Sony Pixel Power calrec Sony

How GeForce RTX 50 Series GPUs Are Built to Supercharge Generative AI on PCs

05/02/2025

NVIDIA's GeForce RTX 5090 and 5080 GPUs - which are based on the groundbreaking NVIDIA Blackwell architecture -offer up to 8x faster frame rates with NVIDIA DLSS 4 technology, lower latency with NVIDIA Reflex 2 and enhanced graphical fidelity with NVIDIA RTX neural shaders.

These GPUs were built to accelerate the latest generative AI workloads, delivering up to 3,352 AI trillion operations per second (TOPS), enabling incredible experiences for AI enthusiasts, gamers, creators and developers.

To help AI developers and enthusiasts harness these capabilities, NVIDIA at the CES trade show last month unveiled NVIDIA NIM and AI Blueprints for RTX. NVIDIA NIM microservices are prepackaged generative AI models that let developers and enthusiasts easily get started with generative AI, iterate quickly and harness the power of RTX for accelerating AI on Windows PCs. NVIDIA AI Blueprints are reference projects that show developers how to use NIM microservices to build the next generation of AI experiences.

NIM and AI Blueprints are optimized for GeForce RTX 50 Series GPUs. These technologies work together seamlessly to help developers and enthusiasts build, iterate and deliver cutting-edge AI experiences on AI PCs.

NVIDIA NIM Accelerates Generative AI on PCs While AI model development is rapidly advancing, bringing these innovations to PCs remains a challenge for many people. Models posted on platforms like Hugging Face must be curated, adapted and quantized to run on PC. They also need to be integrated into new AI application programming interfaces (APIs) to ensure compatibility with existing tools, and converted to optimized inference backends for peak performance.

NVIDIA NIM microservices for RTX AI PCs and workstations can ease the complexity of this process by providing access to community-driven and NVIDIA-developed AI models. These microservices are easy to download and connect to via industry-standard APIs and span the key modalities essential for AI PCs. They are also compatible with a wide range of AI tools and offer flexible deployment options, whether on PCs, in data centers, or in the cloud.

NIM microservices include everything needed to run optimized models on PCs with RTX GPUs, including prebuilt engines for specific GPUs, the NVIDIA TensorRT software development kit (SDK), the open-source NVIDIA TensorRT-LLM library for accelerated inference using Tensor Cores, and more.

Microsoft and NVIDIA worked together to enable NIM microservices and AI Blueprints for RTX in Windows Subsystem for Linux (WSL2). With WSL2, the same AI containers that run on data center GPUs can now run efficiently on RTX PCs, making it easier for developers to build, test and deploy AI models across platforms.

In addition, NIM and AI Blueprints harness key innovations of the Blackwell architecture that the GeForce RTX 50 series is built on, including fifth-generation Tensor Cores and support for FP4 precision.

Tensor Cores Drive Next-Gen AI Performance AI calculations are incredibly demanding and require vast amounts of processing power. Whether generating images and videos or understanding language and making real-time decisions, AI models rely on hundreds of trillions of mathematical operations to be completed every second. To keep up, computers need specialized hardware built specifically for AI.

NVIDIA GeForce RTX desktop GPUs deliver up to 3,352 AI TOPS for unmatched speed and efficiency in AI-powered workflows. In 2018, NVIDIA GeForce RTX GPUs changed the game by introducing Tensor Cores - dedicated AI processors designed to handle these intensive workloads. Unlike traditional computing cores, Tensor Cores are built to accelerate AI by performing calculations faster and more efficiently. This breakthrough helped bring AI-powered gaming, creative tools and productivity applications into the mainstream.

Blackwell architecture takes AI acceleration to the next level. The fifth-generation Tensor Cores in Blackwell GPUs deliver up to 3,352 AI TOPS to handle even more demanding AI tasks and simultaneously run multiple AI models. This means faster AI-driven experiences, from real-time rendering to intelligent assistants, that pave the way for greater innovation in gaming, content creation and beyond.

FP4 - Smaller Models, Bigger Performance Another way to optimize AI performance is through quantization, a technique that reduces model sizes, enabling the models to run faster while reducing the memory requirements.

Enter FP4 - an advanced quantization format that allows AI models to run faster and leaner without compromising output quality. Compared with FP16, it reduces model size by up to 60% and more than doubles performance, with minimal degradation.

For example, Black Forest Labs' FLUX.1 [dev] model at FP16 requires over 23GB of VRAM, meaning it can only be supported by the GeForce RTX 4090 and professional GPUs. With FP4, FLUX.1 [dev] requires less than 10GB, so it can run locally on more GeForce RTX GPUs.

On a GeForce RTX 4090 with FP16, the FLUX.1 [dev] model can generate images in 15 seconds with just 30 steps. With a GeForce RTX 5090 with FP4, images can be generated in just over five seconds.

FP4 is natively supported by the Blackwell architecture, making it easier than ever to deploy high-performance AI on local PCs. It's also integrated into NIM microservices, effectively optimizing models that were previously difficult to quantize. By enabling more efficient AI processing, FP4 helps to bring faster, smarter AI experiences for content creation.

AI Blueprints Power Advanced AI Workflows on RTX PCs NVIDIA AI Blueprints, built on NIM microservices, provide prepackaged, optimized reference implementations that make it easier to develop advanced AI-powered projects - whether for digital humans, podcast generators or application assistants.

At CES, NVIDIA demonstrated PDF to Podcast
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-blackwell-nim-blueprints-p...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

24/07/2026

ESPN Adds New Production Features for NFL FLAG Championships

Referee hat cameras, player/coach mics, and virtual graphics will be deployed at the three-day event for the first time The NFL FLAG Championships return to ES...

24/07/2026

Qvest, Ateme and Scaleway Deliver Sovereign OTT Platforms for European Broadcasters

Qvest, Ateme, and Scaleway have partnered to offer broadcasters, media organizat...

24/07/2026

LTN Reaches 3,000 Satellite-to-IP Migrations as FCC Votes on C-Band Auction

LTN has completed satellite-to-IP migrations for more than 3,000 broadcaster, MVPD (Multi-Channel Video Programming Distributor), head-end, and content owner si...

24/07/2026

Chyron Releases Virtual Placement 8.1

Chyron has released Virtual Placement 8.1, an update to its live sports virtual graphics platform. The release adds workflow and graphics changes across chroma ...

24/07/2026

Riedel Deploys RefCam and Easy5G at International Soccer Match

Riedel's RefCam Live was used for the first time at an international soccer match during a friendly between the German men's national team and Ghana in ...

24/07/2026

USSI Global Offers Services for Next Phase of C-Band Spectrum Transition

USSI Global said it is prepared to help broadcasters, satellite network operators, and media organizations manage the next phase of C-band spectrum clearing, fo...

24/07/2026

Fubo Launches The Athletic Video Hub on CTV

FuboTV and The Athletic have launched The Athletic Video Hub on Fubo, bringing The Athletic's sports video content to connected TV (CTV) for the first time....

24/07/2026

Tagboard Integrates With Momento To Display Fan Reaction Photos on Venue Screens

Tagboard and Momento have partnered to bring Momento's fan reaction photos to venue videoboards in real time following big plays. The Seattle Mariners will ...

24/07/2026

Stephen Arnold Music Creates Anthem for Fox Television Stations FIFA World Cup Coverage

Stephen Arnold Music (SAM) created an anthem called The World Is Here for Fox ...

24/07/2026

CazTV Acquires Exclusive Brazilian WTA Tour Rights Through 2030

Caz TV has acquired Brazilian broadcast rights to the entire WTA Tour driven by Mercedes-Benz, covering all WTA 250, WTA 500, and WTA 1000 tournaments. The agre...

24/07/2026

SiriusXM and WWE Launch WWE Radio on Channel 156

SiriusXM and WWE have launched WWE Radio on SiriusXM channel 156, beginning Monday, July 27. The channel will carry live audio of WWE Premium Live Events, audio...

24/07/2026

Harvard Athletics Uses AJA Equipment for Collegiate Sports Production

Harvard Athletics produces more than 325 live NCAA Division 1 sports events and 500 edited videos per year. To manage video capture, streaming, recording, and s...

24/07/2026

Chyrons PRIME 5 Supported Telemundos FIFA World Cup 2026 Graphics Production

Chyron's PRIME 5 graphics platform supported live graphics workflows for NBCUniversal Telemundo's FIFA World Cup 2026 coverage across Telemundo, Univers...

24/07/2026

NBC Sports Prioritizes Data in Presentation of 113th Tour de France

Wearable tech returns to the coverage, and a brand-new mobile unit is rolled out for the 2026 edition The 21-stage Tour de France is nearing its conclusion. Th...

24/07/2026

ESPN Leans Into Player Access, Referee Cam for WNBA All-Star Weekend in Chicago

More than 20 cameras, extensive player and coach audio, and a REMCO production model will power coverage of the league's showcase For an event designed to ...

24/07/2026

F1 Unveils Strategy Insight Graphic Powered by AWS at Hungarian Grand Prix

New broadcast tool uses live timing, telemetry, and predictive analysis to decode real-time team decision-making for fans at home...

24/07/2026

Ratings Roundup: World Cup Final Draws Largest Non-NFL U.S. TV Audience in Nearly 30 Years

Ratings Roundup is a rundown of recent rating news and is derived from press rel...

24/07/2026

SRM Sounds introduce Max Richter Strings

First string library captured at Studio Richter Mahr The latest sample library to be created at Max Richter's Studio Richter Mahr facility captures the ...

24/07/2026

KIT Plugins release BB Chamber D

Official emulation of Blackbird Studios reverb chamber In their latest collaboration with Blackbird Studios, KIT Plugins have captured the sound of the Stud...

24/07/2026

Behind Netflix's Emmy-nominated Monster: Bind Studio and FileRunner on the VFX pipeline

Sohonet's partners at BIND Studio have published a great case study on the V...

24/07/2026

Calrec Craft Interview with Sound Engineer Angela Gomez

Angela Gomez brings over 14 years of experience in broadcast communications and audio engineering, specialising in live outside broadcasts, live sports and larg...

24/07/2026

Harvard Athletics Transforms Collegiate Sports Storytelli...

Between the maturation of IP and remote production workflows, collegiate sports production is advancing rapidly. For an Ivy League institution like Harvard, kee...

24/07/2026

iWedia announces the launch of Teatro Factory - A groundb...

iWedia, a global provider of software solutions for connected TV devices, today announces the launch of Teatro Factory, a new operator-facing software factory o...

24/07/2026

Record-breaking World Cup has advertisers cheering

Yospace, the trusted leader in Dynamic Ad Insertion (DAI), stitched 11.57 billion one-to-one addressable advertisements into live video streams during the 2026 ...

24/07/2026

Mediagenix To Feature 'Real-Time Media Enterprise Platform At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Peacock Posts First Profits, Adds 2 Million Subs in Q2 2026

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Edward F. OKeefe Named President and CEO of The WNET Group

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

TiVo Ads, OpenGlass Launch Programmatic Access to the TV Homescreen

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Digital Alert Systems DASDEC Platform Supports FCCs New P...

Current DASDEC software enables customers to comply with the FCC's new 15-character password mandate without requiring updates LYNDONVILLE, N.Y. July 23,...

24/07/2026

SDVI to Showcase Next-Generation Rally Platform and New T...

At the IBC2026 Show, SDVI will give European media organizations their first hands-on look at the next-generation Rally media supply chain management platform f...

24/07/2026

Sonnet Technologies at IBC2026

Sonnet Technologies at IBC2026 Brie Clayton July 23, 2026 0 Comments Hero image: Sonnet Twin25G T5 Thunderbolt 5 Adapter At this year's IBC Sho...

24/07/2026

Musora Enhances Online Music Lessons with Blackmagic Design

Musora Enhances Online Music Lessons with Blackmagic Design Brie Clayton July 23, 2026 0 Comments Director of Production Josh Holliday details workflo...

24/07/2026

The Future of Live Production: How DMC Is Combining Traditional OB with Software-Defined Remote Production

Interview with Production 360. Original article published here The theme of thi...

24/07/2026

From postPerspective: Pixar Colorist Susan Brunig Talks Pre-Grading, More for Toy Story 5

Article courtesy of postPerspective Read the article While Toy Story 5 maintai...

24/07/2026

Kerry and Mayo fans Up For The Match as excitement builds in Croke Park on the eve of the football final

Kerry and Mayo fans Up For The Match as excitement builds in Croke Park on the e...

23/07/2026

Record-breaking World Cup has advertisers cheering

Staines-upon-Thames, UK, 23rd, JULY, 2026 - Yospace, the trusted leader in Dynamic Ad Insertion (DAI), stitched 11.57 billion one-to-one addressable advertisem...

23/07/2026

SVG Students To Watch: Shansley Glenn, University of Oklahoma

This Spring 2026 graduate from Honolulu found a home at SoonerVision as a live-production star and is ready to enter the industry as a replay op on Prime Video&...

23/07/2026

Miked Up Is an Everyday Deal for the Athletes Unlimited Softball League

As the AUSL postseason begins tonight, listening in to players during games enhances fan engagement for the young organization Ballplayers chatting with announ...

23/07/2026

Snap Announces AR and Creator Activations at Esports World Cup 2026 in Paris

Snap Inc. and the Esports Foundation have announced Snap's activations at the Esports World Cup 2026 in Paris, running July 6 through August 23. For the fir...

23/07/2026

Sony Introduces FX5 Full-Frame Cinema Line Camera

Sony has announced the FX5, a full-frame Cinema Line camera built around a newly developed fully stacked Exmor RS CMOS image sensor and BIONZ XR2 image processi...

23/07/2026

TNDV Powers Pickleball Slam 4 Broadcast for Ohlmeyer Kusserow Group

TNDV (a division of Live Media Group) provided technical production support for the Pickleball Slam 4 live broadcast from Seminole Hard Rock Live in Hollywood, ...

23/07/2026

LTN Surpasses 3,000 Satellite-to-IP Migrations as FCC Approves Upper C-Band Auction Rules

LTN has announced it has completed satellite-to-IP migrations for more than 3,00...

23/07/2026

Daktronics Announces 2026 DakClassroom Student Showcase Winners

Daktronics has announced the winners of the 2026 DakClassroom Student Showcase, a national competition recognizing student work in media production, storytellin...

23/07/2026

beIN Sports Extends Exclusive Roland-Garros Rights Across 10 Asian Markets Through 2031

The French Tennis Federation (FFT) and beIN Media Group have announced a five-ye...

23/07/2026

Clear-Com Provides Intercom System for Fryderyk Awards Gala at Tauron Arena Krakw

Clear-Com provided the communications infrastructure for the Fryderyk Awards Gal...

23/07/2026

How the FIFA World Cup's Record Revenue Masks a Structural Market Contraction

The 2026 FIFA World Cup is, on paper, an unparalleled financial success. Total t...