Sony Pixel Power calrec Sony

How GeForce RTX 50 Series GPUs Are Built to Supercharge Generative AI on PCs

05/02/2025

NVIDIA's GeForce RTX 5090 and 5080 GPUs - which are based on the groundbreaking NVIDIA Blackwell architecture -offer up to 8x faster frame rates with NVIDIA DLSS 4 technology, lower latency with NVIDIA Reflex 2 and enhanced graphical fidelity with NVIDIA RTX neural shaders.

These GPUs were built to accelerate the latest generative AI workloads, delivering up to 3,352 AI trillion operations per second (TOPS), enabling incredible experiences for AI enthusiasts, gamers, creators and developers.

To help AI developers and enthusiasts harness these capabilities, NVIDIA at the CES trade show last month unveiled NVIDIA NIM and AI Blueprints for RTX. NVIDIA NIM microservices are prepackaged generative AI models that let developers and enthusiasts easily get started with generative AI, iterate quickly and harness the power of RTX for accelerating AI on Windows PCs. NVIDIA AI Blueprints are reference projects that show developers how to use NIM microservices to build the next generation of AI experiences.

NIM and AI Blueprints are optimized for GeForce RTX 50 Series GPUs. These technologies work together seamlessly to help developers and enthusiasts build, iterate and deliver cutting-edge AI experiences on AI PCs.

NVIDIA NIM Accelerates Generative AI on PCs While AI model development is rapidly advancing, bringing these innovations to PCs remains a challenge for many people. Models posted on platforms like Hugging Face must be curated, adapted and quantized to run on PC. They also need to be integrated into new AI application programming interfaces (APIs) to ensure compatibility with existing tools, and converted to optimized inference backends for peak performance.

NVIDIA NIM microservices for RTX AI PCs and workstations can ease the complexity of this process by providing access to community-driven and NVIDIA-developed AI models. These microservices are easy to download and connect to via industry-standard APIs and span the key modalities essential for AI PCs. They are also compatible with a wide range of AI tools and offer flexible deployment options, whether on PCs, in data centers, or in the cloud.

NIM microservices include everything needed to run optimized models on PCs with RTX GPUs, including prebuilt engines for specific GPUs, the NVIDIA TensorRT software development kit (SDK), the open-source NVIDIA TensorRT-LLM library for accelerated inference using Tensor Cores, and more.

Microsoft and NVIDIA worked together to enable NIM microservices and AI Blueprints for RTX in Windows Subsystem for Linux (WSL2). With WSL2, the same AI containers that run on data center GPUs can now run efficiently on RTX PCs, making it easier for developers to build, test and deploy AI models across platforms.

In addition, NIM and AI Blueprints harness key innovations of the Blackwell architecture that the GeForce RTX 50 series is built on, including fifth-generation Tensor Cores and support for FP4 precision.

Tensor Cores Drive Next-Gen AI Performance AI calculations are incredibly demanding and require vast amounts of processing power. Whether generating images and videos or understanding language and making real-time decisions, AI models rely on hundreds of trillions of mathematical operations to be completed every second. To keep up, computers need specialized hardware built specifically for AI.

NVIDIA GeForce RTX desktop GPUs deliver up to 3,352 AI TOPS for unmatched speed and efficiency in AI-powered workflows. In 2018, NVIDIA GeForce RTX GPUs changed the game by introducing Tensor Cores - dedicated AI processors designed to handle these intensive workloads. Unlike traditional computing cores, Tensor Cores are built to accelerate AI by performing calculations faster and more efficiently. This breakthrough helped bring AI-powered gaming, creative tools and productivity applications into the mainstream.

Blackwell architecture takes AI acceleration to the next level. The fifth-generation Tensor Cores in Blackwell GPUs deliver up to 3,352 AI TOPS to handle even more demanding AI tasks and simultaneously run multiple AI models. This means faster AI-driven experiences, from real-time rendering to intelligent assistants, that pave the way for greater innovation in gaming, content creation and beyond.

FP4 - Smaller Models, Bigger Performance Another way to optimize AI performance is through quantization, a technique that reduces model sizes, enabling the models to run faster while reducing the memory requirements.

Enter FP4 - an advanced quantization format that allows AI models to run faster and leaner without compromising output quality. Compared with FP16, it reduces model size by up to 60% and more than doubles performance, with minimal degradation.

For example, Black Forest Labs' FLUX.1 [dev] model at FP16 requires over 23GB of VRAM, meaning it can only be supported by the GeForce RTX 4090 and professional GPUs. With FP4, FLUX.1 [dev] requires less than 10GB, so it can run locally on more GeForce RTX GPUs.

On a GeForce RTX 4090 with FP16, the FLUX.1 [dev] model can generate images in 15 seconds with just 30 steps. With a GeForce RTX 5090 with FP4, images can be generated in just over five seconds.

FP4 is natively supported by the Blackwell architecture, making it easier than ever to deploy high-performance AI on local PCs. It's also integrated into NIM microservices, effectively optimizing models that were previously difficult to quantize. By enabling more efficient AI processing, FP4 helps to bring faster, smarter AI experiences for content creation.

AI Blueprints Power Advanced AI Workflows on RTX PCs NVIDIA AI Blueprints, built on NIM microservices, provide prepackaged, optimized reference implementations that make it easier to develop advanced AI-powered projects - whether for digital humans, podcast generators or application assistants.

At CES, NVIDIA demonstrated PDF to Podcast
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-blackwell-nim-blueprints-p...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

06/08/2026

ASG Ups Michele Ferreira to Chief Business Officer

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

WNBC and WNJU Expand New York Giants Deal

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

Utah Scientific to Highlight NBOSS at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

Disney, TikTok Ink Global Short-Form Content-Sharing Deal

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

Kane Peterson Joins QuickLink's North America Team

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

FCC Returns $881 Million in Unused TV Broadcaster Relocation Funds

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

PlayBox Neo to highlight secure and scalable workflow del...

At this year's SET EXPO, PlayBox Neo will present recent innovations across its PlayBox Neo Suite and integrated range of broadcast media solutions. By show...

06/08/2026

Modern Streaming Solutions Private Limited Partners with...

Live demo at IBC2026 VisualOn Booth, Hall 5, Stand A55 Amsterdam, Netherlands Modern Streaming Solutions Private Limited, a rising force in India's dig...

06/08/2026

Screen Australia and YouTube Australia fund five new teams through eleventh Skip Ahead initiative

Screen Australia and YouTube Australia fund five new teams through eleventh Skip...

06/08/2026

How Karukera Studio Built a Media Production Hub with SNS EVO

How Karukera Studio Built a Media Production Hub with SNS EVO Melanie Ciotti August 5, 2026 0 Comments Hero images displays Karukera Studio in Sainte-...

06/08/2026

NHK drama series Rosanjin no Kamado shot on PYXIS 6K

NHK drama series Rosanjin no Kamado shot on PYXIS 6K Brie Clayton August 5, 2026 0 Comments Blackmagic PYXIS 6K and DaVinci Resolve Studio capture the...

06/08/2026

Camera Match: AutoSetup 3d Plugin / script for Photomontages- Cinema 4D

Camera Match: AutoSetup 3d Plugin / script for Photomontages- Cinema 4D Jamie Cardoso August 5, 2026 0 Comments If you do any kind of Architectural Vi...

05/08/2026

Thomson toolkit added to virtual hub built to strengthen climate storytelling

Thomson's Climate Crisis Toolkit for Media in Tanzania is being included in a new virtual library designed to ensure accurate and engaging storytelling arou...

05/08/2026

SVG Regional Sports Production Summit 2026: All Sessions Now Available to Watch on SVG PLAY

RSNs, teams, leagues, and streamers explore the present and future of local spor...

05/08/2026

SVG New Sponsor Spotlight: Hitachi Vantara's Lenny Khaitov on Building Resilient Data Infrastructure for Sports Production

As sports-production workflows generate larger volumes of unstructured data and ...

05/08/2026

NESN's Women's Celebration Night Returns With Expanded Focus on the Next Generation

Three aspiring broadcasters will contribute on-camera and inside the production ...

05/08/2026

Union County Paints an Authentic Picture of Recovery and Community

Adam Meeks attends the premiere of his film Union County, an official selection of the 2026 Sundance Film Festival. (Photo by Jemal Countess/Sundance Institut...

05/08/2026

Steinberg celebrate VST & HALion anniversaries

Major discounts, updates & remakes of early VST plug-ins Steinberg are currently celebrating two significant anniversaries, with this week marking the 30th ...

05/08/2026

KRK introduce the V Series Five

Flagship monitor range gains wireless remote control KRK's flagship studio monitor range has just been upgraded, with three new fifth-generation models ...

05/08/2026

Rohde & Schwarz launches next phase of Airways New Zealand Air Traffic Control system upgrade

Rohde & Schwarz launches next phase of Airways New Zealand Air Traffic Control s...

05/08/2026

Rohde & Schwarz presents the R&SMP007, a man-portable tactical direction finding system for seamless signal detection from 9 MHz to 8 GHz

Rohde & Schwarz presents the R&S MP007, a man-portable tactical direction findin...

05/08/2026

Australia's retirement sector advertising rises more than 10% as millions plan for life after work according to Nielsen

Advertisers invested $53.6 million in the retirement sector in the last 12 month...

05/08/2026

New Nielsen data shows IKEA's New Zealand launch attracted more than 243,000 shoppers in the last month

Nielsen CMI and Ad Intel data reveals who's visiting IKEA, where else they s...

05/08/2026

Nielsen expands Four-Screen Ad Deduplication across CTV in Japan

Media buyers and sellers can now compare deduplicated campaign reach across computer, mobile, connected TV and linear TV across all measurable CTV publishers in...

05/08/2026

Stranger Things,' Bluey,' The Pitt' Top Nielsen's Streaming Charts Through First Half of 2026

Stranger Things' Leads All Streaming Titles with 23.3 Billion Minutes in Fir...

05/08/2026

Live Media Group, Gravity Media Strike Deal on U.S. OB Fleets

Share Copy link Facebook X Linkedin Bluesky Email...

05/08/2026

Beyond VVC: Call for Proposals for Next-Gen Video Coding

Share Copy link Facebook X Linkedin Bluesky Email...

05/08/2026

QuickLink Expands North American Team With Appointment of...

QuickLink, the leading provider of award-winning video production and remote guest integration solutions, announces the appointment of Kane Peterson to its Nort...

05/08/2026

Seven in 10 UK advertisers exceed production budgets desp...

XR research reveals marketers believe they have control over production costs, yet budget overruns, campaign delays and creative cutbacks remain commonplace Se...

05/08/2026

Game On Live Studio Uses Blackmagic Design to Stream Tropical 7s

Game On Live Studio Uses Blackmagic Design to Stream Tropical 7s Brie Clayton August 4, 2026 0 Comments Every match of world's largest youth rugby...

05/08/2026

Chris Fitzgerald to Head TDC's Experiential Growth

Chris Fitzgerald to Head TDC's Experiential Growth Brie Clayton August 4, 2026 0 Comments Technical Direction Company promotes Chris Fitzgerald to...

05/08/2026

Gravity Media, Live Media Group Form Strategic Partnership

Share Copy link Facebook X Linkedin Bluesky Email...

05/08/2026

Samsung Launches World's First HDR10+ Streaming on Prime Video

Share Copy link Facebook X Linkedin Bluesky Email...

05/08/2026

Profuz Digital unveils new advanced search capabilities a...

Profuz Digital is set to launch a powerful upgrade to its Profuz LAPIS digital media management platform at IBC this year at Stand 8.A88. France Galop, Canal+ F...

05/08/2026

KRK Brings Advanced Wireless Control to Professional Moni...

KRK, a Gibson brand and leader in professional studio monitoring for nearly four decades, launches its new V Series Five Studio Monitors, the latest evolution o...

05/08/2026

Stable performance in line with plan - Magyar Telekoms H1 and Q2 2026 results

Network expansion, continued customer growth and stable financial performance characterized Magyar Telekoms business results for the first half and second quart...

05/08/2026

The Sky Foundation launches new bursary programme to support the future of UK dance

Wednesday 5 August 2026 The Sky Foundation launches new bursary programme to su...

05/08/2026

Charlie Sheen Launches Mostly Sheenius in Partnership with Red Seat Ventures

Charlie Sheen Launches Mostly Sheenius in Partnership with Red Seat Ventures After Decades as One of the World's Most Recognizable and Interviewed Celebr...

04/08/2026

MLB's Jason Hedgcock on Using the Cloud To Produce World Baseball Classic Games for Netflix Japan

Live production in the cloud is a growing trend across the industry, and Major L...

04/08/2026

Major League Soccer Names Larry Berg as Next Commissioner; Will Take Helm in 2027

LAFC co-managing owner will succeed Don Garber on Jan. 1, 2027, as league prepar...

04/08/2026

Foresight: Driving Growth Through Broadcast Flexibility - A Calrec + PGA TOUR Case Study

In 2022, when the PGA TOUR was breaking ground on its new, state-of-the-art broa...

04/08/2026

Dealer Cam Debuts as Omaha Productions Takes World Series of Poker Main Event Final Table Live on ESPN

Provided by POVORA, the new camera angle offers a dealer's-eye view of the c...

04/08/2026

USL To Trial FIFA's Football Video Support System During 2026 USL Cup

Spiideo will provide the camera setup, with NEP handling broadcast integration and off-site video operations...

04/08/2026

Game On Live Studio Deploys Blackmagic Design Workflow Across 15 Fields at Tropical 7s

Production team streamed more than 750 youth rugby matches using ATEM switchers,...

04/08/2026

NDI, KTC Partner To Develop Network-Native Commercial Displays

Agreement gives KTC early access to NDI's Advanced SDK for integration across commercial displays, digital signage, and interactive panels...

04/08/2026

IBC2026: IBC Innovation Awards Finalists Highlight Advances in AI, Cloud, Open Standards, and Accessibility

Twelve projects across four categories recognize collaborative work in productio...

04/08/2026

Ekstraklasa, Live Park Select Hawk-Eye for Tracking, Offside, and Broadcast Technology

Multi-year agreement will introduce SkeleTRACK, semi-automated offside, automate...