Sony Pixel Power calrec Sony

How GeForce RTX 50 Series GPUs Are Built to Supercharge Generative AI on PCs

05/02/2025

NVIDIA's GeForce RTX 5090 and 5080 GPUs - which are based on the groundbreaking NVIDIA Blackwell architecture -offer up to 8x faster frame rates with NVIDIA DLSS 4 technology, lower latency with NVIDIA Reflex 2 and enhanced graphical fidelity with NVIDIA RTX neural shaders.

These GPUs were built to accelerate the latest generative AI workloads, delivering up to 3,352 AI trillion operations per second (TOPS), enabling incredible experiences for AI enthusiasts, gamers, creators and developers.

To help AI developers and enthusiasts harness these capabilities, NVIDIA at the CES trade show last month unveiled NVIDIA NIM and AI Blueprints for RTX. NVIDIA NIM microservices are prepackaged generative AI models that let developers and enthusiasts easily get started with generative AI, iterate quickly and harness the power of RTX for accelerating AI on Windows PCs. NVIDIA AI Blueprints are reference projects that show developers how to use NIM microservices to build the next generation of AI experiences.

NIM and AI Blueprints are optimized for GeForce RTX 50 Series GPUs. These technologies work together seamlessly to help developers and enthusiasts build, iterate and deliver cutting-edge AI experiences on AI PCs.

NVIDIA NIM Accelerates Generative AI on PCs While AI model development is rapidly advancing, bringing these innovations to PCs remains a challenge for many people. Models posted on platforms like Hugging Face must be curated, adapted and quantized to run on PC. They also need to be integrated into new AI application programming interfaces (APIs) to ensure compatibility with existing tools, and converted to optimized inference backends for peak performance.

NVIDIA NIM microservices for RTX AI PCs and workstations can ease the complexity of this process by providing access to community-driven and NVIDIA-developed AI models. These microservices are easy to download and connect to via industry-standard APIs and span the key modalities essential for AI PCs. They are also compatible with a wide range of AI tools and offer flexible deployment options, whether on PCs, in data centers, or in the cloud.

NIM microservices include everything needed to run optimized models on PCs with RTX GPUs, including prebuilt engines for specific GPUs, the NVIDIA TensorRT software development kit (SDK), the open-source NVIDIA TensorRT-LLM library for accelerated inference using Tensor Cores, and more.

Microsoft and NVIDIA worked together to enable NIM microservices and AI Blueprints for RTX in Windows Subsystem for Linux (WSL2). With WSL2, the same AI containers that run on data center GPUs can now run efficiently on RTX PCs, making it easier for developers to build, test and deploy AI models across platforms.

In addition, NIM and AI Blueprints harness key innovations of the Blackwell architecture that the GeForce RTX 50 series is built on, including fifth-generation Tensor Cores and support for FP4 precision.

Tensor Cores Drive Next-Gen AI Performance AI calculations are incredibly demanding and require vast amounts of processing power. Whether generating images and videos or understanding language and making real-time decisions, AI models rely on hundreds of trillions of mathematical operations to be completed every second. To keep up, computers need specialized hardware built specifically for AI.

NVIDIA GeForce RTX desktop GPUs deliver up to 3,352 AI TOPS for unmatched speed and efficiency in AI-powered workflows. In 2018, NVIDIA GeForce RTX GPUs changed the game by introducing Tensor Cores - dedicated AI processors designed to handle these intensive workloads. Unlike traditional computing cores, Tensor Cores are built to accelerate AI by performing calculations faster and more efficiently. This breakthrough helped bring AI-powered gaming, creative tools and productivity applications into the mainstream.

Blackwell architecture takes AI acceleration to the next level. The fifth-generation Tensor Cores in Blackwell GPUs deliver up to 3,352 AI TOPS to handle even more demanding AI tasks and simultaneously run multiple AI models. This means faster AI-driven experiences, from real-time rendering to intelligent assistants, that pave the way for greater innovation in gaming, content creation and beyond.

FP4 - Smaller Models, Bigger Performance Another way to optimize AI performance is through quantization, a technique that reduces model sizes, enabling the models to run faster while reducing the memory requirements.

Enter FP4 - an advanced quantization format that allows AI models to run faster and leaner without compromising output quality. Compared with FP16, it reduces model size by up to 60% and more than doubles performance, with minimal degradation.

For example, Black Forest Labs' FLUX.1 [dev] model at FP16 requires over 23GB of VRAM, meaning it can only be supported by the GeForce RTX 4090 and professional GPUs. With FP4, FLUX.1 [dev] requires less than 10GB, so it can run locally on more GeForce RTX GPUs.

On a GeForce RTX 4090 with FP16, the FLUX.1 [dev] model can generate images in 15 seconds with just 30 steps. With a GeForce RTX 5090 with FP4, images can be generated in just over five seconds.

FP4 is natively supported by the Blackwell architecture, making it easier than ever to deploy high-performance AI on local PCs. It's also integrated into NIM microservices, effectively optimizing models that were previously difficult to quantize. By enabling more efficient AI processing, FP4 helps to bring faster, smarter AI experiences for content creation.

AI Blueprints Power Advanced AI Workflows on RTX PCs NVIDIA AI Blueprints, built on NIM microservices, provide prepackaged, optimized reference implementations that make it easier to develop advanced AI-powered projects - whether for digital humans, podcast generators or application assistants.

At CES, NVIDIA demonstrated PDF to Podcast
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-blackwell-nim-blueprints-p...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

24/07/2026

Mediagenix To Feature 'Real-Time Media Enterprise Platform At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Peacock Posts First Profits, Adds 2 Million Subs in Q2 2026

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Edward F. OKeefe Named President and CEO of The WNET Group

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

TiVo Ads, OpenGlass Launch Programmatic Access to the TV Homescreen

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Digital Alert Systems DASDEC Platform Supports FCCs New P...

Current DASDEC software enables customers to comply with the FCC's new 15-character password mandate without requiring updates LYNDONVILLE, N.Y. July 23,...

24/07/2026

SDVI to Showcase Next-Generation Rally Platform and New T...

At the IBC2026 Show, SDVI will give European media organizations their first hands-on look at the next-generation Rally media supply chain management platform f...

24/07/2026

Sonnet Technologies at IBC2026

Sonnet Technologies at IBC2026 Brie Clayton July 23, 2026 0 Comments Hero image: Sonnet Twin25G T5 Thunderbolt 5 Adapter At this year's IBC Sho...

24/07/2026

Musora Enhances Online Music Lessons with Blackmagic Design

Musora Enhances Online Music Lessons with Blackmagic Design Brie Clayton July 23, 2026 0 Comments Director of Production Josh Holliday details workflo...

23/07/2026

Record-breaking World Cup has advertisers cheering

Staines-upon-Thames, UK, 23rd, JULY, 2026 - Yospace, the trusted leader in Dynamic Ad Insertion (DAI), stitched 11.57 billion one-to-one addressable advertisem...

23/07/2026

SVG Students To Watch: Shansley Glenn, University of Oklahoma

This Spring 2026 graduate from Honolulu found a home at SoonerVision as a live-production star and is ready to enter the industry as a replay op on Prime Video&...

23/07/2026

Miked Up Is an Everyday Deal for the Athletes Unlimited Softball League

As the AUSL postseason begins tonight, listening in to players during games enhances fan engagement for the young organization Ballplayers chatting with announ...

23/07/2026

Snap Announces AR and Creator Activations at Esports World Cup 2026 in Paris

Snap Inc. and the Esports Foundation have announced Snap's activations at the Esports World Cup 2026 in Paris, running July 6 through August 23. For the fir...

23/07/2026

Sony Introduces FX5 Full-Frame Cinema Line Camera

Sony has announced the FX5, a full-frame Cinema Line camera built around a newly developed fully stacked Exmor RS CMOS image sensor and BIONZ XR2 image processi...

23/07/2026

TNDV Powers Pickleball Slam 4 Broadcast for Ohlmeyer Kusserow Group

TNDV (a division of Live Media Group) provided technical production support for the Pickleball Slam 4 live broadcast from Seminole Hard Rock Live in Hollywood, ...

23/07/2026

LTN Surpasses 3,000 Satellite-to-IP Migrations as FCC Approves Upper C-Band Auction Rules

LTN has announced it has completed satellite-to-IP migrations for more than 3,00...

23/07/2026

Daktronics Announces 2026 DakClassroom Student Showcase Winners

Daktronics has announced the winners of the 2026 DakClassroom Student Showcase, a national competition recognizing student work in media production, storytellin...

23/07/2026

beIN Sports Extends Exclusive Roland-Garros Rights Across 10 Asian Markets Through 2031

The French Tennis Federation (FFT) and beIN Media Group have announced a five-ye...

23/07/2026

Clear-Com Provides Intercom System for Fryderyk Awards Gala at Tauron Arena Krakw

Clear-Com provided the communications infrastructure for the Fryderyk Awards Gal...

23/07/2026

How the FIFA World Cup's Record Revenue Masks a Structural Market Contraction

The 2026 FIFA World Cup is, on paper, an unparalleled financial success. Total t...

23/07/2026

From Green Screen to LED: How BBC Sport's World Cup Studio Became the Blueprint for Match of the Day

Standing inside HQ3 at MediaCity Studios during the FIFA World Cup 2026, it quic...

23/07/2026

How the 2026 FIFA World Cup Tightened the Bond Between the FOX Sports Digital, Linear Teams

Having attracted upwards of 17 billion views throughout the tourney, the broadca...

23/07/2026

Low End Candy release Preverb

Quickly creates reverse reverb effects Low End Candy have recently released a new plug-in that offers a quick and simple way to create reverse reverb effect...

23/07/2026

Expressive E Noisy 2.6 arrives

New engines, resonators, effects & more Expressive E's versatile soft synth has just been treated to an update that greatly expands its sonic range. Noi...

23/07/2026

SGL Carbon expands photovoltaic capacity at its Ort im Innkreis site

SGL Carbon has further expanded its photovoltaic capacity at its Ort im Innkreis site in Austria. With the commissioning of new PV carports, the sites solar sys...

23/07/2026

NITV launches new By Mob For Mob series in partnership with NRMA Insurance

NITV launches new By Mob For Mob series in partnership with NRMA Insurance 23 July, 2026 Media releases National Indigenous Television (NITV) has launched ...

23/07/2026

Rohde & Schwarz presents new software for three-phase power analysis on MXO series oscilloscopes

Rohde & Schwarz presents new software for three-phase power analysis on MXO seri...

23/07/2026

Why The Next Big Opportunity in Sports Lies Outside the Stadium

In our latest blog, Laura Rognoni explores how the launch of Play Snooker reflects a wider shift in sports economics - from monetising peak broadcast audiences ...

23/07/2026

Scaling Smart with Vivid Broadcast

Download Now! To receive a short case study showcasing Vivid Broadcast's audio setup, please enter the following details: -- First Name* First Name ...

23/07/2026

Sony Unveils FX5 Full-Frame Camera

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

Sachtler To Show Akti8T Fluid Head, Flowtech75 Tripod At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

NextGen TV Launches in Cleveland

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

Yospace Stitched 11.57 Billion Ads into Live Streams During World Cup

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

At IBC2026 Witbe Will Showcase Tests That Build Themselve...

Witbe brings its AI-native testing and monitoring infrastructure to Amsterdam: demonstrations on real devices, a peer-reviewed technical paper in the conference...

23/07/2026

Quickplay Caretta Research Evergent and Yospace Announce...

Quickplay, Caretta Research, Evergent, and Yospace have announced that the renowned IBC Pride Happy Hour will once again bring the vibe and fun back to IBC on F...

23/07/2026

IBC2026 Interra Systems Brings Trusted Media Intelligence...

At IBC2026, Interra Systems will present this year's focus: operational AI at scale for QC, monitoring, and captioning workflows. The industry has moved pas...

23/07/2026

Illusionfx is finally coming!

Illusionfx is finally coming! Alex Perea July 23, 2026 0 Comments The new website is now live to mark the occasion. Since the last update, feedback h...

23/07/2026

Evergent showcases AI agents for streaming retention at I...

Evergent (5.A86) will showcase its Agentic Revenue Orchestration Platform for streaming services, sports leagues, pay-TV operators at IBC2026 (RAI Amsterdam, 11...

23/07/2026

Brian Jones Named NCTCs New CFO

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

Scripps Unites TV Operations Under Dean Littleton's Leadership

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

2D House is First North American Rental Facility to Offer...

David Dvir, 2D founder (left), Sundeep Reddy (center), and Jean-Marc Bouchut (right), both of Zeiss...

23/07/2026

Screen Australia announces new national documentary accelerator program

Screen Australia announces new national documentary accelerator program 23 July 2026 Screen Australia has today announced the Above the Line Documentary Accel...

23/07/2026

At AI Summit, South Korea Outlines Its AI Future With NVIDIA and Partners

At this week's AI Summit in San Francisco, South Korean President Jae Myung Lee and some of the country's top business leaders and researchers are meeti...

23/07/2026

X-Rite Pantone and Fashion Institute of Technology (FIT) Partner to Advance Digital Color Education

X-Rite Pantone and Fashion Institute of Technology (FIT) Partner to Advance Digi...

23/07/2026

New Samsung Galaxy Foldable range available now to pre-order on Sky Mobile

Thursday 23 July 2026 New Samsung Galaxy Foldable range available now to pre-order on Sky Mobile Sky Mobile, the award-winning network voted this year by Expe...

23/07/2026

Jason Statham leads Sky Original action thriller MUTINY in explosive new trailer

Thursday 23 July 2026 Jason Statham leads Sky Original action thriller MUTINY in explosive new trailerTurn on cookies to view this content. Go to Privacy optio...

23/07/2026

Riedel Implements RefCam and Easy5G for the First Time at an International Soccer Match

Wuppertal July 23, 2026 Riedel Implements RefCam and Easy5G for the First Time...