Sony Pixel Power calrec Sony

How GeForce RTX 50 Series GPUs Are Built to Supercharge Generative AI on PCs

05/02/2025

NVIDIA's GeForce RTX 5090 and 5080 GPUs - which are based on the groundbreaking NVIDIA Blackwell architecture -offer up to 8x faster frame rates with NVIDIA DLSS 4 technology, lower latency with NVIDIA Reflex 2 and enhanced graphical fidelity with NVIDIA RTX neural shaders.

These GPUs were built to accelerate the latest generative AI workloads, delivering up to 3,352 AI trillion operations per second (TOPS), enabling incredible experiences for AI enthusiasts, gamers, creators and developers.

To help AI developers and enthusiasts harness these capabilities, NVIDIA at the CES trade show last month unveiled NVIDIA NIM and AI Blueprints for RTX. NVIDIA NIM microservices are prepackaged generative AI models that let developers and enthusiasts easily get started with generative AI, iterate quickly and harness the power of RTX for accelerating AI on Windows PCs. NVIDIA AI Blueprints are reference projects that show developers how to use NIM microservices to build the next generation of AI experiences.

NIM and AI Blueprints are optimized for GeForce RTX 50 Series GPUs. These technologies work together seamlessly to help developers and enthusiasts build, iterate and deliver cutting-edge AI experiences on AI PCs.

NVIDIA NIM Accelerates Generative AI on PCs While AI model development is rapidly advancing, bringing these innovations to PCs remains a challenge for many people. Models posted on platforms like Hugging Face must be curated, adapted and quantized to run on PC. They also need to be integrated into new AI application programming interfaces (APIs) to ensure compatibility with existing tools, and converted to optimized inference backends for peak performance.

NVIDIA NIM microservices for RTX AI PCs and workstations can ease the complexity of this process by providing access to community-driven and NVIDIA-developed AI models. These microservices are easy to download and connect to via industry-standard APIs and span the key modalities essential for AI PCs. They are also compatible with a wide range of AI tools and offer flexible deployment options, whether on PCs, in data centers, or in the cloud.

NIM microservices include everything needed to run optimized models on PCs with RTX GPUs, including prebuilt engines for specific GPUs, the NVIDIA TensorRT software development kit (SDK), the open-source NVIDIA TensorRT-LLM library for accelerated inference using Tensor Cores, and more.

Microsoft and NVIDIA worked together to enable NIM microservices and AI Blueprints for RTX in Windows Subsystem for Linux (WSL2). With WSL2, the same AI containers that run on data center GPUs can now run efficiently on RTX PCs, making it easier for developers to build, test and deploy AI models across platforms.

In addition, NIM and AI Blueprints harness key innovations of the Blackwell architecture that the GeForce RTX 50 series is built on, including fifth-generation Tensor Cores and support for FP4 precision.

Tensor Cores Drive Next-Gen AI Performance AI calculations are incredibly demanding and require vast amounts of processing power. Whether generating images and videos or understanding language and making real-time decisions, AI models rely on hundreds of trillions of mathematical operations to be completed every second. To keep up, computers need specialized hardware built specifically for AI.

NVIDIA GeForce RTX desktop GPUs deliver up to 3,352 AI TOPS for unmatched speed and efficiency in AI-powered workflows. In 2018, NVIDIA GeForce RTX GPUs changed the game by introducing Tensor Cores - dedicated AI processors designed to handle these intensive workloads. Unlike traditional computing cores, Tensor Cores are built to accelerate AI by performing calculations faster and more efficiently. This breakthrough helped bring AI-powered gaming, creative tools and productivity applications into the mainstream.

Blackwell architecture takes AI acceleration to the next level. The fifth-generation Tensor Cores in Blackwell GPUs deliver up to 3,352 AI TOPS to handle even more demanding AI tasks and simultaneously run multiple AI models. This means faster AI-driven experiences, from real-time rendering to intelligent assistants, that pave the way for greater innovation in gaming, content creation and beyond.

FP4 - Smaller Models, Bigger Performance Another way to optimize AI performance is through quantization, a technique that reduces model sizes, enabling the models to run faster while reducing the memory requirements.

Enter FP4 - an advanced quantization format that allows AI models to run faster and leaner without compromising output quality. Compared with FP16, it reduces model size by up to 60% and more than doubles performance, with minimal degradation.

For example, Black Forest Labs' FLUX.1 [dev] model at FP16 requires over 23GB of VRAM, meaning it can only be supported by the GeForce RTX 4090 and professional GPUs. With FP4, FLUX.1 [dev] requires less than 10GB, so it can run locally on more GeForce RTX GPUs.

On a GeForce RTX 4090 with FP16, the FLUX.1 [dev] model can generate images in 15 seconds with just 30 steps. With a GeForce RTX 5090 with FP4, images can be generated in just over five seconds.

FP4 is natively supported by the Blackwell architecture, making it easier than ever to deploy high-performance AI on local PCs. It's also integrated into NIM microservices, effectively optimizing models that were previously difficult to quantize. By enabling more efficient AI processing, FP4 helps to bring faster, smarter AI experiences for content creation.

AI Blueprints Power Advanced AI Workflows on RTX PCs NVIDIA AI Blueprints, built on NIM microservices, provide prepackaged, optimized reference implementations that make it easier to develop advanced AI-powered projects - whether for digital humans, podcast generators or application assistants.

At CES, NVIDIA demonstrated PDF to Podcast
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-blackwell-nim-blueprints-p...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

28/07/2026

LiveU's World Cup Support Breaks Company Records

Share Copy link Facebook X Linkedin Bluesky Email...

28/07/2026

Encompass Selected by Channel 4 to Deliver Managed Linear...

Encompass Digital Media has been selected by Channel 4, one of the UK's public service broadcasters, to deliver managed linear playout services as part of a...

28/07/2026

Cinegy partners with SAMA Digital Media Solutions to sati...

Cinegy GmbH, the premier provider of software-defined television technology, has confirmed a new partnership with leading Korean systems integrator and distribu...

28/07/2026

Limecraft Adds Multicam Player and Audio Fingerprint-Base...

Limecraft today announces version 2026.5 of its AI-powered production platform. Limecraft 2026.5 https://(www.limecraft.com/limecraft-2026-5-multicam-quad-view-...

28/07/2026

Appear powers first large-scale 4k FIFA World Cup viewing...

X Platform technology enabled a premium UHD viewing experience through a hybrid ground-to-cloud architecture developed with Chilevisi n, ClaroVTR and Pixop App...

28/07/2026

LiveU Delivers Record-Breaking LIQ and Cloud Service Depl...

LiveU, the pioneer in IP-video transmission and cloud-based remote production, today announced it has set historic performance records during the 2026 World Foo...

28/07/2026

DHD Releases New Firmware and Options for its Audio Produ...

dhd.audio announces that its latest generation firmware, Version 10.4, is now available to DHD customers. Version 10.4 introduces expanded configuration capabil...

28/07/2026

Study: TV Operating Systems Gain Influence Over Viewing

Share Copy link Facebook X Linkedin Bluesky Email...

28/07/2026

Maryland Public Television Promotes Ling Ling Sun to CTO

Share Copy link Facebook X Linkedin Bluesky Email...

28/07/2026

NUGEN Audio Helps Mix Technician Blake Bunzel Deliver Rel...

Brand's Intuitive Metering and Dialogue Tools Improve Efficiency and Maintain Clarity Across Projects Ranging from Sitcoms to Effects Heavy Fantasy Series ...

28/07/2026

TAG Video Systems Accelerates the Move to Cloud and Virtu...

TAG Video Systems, a leader in 100% software-based realtime media monitoring, multiviewing and quality control (QC), today announced the latest innovations to i...

28/07/2026

Harvard Athletics Transforms Collegiate Sports Storytelling with AJA Gear

Harvard Athletics Transforms Collegiate Sports Storytelling with AJA Gear Brie Clayton July 27, 2026 0 Comments Between the maturation of IP and remot...

28/07/2026

New Live Action Projection Mapping Film Captured with URSA Cine 12K LF

New Live Action Projection Mapping Film Captured with URSA Cine 12K LF Brie Clayton July 27, 2026 0 Comments Large format sensor allows Texas Legacy ...

28/07/2026

NVIDIA Agent Toolkit Expands With New Omniverse Libraries, Putting AI Agents to Work Building Simulation-Ready Worlds

NVIDIA Agent Toolkit Expands With New Omniverse Libraries, Putting AI Agents to ...

28/07/2026

AI Agents Expand Creative Tools to Millions

AI Agents Expand Creative Tools to Millions Brie Clayton July 27, 2026 0 Comments Hero image courtesy of Epic Games Leading creative applications are...

28/07/2026

How Rick Aggeler Built a Music Community for Boston Teens

How Rick Aggeler Built a Music Community for Boston Teens When he was a Berklee student, Aggeler volunteered at the Boys & Girls Clubs of Boston, where he hel...

28/07/2026

Are you coming to the Fleadh? RT will be there

RT Raidi na Gaeltachta, RT Radio 1, RT One and RT Player to showcase the best of the reels, rhymes and rambles from Comhaltas Fleadh Cheoil na h ireann 202...

28/07/2026

RT to broadcast The Irish Question

Through a wide range of perspectives, this documentary looks at how Ireland might navigate one of the defining political questions of the future Wednesday, Jul...

27/07/2026

AES Educational Foundation Announces 2026/2027 Scholarship and Grant Recipients

The Audio Engineering Society Educational Foundation has named its scholarship and grant recipients for the 2026/2027 academic year. The awards support students...

27/07/2026

ESPN and MEAC Reach Multi-Year Media Rights Agreement Through 2030-31

ESPN and the Mid-Eastern Athletic Conference (MEAC) have signed a multi-year media rights agreement covering basketball championships and select football and ba...

27/07/2026

Yahoo Sports and Cameo Integrate Celebrity Video Bookings into Yahoo Fantasy

Yahoo Sports and Cameo have partnered to allow fantasy football users to book personalized celebrity videos directly within the Yahoo Fantasy app and website. T...

27/07/2026

Eutelsat to Receive $504 Million in FCC Upper C-Band Transition Payments

Eutelsat has welcomed the FCC's order establishing the regulatory framework for the transition of Upper C-band spectrum in the United States. Under the orde...

27/07/2026

ESPN Acquires U.S. and International Rights to International Dance League

ESPN and the International Dance League (IDL) have signed a global rights agreement for the 2026 season. Events will air bi-weekly on ESPN2 at 7 p.m. ET beginni...

27/07/2026

NBCUniversal and YouTube Announce Multi-Year Global Partnership

NBCUniversal and YouTube have signed a multi-year global partnership that includes bundling Peacock with YouTube Premium, extending NBCUniversal's distribut...

27/07/2026

Two Weeks Away: 2026 SVG Venues & Teams Summit at Miamis Kaseya Center To Reunite In-Stadium Production Community

Agenda includes presentations from the Miami Heat, Inter Miami, Florida Panthers...

27/07/2026

Behind The Mic: CBS Sports Bolsters College Football Analyst Team

Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...

27/07/2026

PBR Goes Animated With BS: Bull Stories, Giving Its Bucking Bulls a Voice

Ten one-minute shorts will roll out across CBS, The CW, Paramount+ during the 2026 PBR Teams season PBR is officially moving into scripted animation. The Profe...

27/07/2026

Vochlea announce DubBox

New app turns vocal percussion into polished loops Vochlea, the company behind the voice-to-MIDI instrument Dubler 2, have just announced the launch of a ne...

27/07/2026

Sonora Cinematic launch Pure 12-String for Soundbox

Latest MPE-capable instrument completes Pure Trilogy line-up Sonora Cinematic have just released the third and final instalment in their series of acoustic ...

27/07/2026

fedDSP introduce Opto compressor plug-in

Emulates four varieties of optical compression The latest addition to the fedDSP line-up has just been announced, and packs four distinct optical compressor...

27/07/2026

Drawmer reveal the OC1 & FC1

Optical & FET compressors join 500-series line-up At our recent GearExpo UK show, we heard from Drawmer that they would soon be launching a pair of new 500-...

27/07/2026

T-Mobile Tops Ookla's Mobile Network Rankings

Share Copy link Facebook X Linkedin Bluesky Email...

27/07/2026

Pebble to Feature Virtualization, Cloud-Based Playout Tech at IBC

Share Copy link Facebook X Linkedin Bluesky Email...

27/07/2026

NBCU Telemundo Turns To Chyron PRIME 5 For World Cup Graphics

Share Copy link Facebook X Linkedin Bluesky Email...

27/07/2026

Lightware Adds SNMPv3 Monitoring to Taurus Devices

Lightware announces SNMPv3-based monitoring support for selected Taurus devices, available from firmware v1.20.0. The update enables IT administrators and AV in...

27/07/2026

Mediagenix Showcases the Real-Time Media Enterprise at IB...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, will showcase its vision for the Real-Time...

27/07/2026

Official trailer: Gugu Mbatha-Raw stars in Sky Original supernatural thriller Possession

All episodes available Thursday 6 August on Sky and streaming service NOWMonday ...

27/07/2026

Seven paradoxes shaping the next era of media production - Episode 4

Why Confidence MattersIn this series, we explore the technologies, architectures and operational realities shaping modern media operations. Along the way, we ex...

27/07/2026

Apple brings AppleCare One to the UK, streamlining coverage - UPDATE - Posted on 27 July 2026

Apple today announced AppleCare One - a new way for customers to protect multipl...

27/07/2026

944,000 VIEWERS WATCH RT'S COVERAGE OF MAYO'S HISTORIC WIN, AFTER A 75 YEAR WAIT TO LIFT THE SAM MAGUIRE

Yesterday witnessed truly memorable scenes in Croke Park, bringing the curtain d...

27/07/2026

SES Statement On FCC Upper C-band Auction Decision

Luxembourg, July 27, 2026 - SES, a leading space solutions company, issued the following statement following the U.S. Federal Communications Commission approval...

27/07/2026

Industry Leaders Unite in Open Secure AI Alliance for AI Safety and Security

Open source software is a critical pillar of the global economy. It underpins cloud computing, financial services, manufacturing, telecommunications, government...

26/07/2026

Audio Vivid: A New Destination for Immersive Audio

What is Audio Vivid? A New Destination for Immersive Audio Over the past several years, immersive audio has evolved from a niche production consideration into a...

26/07/2026

NVIDIA Harnesses Vera CPU to Speed Up Design of Next-Generation CPUs and GPUs

The complexity of modern chip design continues to grow as engineering teams work to develop increasingly sophisticated CPUs, GPUs and AI systems. To help meet t...

25/07/2026

Vochlea introduce DubBox

New app turns vocal percussion into polished loops Vochlea, the company behind the voice-to-MIDI instrument Dubler 2, have just announced the launch of a ne...