Sony Pixel Power calrec Sony

How GeForce RTX 50 Series GPUs Are Built to Supercharge Generative AI on PCs

05/02/2025

NVIDIA's GeForce RTX 5090 and 5080 GPUs - which are based on the groundbreaking NVIDIA Blackwell architecture -offer up to 8x faster frame rates with NVIDIA DLSS 4 technology, lower latency with NVIDIA Reflex 2 and enhanced graphical fidelity with NVIDIA RTX neural shaders.

These GPUs were built to accelerate the latest generative AI workloads, delivering up to 3,352 AI trillion operations per second (TOPS), enabling incredible experiences for AI enthusiasts, gamers, creators and developers.

To help AI developers and enthusiasts harness these capabilities, NVIDIA at the CES trade show last month unveiled NVIDIA NIM and AI Blueprints for RTX. NVIDIA NIM microservices are prepackaged generative AI models that let developers and enthusiasts easily get started with generative AI, iterate quickly and harness the power of RTX for accelerating AI on Windows PCs. NVIDIA AI Blueprints are reference projects that show developers how to use NIM microservices to build the next generation of AI experiences.

NIM and AI Blueprints are optimized for GeForce RTX 50 Series GPUs. These technologies work together seamlessly to help developers and enthusiasts build, iterate and deliver cutting-edge AI experiences on AI PCs.

NVIDIA NIM Accelerates Generative AI on PCs While AI model development is rapidly advancing, bringing these innovations to PCs remains a challenge for many people. Models posted on platforms like Hugging Face must be curated, adapted and quantized to run on PC. They also need to be integrated into new AI application programming interfaces (APIs) to ensure compatibility with existing tools, and converted to optimized inference backends for peak performance.

NVIDIA NIM microservices for RTX AI PCs and workstations can ease the complexity of this process by providing access to community-driven and NVIDIA-developed AI models. These microservices are easy to download and connect to via industry-standard APIs and span the key modalities essential for AI PCs. They are also compatible with a wide range of AI tools and offer flexible deployment options, whether on PCs, in data centers, or in the cloud.

NIM microservices include everything needed to run optimized models on PCs with RTX GPUs, including prebuilt engines for specific GPUs, the NVIDIA TensorRT software development kit (SDK), the open-source NVIDIA TensorRT-LLM library for accelerated inference using Tensor Cores, and more.

Microsoft and NVIDIA worked together to enable NIM microservices and AI Blueprints for RTX in Windows Subsystem for Linux (WSL2). With WSL2, the same AI containers that run on data center GPUs can now run efficiently on RTX PCs, making it easier for developers to build, test and deploy AI models across platforms.

In addition, NIM and AI Blueprints harness key innovations of the Blackwell architecture that the GeForce RTX 50 series is built on, including fifth-generation Tensor Cores and support for FP4 precision.

Tensor Cores Drive Next-Gen AI Performance AI calculations are incredibly demanding and require vast amounts of processing power. Whether generating images and videos or understanding language and making real-time decisions, AI models rely on hundreds of trillions of mathematical operations to be completed every second. To keep up, computers need specialized hardware built specifically for AI.

NVIDIA GeForce RTX desktop GPUs deliver up to 3,352 AI TOPS for unmatched speed and efficiency in AI-powered workflows. In 2018, NVIDIA GeForce RTX GPUs changed the game by introducing Tensor Cores - dedicated AI processors designed to handle these intensive workloads. Unlike traditional computing cores, Tensor Cores are built to accelerate AI by performing calculations faster and more efficiently. This breakthrough helped bring AI-powered gaming, creative tools and productivity applications into the mainstream.

Blackwell architecture takes AI acceleration to the next level. The fifth-generation Tensor Cores in Blackwell GPUs deliver up to 3,352 AI TOPS to handle even more demanding AI tasks and simultaneously run multiple AI models. This means faster AI-driven experiences, from real-time rendering to intelligent assistants, that pave the way for greater innovation in gaming, content creation and beyond.

FP4 - Smaller Models, Bigger Performance Another way to optimize AI performance is through quantization, a technique that reduces model sizes, enabling the models to run faster while reducing the memory requirements.

Enter FP4 - an advanced quantization format that allows AI models to run faster and leaner without compromising output quality. Compared with FP16, it reduces model size by up to 60% and more than doubles performance, with minimal degradation.

For example, Black Forest Labs' FLUX.1 [dev] model at FP16 requires over 23GB of VRAM, meaning it can only be supported by the GeForce RTX 4090 and professional GPUs. With FP4, FLUX.1 [dev] requires less than 10GB, so it can run locally on more GeForce RTX GPUs.

On a GeForce RTX 4090 with FP16, the FLUX.1 [dev] model can generate images in 15 seconds with just 30 steps. With a GeForce RTX 5090 with FP4, images can be generated in just over five seconds.

FP4 is natively supported by the Blackwell architecture, making it easier than ever to deploy high-performance AI on local PCs. It's also integrated into NIM microservices, effectively optimizing models that were previously difficult to quantize. By enabling more efficient AI processing, FP4 helps to bring faster, smarter AI experiences for content creation.

AI Blueprints Power Advanced AI Workflows on RTX PCs NVIDIA AI Blueprints, built on NIM microservices, provide prepackaged, optimized reference implementations that make it easier to develop advanced AI-powered projects - whether for digital humans, podcast generators or application assistants.

At CES, NVIDIA demonstrated PDF to Podcast
LINK: https://blogs.nvidia.com/blog/rtx-ai-garage-blackwell-nim-blueprints-p...
See more stories from nvidia

Most recent headlines

17/12/2025

Clear-Com's Arcadia Central Station Links Toledo Walleye and Mud Hens Venues with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/12/2025

Broadcast and Streaming Serve Up a Historic Month of TV in Nielsen's The Gauge

Audiences Watched Over 103 Billion Minutes of TV on Thanksgiving Day NFL Games ...

17/12/2025

EdgeBeam Wireless Makes Initial Sale, Expands Executive Team

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Warner Bros. Discovery Tells Shareholders to Reject Paramount Bid

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

NDI, Zoom Collaborate on Seamless Connectivity

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Broadcasters Mark Momentous Year of Challenges Amid Viewing Fragmentation

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Tennessee Public Broadcaster to Trial AI Metadata

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Chyron Unveils New AXIS Maps

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Broadcast Solutions Group Acquires PMT Professional Motion Technology

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Study: U.S. Pay TV, Video Revenue to Total $190.7B in 2030

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Texas Attorney General Takes Aim at 5 TV Manufacturers

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

DirecTV Wins Appeal in Retransmission Price-Fixing Suit

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

E.W. Scripps Rejects Sinclair Takeover Bid

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

KPop Demon Hunters Stars Visit Berklee for Weeklong Celebration

KPop Demon Hunters Stars Visit Berklee for Weeklong Celebration Andrew Choi and EJAE, who voiced the film's main characters and contributed to its soundtr...

17/12/2025

RT announces appointment of Kathy Fox to role of Commissioning Editor, Documentaries and Features

RT has announced that Kathy Fox has been appointed Commissioning Editor with re...

17/12/2025

UC San Diego Lab Advances Generative AI Research With NVIDIA DGX B200 System

The Hao AI Lab research team at the University of California San Diego - at the forefront of pioneering AI model innovation - recently received an NVIDIA DGX B...

17/12/2025

Into the Omniverse: OpenUSD and NVIDIA Halos Accelerate Safety for Robotaxis, Physical AI Systems

Editor's note: This post is part of Into the Omniverse, a series focused on ...

17/12/2025

The Glitterball awaits: Dancing with the Stars unveils dance pairings for 2026

With the new season of Dancing with the Stars shimmering in the not-too-distant future this New Year, the celebrity and dancer pairings of the twelve couples ha...

16/12/2025

Stranger Things' Playlist Takeover Challenges Fans to Decode Clues and Unlock Exclusive Volume 2' Content

Hawkins has landed on Spotify, just in time for Stranger Things Season 5, Volume...

16/12/2025

Spotify and NAVER Bring Music Integrations and Premium Benefits to Korea

Wherever you are, your favorite music and audio content should go seamlessly with you. That's why Spotify has partnered with NAVER Corp, Korea's leading...

16/12/2025

Around the World With Spotify Wrapped: 2025 Fan Destinations You Had to See

2025 Wrapped arrived bigger and bolder than ever. This year's experience is designed to be ultra personal and shareable, with new features like Wrapped Part...

16/12/2025

L3Harris Delivers Most Powerful Thrusters for NASA's Lunar Gateway

Three 12-kilowatt Advanced Electric Propulsion System thrusters, supplied by L3Harris Technologies, form the core of Gateway's propulsion system. Pictured i...

16/12/2025

Palantir and L3Harris: Reindustrializing Defense Through AI-Powered Production

The challenge facing America's defense industrial base is not just about speed - its about rebuilding the foundation that makes speed possible. Our nations ...

16/12/2025

NFL Boosts Broadcast, Streaming Viewing Share in November

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/12/2025

Spanish Broadcaster Updates Playout With Pebble Solutions

SEVILLE, Spain Canal Sur, the public broadcasting service for Andalusia, Spain, has completed a total technology refresh based on Pebble's resilient, softwa...

16/12/2025

Telescript International Buys Prompter Software Company

NEW YORK Teleprompting hardware provider Telescript International has acquired all software code and intellectual property previously owned by Telescript West. ...

16/12/2025

Ookla: T-Mobile Is Fastest Fixed Wireless Access Provider

As cable operators face increased competition from 5G fixed wireless access providers, a new report from Ookla Research finds that T-Mobile is the FWA speed lea...

16/12/2025

Apple TV App for Android Now Supports Google Cast

Apple has announced a major upgrade to the Apple TV app for device owners outside the Apple ecosystem with news that the Apple TV app for Android now supports G...

16/12/2025

PT Telkom Satelit Indonesia and Space42 Explore Partnership to Extend 5G Direct-to-Device Services

Space42 grows Direct-to-Device partner ecosystem through a Memorandum of Underst...

16/12/2025

VEON Announces Release Date for Full Year and Fourth Quarter 2025 Results of Both VEON and Kyivstar

16 Dec 2025 VEON Announces Release Date for Full Year and Fourth Quarter 2025 R...

16/12/2025

VEON's Kyivstar Invests in Renewable Energy in Ukraine with Acquisition of Solar Power Company

16 Dec 2025 VEON's Kyivstar Invests in Renewable Energy in Ukraine with Acq...

16/12/2025

Emma Appleton, Fares Fares, Frida Gustavsson and Jakob Oftebro Star in Swedish Thriller Series Bytet'

Back to All News Emma Appleton, Fares Fares, Frida Gustavsson and Jakob Oftebro...

16/12/2025

Docu-reality 'My Korean Boyfriend' Gets a Trailer and Premiere Date: January 1st. Is Real Life Really like a K-drama?

Back to All News Docu-reality My Korean Boyfriend Gets a Trailer and Premiere D...

16/12/2025

Czech TV Elevates Video Streaming with Harmonic

Harmonic's XOS Advanced Media Processor Improves Streaming Video Quality and Boosts Viewer Engagement SAN JOSE, Calif. - Dec. 16, 2025 - Harmonic (NASDAQ: ...

16/12/2025

RT Sport Manager of the Year Nominees 2025 Revealed

RT Sport Awards 2025 live on RT One and RT Player at 8:05pm on Saturday 20 December. On Saturday 20 December live on RT One and RT Player at the earlier t...

16/12/2025

Music legend Brian Kennedy revealed as the twelfth and final contestant for Dancing with the Stars 2026

Singer -songwriter Brian Kennedy has been announced as the final celebrity dance...

15/12/2025

Harlem Globetrotters Celebrate 100th Anniversary With New Brand Campaign From The Famous Group

Harlem Globetrotters Celebrate 100th Anniversary With New Brand Campaign From Th...

15/12/2025

2026 Sundance Film Festival Reveals 54 Titles Selected for Short Film Program Presented by Ketel One Vodka

Top L-R: La Tierra Del Valor (The Home of the Brave), Mangittatuarjuk (The Gnawe...

15/12/2025

L3Harris to Provide Assured Communications for US Air Force's Survivable Airborne Operations Center Program

L3Harris will leverage 15 years of experience supporting the E-4B Nightwatch and...

15/12/2025

Arkansas TV Ends PBS Affiliation Amid Funding Cuts

CONWAY, Ark. In a notable example of how the loss of federal funding is forcing public stations to make massive cuts and operational changes, the statewide pub...

15/12/2025

PMVG Acquires WBPA-LD for WQED Pittsburgh

BOULDER, Colo. Public Media Venture Group (PMVG), Venture Technologies Group (VTG), and WQED have completed a multipart agreement that they say will significant...

15/12/2025

SES and WPDI Win Changing Lives Award, Connecting Youth to Digital Education in South Sudan and Uganda

Cape Town, November 13, 2025 - SES and International artist and humanitarian, Fo...

15/12/2025

SES, Abra Group Launch Multi-Orbit Inflight Connectivity

Luxembourg, December 15, 2025 - SES, a leading space solutions company, and Abra Group launched fast and reliable multi-orbit inflight connectivity service on t...

15/12/2025

How Rivian s Design Puts Drivers First-And Why That Matters

How Rivian s Design Puts Drivers First-And Why That Matters Published on Dec 15, 2025 Categories: Business Solutions LinkedIn Corporate Communications Sha...

15/12/2025

Space42 and Cobham Satcom Redefine L-band Performance with New Portfolio of Thuraya-4 Terminals

Space42 and Cobham Satcom completed the full range of advanced terminals for the...

15/12/2025

VEON's Beeline Kazakhstan Delivers First Starlink Direct to Cell Call in Central Asia

15 Dec 2025 VEON's Beeline Kazakhstan Delivers First Starlink Direct to Cel...

15/12/2025

U&GOLD Reveals Top 10 Topical Christmas Cracker Jokes for 2025!

Andrew Mountbatten-Windsor finds himself the topic of year's cracker jokes Oasis, David Harbour, Celebrity Traitors and Angela Rayner all feature in this y...

15/12/2025

Comscore Expands Cross-Platform Campaign Measurement to Include Audio and Social

Comscore Expands Cross-Platform Campaign Measurement to Include Audio and Social New capabilities strengthen cross-platform campaign reporting suite; CCR rebran...

15/12/2025

NVIDIA Acquires Open-Source Workload Management Provider SchedMD

NVIDIA today announced it has acquired SchedMD - the leading developer of Slurm, an open-source workload management system for high-performance computing (HPC) ...