
NVIDIA's GeForce RTX 5090 and 5080 GPUs - which are based on the groundbreaking NVIDIA Blackwell architecture -offer up to 8x faster frame rates with NVIDIA DLSS 4 technology, lower latency with NVIDIA Reflex 2 and enhanced graphical fidelity with NVIDIA RTX neural shaders.
These GPUs were built to accelerate the latest generative AI workloads, delivering up to 3,352 AI trillion operations per second (TOPS), enabling incredible experiences for AI enthusiasts, gamers, creators and developers.
To help AI developers and enthusiasts harness these capabilities, NVIDIA at the CES trade show last month unveiled NVIDIA NIM and AI Blueprints for RTX. NVIDIA NIM microservices are prepackaged generative AI models that let developers and enthusiasts easily get started with generative AI, iterate quickly and harness the power of RTX for accelerating AI on Windows PCs. NVIDIA AI Blueprints are reference projects that show developers how to use NIM microservices to build the next generation of AI experiences.
NIM and AI Blueprints are optimized for GeForce RTX 50 Series GPUs. These technologies work together seamlessly to help developers and enthusiasts build, iterate and deliver cutting-edge AI experiences on AI PCs.
NVIDIA NIM Accelerates Generative AI on PCs While AI model development is rapidly advancing, bringing these innovations to PCs remains a challenge for many people. Models posted on platforms like Hugging Face must be curated, adapted and quantized to run on PC. They also need to be integrated into new AI application programming interfaces (APIs) to ensure compatibility with existing tools, and converted to optimized inference backends for peak performance.
NVIDIA NIM microservices for RTX AI PCs and workstations can ease the complexity of this process by providing access to community-driven and NVIDIA-developed AI models. These microservices are easy to download and connect to via industry-standard APIs and span the key modalities essential for AI PCs. They are also compatible with a wide range of AI tools and offer flexible deployment options, whether on PCs, in data centers, or in the cloud.
NIM microservices include everything needed to run optimized models on PCs with RTX GPUs, including prebuilt engines for specific GPUs, the NVIDIA TensorRT software development kit (SDK), the open-source NVIDIA TensorRT-LLM library for accelerated inference using Tensor Cores, and more.
Microsoft and NVIDIA worked together to enable NIM microservices and AI Blueprints for RTX in Windows Subsystem for Linux (WSL2). With WSL2, the same AI containers that run on data center GPUs can now run efficiently on RTX PCs, making it easier for developers to build, test and deploy AI models across platforms.
In addition, NIM and AI Blueprints harness key innovations of the Blackwell architecture that the GeForce RTX 50 series is built on, including fifth-generation Tensor Cores and support for FP4 precision.
Tensor Cores Drive Next-Gen AI Performance AI calculations are incredibly demanding and require vast amounts of processing power. Whether generating images and videos or understanding language and making real-time decisions, AI models rely on hundreds of trillions of mathematical operations to be completed every second. To keep up, computers need specialized hardware built specifically for AI.
NVIDIA GeForce RTX desktop GPUs deliver up to 3,352 AI TOPS for unmatched speed and efficiency in AI-powered workflows. In 2018, NVIDIA GeForce RTX GPUs changed the game by introducing Tensor Cores - dedicated AI processors designed to handle these intensive workloads. Unlike traditional computing cores, Tensor Cores are built to accelerate AI by performing calculations faster and more efficiently. This breakthrough helped bring AI-powered gaming, creative tools and productivity applications into the mainstream.
Blackwell architecture takes AI acceleration to the next level. The fifth-generation Tensor Cores in Blackwell GPUs deliver up to 3,352 AI TOPS to handle even more demanding AI tasks and simultaneously run multiple AI models. This means faster AI-driven experiences, from real-time rendering to intelligent assistants, that pave the way for greater innovation in gaming, content creation and beyond.
FP4 - Smaller Models, Bigger Performance Another way to optimize AI performance is through quantization, a technique that reduces model sizes, enabling the models to run faster while reducing the memory requirements.
Enter FP4 - an advanced quantization format that allows AI models to run faster and leaner without compromising output quality. Compared with FP16, it reduces model size by up to 60% and more than doubles performance, with minimal degradation.
For example, Black Forest Labs' FLUX.1 [dev] model at FP16 requires over 23GB of VRAM, meaning it can only be supported by the GeForce RTX 4090 and professional GPUs. With FP4, FLUX.1 [dev] requires less than 10GB, so it can run locally on more GeForce RTX GPUs.
On a GeForce RTX 4090 with FP16, the FLUX.1 [dev] model can generate images in 15 seconds with just 30 steps. With a GeForce RTX 5090 with FP4, images can be generated in just over five seconds.
FP4 is natively supported by the Blackwell architecture, making it easier than ever to deploy high-performance AI on local PCs. It's also integrated into NIM microservices, effectively optimizing models that were previously difficult to quantize. By enabling more efficient AI processing, FP4 helps to bring faster, smarter AI experiences for content creation.
AI Blueprints Power Advanced AI Workflows on RTX PCs NVIDIA AI Blueprints, built on NIM microservices, provide prepackaged, optimized reference implementations that make it easier to develop advanced AI-powered projects - whether for digital humans, podcast generators or application assistants.
At CES, NVIDIA demonstrated PDF to Podcast
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
04/06/2026
Sony Electronics is introducing the SRG-AS10, a 4K 60p-compatible PTZ auto-frami...
04/06/2026
This recent grad from Spring, TX, led creative-video output for the Aggies' men's basketball team last season and has been producing video and creating ...
04/06/2026
For the first time at a women's golf major, every player in the field will r...
04/06/2026
Three Panasonic PT-RQ45 40,000-lumen 3-Chip DLP projectors made their first live...
04/06/2026
Bitmovin and Akamai have announced a collaboration with NRJ Group, a French mult...
04/06/2026
Telestream will exhibit at InfoComm 2026 (Booth N7952), demonstrating media work...
04/06/2026
Sony has announced the development of RIALTO 65, a 65mm format image sensor block for the VENICE 2 digital cinema camera, targeting release in the first half of...
04/06/2026
KOKUSAI DENKI Electric America will exhibit at InfoComm 2026 (Booth N8025, June ...
04/06/2026
Bell Media's TSN and RDS are the exclusive Canadian broadcasters of FIFA Wor...
04/06/2026
The Challenge: Receiving Heavy Media Files From Road Games Quickly and ReliablyT...
04/06/2026
MASV, a managed file transfer platform used in broadcast and live sports product...
04/06/2026
NESN has announced the appointment of Fahad Haider as Vice President of Operations and Engineering. Haider returns to NESN, where he previously served as Vice P...
04/06/2026
David J. Halberstam, who spent almost 50 years in sports as a broadcaster and an executive, died June 2 after a years-long battle with brain cancer.
Over his l...
04/06/2026
Although collegiate production programs are tasked with delivering high-quality ...
04/06/2026
California studio, two production trucks, global distribution system are combine...
04/06/2026
New global program empowers and supports storytellers through scriptwriting course and access to industry experts
TikTok and Sundance Institute today announce...
04/06/2026
Steinberg DAWs now boast in-depth Tonalic integration
Celemony's innovative virtual session musician plug-in has just received an update that brings ARA...
04/06/2026
Get Hands-On With Over 20 Mic Brands
GearExpo UK is fast approaching, and if you've been looking for a chance to check out some new mics, then you'r...
04/06/2026
Combos feature new Amplifier Intelligence engine
Positive Grid's latest release sees the company introduce two new combo amplifiers that promise to offe...
04/06/2026
Is Your Job Making You Work this June?
4 June, 2026
Media releases
SBS Launches the World Cup Watchers' Rights Association to Stand Up For Australians&...
04/06/2026
Statement regarding unauthorised use of SBS logos on third party social content
4 June, 2026
Media releases
SBS has become aware of social media posts in c...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Bitmovin, a leading provider of video streaming infrastructure, and Akamai, the cybersecurity and cloud computing company that powers and protects business onli...
04/06/2026
American Underground (AU), the Startup Hub of the South and a community of mor...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI
Brie Clayton June 3, 2026
0 Comments
RTX Spark - a 1-Petaflop Superchip, the Full...
04/06/2026
Inside the Peaky Blinders: The Immortal Man Grade
Brie Clayton June 3, 2026
0 Comments
Simone Grattarola discusses shaping the look in DaVinci Resolve...
04/06/2026
Cine Gear Expo Announces 2026 Awards of Excellence Recipients
Brie Clayton June 3, 2026
0 Comments
Ed Lachman ASC, Caleb Deschanel ASC, and M. David M...
04/06/2026
St. Vincents Live with Orchestra Tour to Feature Berklee Alum Ruby Plume Berklee alumni St. Vincent and Ruby Plume will appear on the same bill across seven d...
04/06/2026
Back to All News
All the Truth in My Lies Coming to Netflix on August 28
Entertainment
04 June 2026
GlobalSpain
Link copied to clipboard
Download the imag...
04/06/2026
Back to All News
Larry Tanz, VP of Content, EMEA, Delivers a Keynote Speech at ...
04/06/2026
Back to All News
Turn Your Living Room into a Stadium With the New FIFA World ...
04/06/2026
Keeping conversations real on LinkedIn Published on Jun 4, 2026 Categories: Product News
LinkedIn Corporate Communications
Share
LinkedIn
Facebook ...
04/06/2026
BackStory follows four Irish young people as they travel back to their parents' homelands
Modern Irish identity is enriched by cultures and influences from...
04/06/2026
June's forecast with GeForce NOW: 100% chance of gaming.
GeForce NOW is lining up new adventures for the month, from big-name blockbusters to quirky indies...
03/06/2026
SES and Viva, Mexico's ultra low-cost airline, have launched multi-orbit satellite inflight connectivity on Viva's Airbus aircraft. A total of 60 A320s ...
03/06/2026
The College Football Playoff, ESPN, and TNT Sports have announced kick times and...
03/06/2026
RED Digital Cinema will exhibit at Cine Gear Expo 2026 (Booth 33, June 5-6, Universal Studios Lot), hosting three panels and hands-on product demonstrations.
P...
03/06/2026
Roku has announced the Soccer Zone, a dedicated hub for FIFA World Cup 2026 content available across the United States, Canada, Mexico, Brazil, Colombia, Argent...