
NVIDIA's GeForce RTX 5090 and 5080 GPUs - which are based on the groundbreaking NVIDIA Blackwell architecture -offer up to 8x faster frame rates with NVIDIA DLSS 4 technology, lower latency with NVIDIA Reflex 2 and enhanced graphical fidelity with NVIDIA RTX neural shaders.
These GPUs were built to accelerate the latest generative AI workloads, delivering up to 3,352 AI trillion operations per second (TOPS), enabling incredible experiences for AI enthusiasts, gamers, creators and developers.
To help AI developers and enthusiasts harness these capabilities, NVIDIA at the CES trade show last month unveiled NVIDIA NIM and AI Blueprints for RTX. NVIDIA NIM microservices are prepackaged generative AI models that let developers and enthusiasts easily get started with generative AI, iterate quickly and harness the power of RTX for accelerating AI on Windows PCs. NVIDIA AI Blueprints are reference projects that show developers how to use NIM microservices to build the next generation of AI experiences.
NIM and AI Blueprints are optimized for GeForce RTX 50 Series GPUs. These technologies work together seamlessly to help developers and enthusiasts build, iterate and deliver cutting-edge AI experiences on AI PCs.
NVIDIA NIM Accelerates Generative AI on PCs While AI model development is rapidly advancing, bringing these innovations to PCs remains a challenge for many people. Models posted on platforms like Hugging Face must be curated, adapted and quantized to run on PC. They also need to be integrated into new AI application programming interfaces (APIs) to ensure compatibility with existing tools, and converted to optimized inference backends for peak performance.
NVIDIA NIM microservices for RTX AI PCs and workstations can ease the complexity of this process by providing access to community-driven and NVIDIA-developed AI models. These microservices are easy to download and connect to via industry-standard APIs and span the key modalities essential for AI PCs. They are also compatible with a wide range of AI tools and offer flexible deployment options, whether on PCs, in data centers, or in the cloud.
NIM microservices include everything needed to run optimized models on PCs with RTX GPUs, including prebuilt engines for specific GPUs, the NVIDIA TensorRT software development kit (SDK), the open-source NVIDIA TensorRT-LLM library for accelerated inference using Tensor Cores, and more.
Microsoft and NVIDIA worked together to enable NIM microservices and AI Blueprints for RTX in Windows Subsystem for Linux (WSL2). With WSL2, the same AI containers that run on data center GPUs can now run efficiently on RTX PCs, making it easier for developers to build, test and deploy AI models across platforms.
In addition, NIM and AI Blueprints harness key innovations of the Blackwell architecture that the GeForce RTX 50 series is built on, including fifth-generation Tensor Cores and support for FP4 precision.
Tensor Cores Drive Next-Gen AI Performance AI calculations are incredibly demanding and require vast amounts of processing power. Whether generating images and videos or understanding language and making real-time decisions, AI models rely on hundreds of trillions of mathematical operations to be completed every second. To keep up, computers need specialized hardware built specifically for AI.
NVIDIA GeForce RTX desktop GPUs deliver up to 3,352 AI TOPS for unmatched speed and efficiency in AI-powered workflows. In 2018, NVIDIA GeForce RTX GPUs changed the game by introducing Tensor Cores - dedicated AI processors designed to handle these intensive workloads. Unlike traditional computing cores, Tensor Cores are built to accelerate AI by performing calculations faster and more efficiently. This breakthrough helped bring AI-powered gaming, creative tools and productivity applications into the mainstream.
Blackwell architecture takes AI acceleration to the next level. The fifth-generation Tensor Cores in Blackwell GPUs deliver up to 3,352 AI TOPS to handle even more demanding AI tasks and simultaneously run multiple AI models. This means faster AI-driven experiences, from real-time rendering to intelligent assistants, that pave the way for greater innovation in gaming, content creation and beyond.
FP4 - Smaller Models, Bigger Performance Another way to optimize AI performance is through quantization, a technique that reduces model sizes, enabling the models to run faster while reducing the memory requirements.
Enter FP4 - an advanced quantization format that allows AI models to run faster and leaner without compromising output quality. Compared with FP16, it reduces model size by up to 60% and more than doubles performance, with minimal degradation.
For example, Black Forest Labs' FLUX.1 [dev] model at FP16 requires over 23GB of VRAM, meaning it can only be supported by the GeForce RTX 4090 and professional GPUs. With FP4, FLUX.1 [dev] requires less than 10GB, so it can run locally on more GeForce RTX GPUs.
On a GeForce RTX 4090 with FP16, the FLUX.1 [dev] model can generate images in 15 seconds with just 30 steps. With a GeForce RTX 5090 with FP4, images can be generated in just over five seconds.
FP4 is natively supported by the Blackwell architecture, making it easier than ever to deploy high-performance AI on local PCs. It's also integrated into NIM microservices, effectively optimizing models that were previously difficult to quantize. By enabling more efficient AI processing, FP4 helps to bring faster, smarter AI experiences for content creation.
AI Blueprints Power Advanced AI Workflows on RTX PCs NVIDIA AI Blueprints, built on NIM microservices, provide prepackaged, optimized reference implementations that make it easier to develop advanced AI-powered projects - whether for digital humans, podcast generators or application assistants.
At CES, NVIDIA demonstrated PDF to Podcast
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
02/05/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
27/04/2026
CES Power, a provider of infrastructure for live events, has announced the acquisition of three Ireland-based businesses: GH Energy Rental Ltd, Event Power, and...
27/04/2026
FuboTV Inc. has announced it is developing its Multiview feature for the Fubo streaming service on select LG TVs, including 2024, 2025, and newer 4K and 8K mode...
27/04/2026
Shade, a file management platform for creative teams, has announced a $14 million funding round led by Khosla Ventures, Construct Capital, and Bling Capital, br...
27/04/2026
The Audio Engineering Society (AES) will present the Immersive Audio Academy 12th Edition - Immersive Audio in All Flavors - on April 30, 2026, at 12:00 p.m. ...
27/04/2026
DAZN has announced DAZN48, a creator program for the FIFA World Cup 2026 that will recruit 48 creators - one representing each of the 48 qualified nations - to ...
27/04/2026
FloSports has announced exclusive streaming rights to four CrossFit competitions: Legends Del Mar: CrossFit Semi-Finals, Magic City Games, NorCal Classic, and t...
27/04/2026
Telestream has announced that Pulse, its software-defined test and measurement p...
27/04/2026
Shade has announced it is a Cloud Computing and Storage winner in the 2026 NAB Show Product of the Year Awards. Winners were selected by a panel of industry exp...
27/04/2026
Leading the NBA's video-ads platform, this Penn State grad is at the forefro...
27/04/2026
DAZN has expanded its international broadcast rights for the T100 Triathlon World Tour to include Africa. All races from the T100 calendar will be available for...
27/04/2026
NAB Show has announced the recipients of its 2026 Project of the Year and Product of the Year Awards at a ceremony at the Las Vegas Convention Center.
Each wi...
27/04/2026
DIRECTV has launched on Meta Quest headsets, becoming the first MVPD to offer live TV through the platform. The timing coincides with the stretch run of the MLB...
27/04/2026
TBL Team Boxing League has announced a broadcast agreement with MSG Networks to air all remaining Season 4 fights live across MSG's television and digital p...
27/04/2026
IP integration, interoperability, growth of intercommunications were key concerns for vendors and visitors alike
Attendees at the recently concluded 2026 NAB S...
27/04/2026
Behind The Mic provides a roundup of recent news regarding on-air talent, includ...
27/04/2026
A pro-audio emphasis, spectrum changes, and on-field audio mark the new products and enhancements to existing offerings
Microphones remain the primary point of...
27/04/2026
The Sports Video Group team was all over the NAB Show floor out in Las Vegas las...
27/04/2026
N r Spotify grundades f r 20 r sedan dominerades musikmarknaden av illegal nedladdning. Sedan dess har streaming bidragit till att teruppr tta betalningsvilja...
27/04/2026
Time on Spotify should feel meaningful and intentional, not something that slips...
27/04/2026
New modular multi-effects plug-in revealed
The latest plug-in from Brainworx delivers a modular set of effects designed to offer a convenient alternative to...
27/04/2026
Kit includes supercardioid & shotgun capsules
High-end mic manufacturer Schoeps have recently introduced another member of their Desert Island Set family. O...
27/04/2026
LA2A-inspired 500-series module arrives
Sound Skulptor have announced the upcoming launch of a new 500-series module that aims to recreate one of the most p...
27/04/2026
SSL-inspired compressor unit upgraded
Stam Audio are well known for their painstaking recreations of vintage audio gear, with their extensive product range ...
27/04/2026
Available for current Nielsen ONE Ads customers, this new capability predicts sa...
27/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/04/2026
Nippon TV's In-House Proprietary AI Solution AiDi Wins Product of the Year A...
27/04/2026
Outpost Introduces Unlimited Collaboration Model for Review and Approval Workflo...
27/04/2026
Ikegami Announces VFE-P07D Monocular OLED Viewfinder with Tiltable 3.5-inch LCD ...
27/04/2026
Custom Consoles announces the completion of a large Module-R desk and MediaWall monitor display mount for an expanded master control room at Gravity Medias West...
27/04/2026
Other World Computing Launches OWC Express 4M2 Ultra - Thunderbolt 5 Four-Slot N...
27/04/2026
Back to All News
Netflix announces El sobrino, the new film by Dami n Szifron s...
27/04/2026
Red Seat Ventures Announces Exclusive Multiyear Partnership with Kill Tony The Company is the New Monetization and Distribution Home for the Globally Popula...
27/04/2026
RT 2FM is calling on aspiring DJs across Ireland to take their shot at the spot...
27/04/2026
RT continues to champion Ireland's creative life this May, supporting a broad range of festivals, exhibitions and performances across music, theatre, liter...
26/04/2026
Back to All News
Director Yoon Jong-bin Returns with The Generals' (WT), A...
26/04/2026
Back to All News
Nine Queens, Starring Alvaro Morte and Patrick Criado, Starts ...
25/04/2026
In the heart of Mexico City, music, culture, and fashion converged last night as Spotify and Vogue Latin America welcomed guests to an intimate gathering at Soh...
25/04/2026
New modular multi-effects plug-in revealed
The latest plug-in from Brainworx delivers a modular set of effects designed to offer a convenient alternative to...
25/04/2026
Mediagenix Sweeps 2026 NAB Awards With Wins for Product of the Year and Best of ...
25/04/2026
SCHOEPS Microphones Announces Desert Island Boom Set for NAB 2026
Brie Clayton April 24, 2026
0 Comments
Compact modular set ideal for location sound ...
25/04/2026
Berklee Africana Studies Hosts Gospel Extravaganza 2026 The Signature Series event will honor three new inductees to the Berklee Gospel Hall of Fame and celeb...
25/04/2026
Student Spotlight: Siva Maja Gierszewska, who performs under the artist name Siva, shares how she found her songwriting confidence at Berklee.
April 24, 2026...
25/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/04/2026
Churchill Downs Inc. (CDI) has announced a definitive agreement to acquire the intellectual property of the Preakness Stakes and Black-Eyed Susan Stakes from 1/...