
NVIDIA today announced at Microsoft Build new AI performance optimizations and integrations for Windows that help deliver maximum performance on NVIDIA GeForce RTX AI PCs and NVIDIA RTX workstations.
Large language models (LLMs) power some of the most exciting new use cases in generative AI and now run up to 3x faster with ONNX Runtime (ORT) and DirectML using the new NVIDIA R555 Game Ready Driver. ORT and DirectML are high-performance tools used to run AI models locally on Windows PCs.
WebNN, an application programming interface for web developers to deploy AI models, is now accelerated with RTX via DirectML, enabling web apps to incorporate fast, AI-powered capabilities. And PyTorch will support DirectML execution backends, enabling Windows developers to train and infer complex AI models on Windows natively. NVIDIA and Microsoft are collaborating to scale performance on RTX GPUs.
These advancements build on NVIDIA's world-leading AI platform, which accelerates more than 500 applications and games on over 100 million RTX AI PCs and workstations worldwide.
RTX AI PCs - Enhanced AI for Gamers, Creators and Developers NVIDIA introduced the first PC GPUs with dedicated AI acceleration, the GeForce RTX 20 Series with Tensor Cores, along with the first widely adopted AI model to run on Windows, NVIDIA DLSS, in 2018. Its latest GPUs offer up to 1,300 trillion operations per second of dedicated AI performance.
In the coming months, Copilot+ PCs equipped with new power-efficient systems-on-a-chip and RTX GPUs will be released, giving gamers, creators, enthusiasts and developers increased performance to tackle demanding local AI workloads, along with Microsoft's new Copilot+ features.
For gamers on RTX AI PCs, NVIDIA DLSS boosts frame rates by up to 4x, while NVIDIA ACE brings game characters to life with AI-driven dialogue, animation and speech.
For content creators, RTX powers AI-assisted production workflows in apps like Adobe Premiere, Blackmagic Design DaVinci Resolve and Blender to automate tedious tasks and streamline workflows. From 3D denoising and accelerated rendering to text-to-image and video generation, these tools empower artists to bring their visions to life.
For game modders, NVIDIA RTX Remix, built on the NVIDIA Omniverse platform, provides AI-accelerated tools to create RTX remasters of classic PC games. It makes it easier than ever to capture game assets, enhance materials with generative AI tools and incorporate full ray tracing.
For livestreamers, the NVIDIA Broadcast application delivers high-quality AI-powered background subtraction and noise removal, while NVIDIA RTX Video provides AI-powered upscaling and auto-high-dynamic range to enhance streamed video quality.
Enhancing productivity, LLMs powered by RTX GPUs execute AI assistants and copilots faster, and can process multiple requests simultaneously.
And RTX AI PCs allow developers to build and fine-tune AI models directly on their devices using NVIDIA's AI developer tools, which include NVIDIA AI Workbench, NVIDIA cuDNN and CUDA on Windows Subsystem for Linux. Developers also have access to RTX-accelerated AI frameworks and software development kits like NVIDIA TensorRT, NVIDIA Maxine and RTX Video.
The combination of AI capabilities and performance deliver enhanced experiences for gamers, creators and developers.
Faster LLMs and New Capabilities for Web Developers Microsoft recently released the generative AI extension for ORT, a cross-platform library for AI inference. The extension adds support for optimization techniques like quantization for LLMs like Phi-3, Llama 3, Gemma and Mistral. ORT supports different execution providers for inferencing via various software and hardware stacks, including DirectML.
ORT with the DirectML backend offers Windows AI developers a quick path to develop AI capabilities, with stability and production-grade support for the broad Windows PC ecosystem. NVIDIA optimizations for the generative AI extension for ORT, available now in R555 Game Ready, Studio and NVIDIA RTX Enterprise Drivers, help developers get up to 3x faster performance on RTX compared to previous drivers.
Inference performance for three LLMs using ONNX Runtime and the DirectML execution provider with the latest R555 GeForce driver compared to the previous R550 driver. INSEQ=2000 representative of document summarization workloads. All data captured with GeForce RTX 4090 GPU using batch size 1. The generative AI extension support for int4 quantization, plus the NVIDIA optimizations, result in up to 3x faster performance for LLMs. Developers can unlock the full capabilities of RTX hardware with the new R555 driver, bringing better AI experiences to consumers, faster. It includes:
Support for DQ-GEMM metacommand to handle INT4 weight-only quantization for LLMs
New RMSNorm normalization methods for Llama 2, Llama 3, Mistral and Phi-3 models
Group and multi-query attention mechanisms, and sliding window attention to support Mistral
In-place KV updates to improve attention performance
Support for GEMM of non-multiple-of-8 tensors to improve context phase performance
Additionally, NVIDIA has optimized AI workflows within WebNN to deliver the powerful performance of RTX GPUs directly within browsers. The WebNN standard helps web app developers accelerate deep learning models with on-device AI accelerators, like Tensor Cores.
Now available in developer preview, WebNN uses DirectML and ORT Web, a Javascript library for in-browser model execution, to make AI applications more accessible across multiple platforms. With this acceleration, popular models like Stable Diffusion, SD Turbo and Whisper run up to 4x faster on WebNN compared to WebGPU and are now available for developers to use. Microsoft Build attendees can learn more about developing on RTX in the Accelerating development on Windows PCs w
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
01/04/2026
January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION
Douyin Users Can Now Create And Share Videos With Stun...
03/02/2026
Tagboard, a modern, interactive graphics system for news, sports, and entertainm...
03/02/2026
Studio Network Solutions (SNS) announces the launch of Trio, a new S3-compatible cloud storage service fully integrated with EVO for media backup, archival, and...
03/02/2026
50 Production Trucks at center of 160 U.S.-based productions...
03/02/2026
Nielsen, which specializes in audience measurement, data, and media intelligence, announces that it is piloting a new methodology enhancement to more accurately...
03/02/2026
Appear's X Platform will be used by NBC Sports to deliver video compression, satellite modulation and transport stream aggregation for its production of the...
03/02/2026
Behind The Mic provides a roundup of recent news regarding on-air talent, includ...
03/02/2026
NHL Network announces its comprehensive programming schedule for the upcoming Winter Olympic Games, underscoring the highly anticipated return of NHL players to...
03/02/2026
NBC Sports has chosen Canon to deliver 115 Canon UHD broadcast lenses for its production of the 2026 Winter Olympics and Paralympics. Canon will also send suppo...
03/02/2026
Audio-Technica equipment will be used by NBC Sports to deliver much of its audio capture requirements across all sporting venues for its production of the 2026 ...
03/02/2026
NBC Sports will use Cisco to deliver AI networking technology for its all-IP production of the 2026 Winter Olympics and Paralympics, including the deployment of...
03/02/2026
NBC Sports will utilize Chyron PRIME CG to produce live broadcast graphics to display names, athlete information, scores, statistics, leaderboards, headshots an...
03/02/2026
NBC Sports will utilize Grass Valley to deliver advanced signal conversion, rout...
03/02/2026
NBC Sports will utilize Planar to deliver leading-edge fine pixel pitch LED video wall technology for its production of the 2026 Winter Olympics and Paralympics...
03/02/2026
Taking place in two venues, the 2026 production celebrates the 150th Anniversary of the Super Bowl of Dogs'
When the Westminster Kennel Club Dog Show conc...
03/02/2026
For the indoor production, NEP Specialty Capture has mounted a 100-ft. overhead ...
03/02/2026
MTVG Edge, the production-services supplier's software-based production solu...
03/02/2026
In the league's second year, new partnerships enhance broadcast quality for ...
03/02/2026
Rocket Surgery will showcase the combined creative strength of Ross Video, with ...
03/02/2026
NBC Sports will utilize Sony Electronics to deliver imaging, monitoring, and tec...
03/02/2026
SMT will provide TVI (broadcast television interface) support services for figur...
03/02/2026
Spotify's annual Best New Artist celebration returned to Los Angeles last ni...
03/02/2026
The smash-hit series The Hospital: In the Deep End returns to shine a spotlight ...
03/02/2026
FoMa Antares: Redefining Camera Stabilization for Modern ProductionsIn high-end broadcast and cinematic environments, precision, reliability, and flexibility ar...
03/02/2026
Viper Shield's robust phase of flight-testing production representative hard...
03/02/2026
Countries throughout the Indo-Pacific have made the ability to defend their people and sovereign borders a top priority, but no single nation can monitor every ...
03/02/2026
U.S. Marine loads a round in an 81 mm mortar system during an exercise. (Credit: U.S. Marines)...
03/02/2026
9905MPx Card features unprecedented level of density with four independent signa...
03/02/2026
Champaign, IL - November 15, 2021 - Cobalt Digital, announced today that three of its products have received 2021 NAB Show Product of the Year Awards. Cobalt, ...
03/02/2026
Cobalt is pleased to confirm that Log4j vulnerability does NOT affect ANY Cobalt products including the HPF-9000 frame.
Given the recent concerns regarding wi...
03/02/2026
Software-based embedding and de-embedding solution will be highlighted at NAB 20...
03/02/2026
Series developed to fill an industry need.
Champaign, IL April 13, 2022 Cobalt Digital will introduce a new series of BlueBox Group (BBG) EO/OE 12G mini...
03/02/2026
Company receives Best in Shows from Next TV and TVB Europe, and two Product of the Year awards from NAB
Champaign, IL - May 6, 2022 - Cobalt Digital Inc. head...
03/02/2026
IBC Preview - IBC Stand 10.B44Journalists: Click to visit Cobalt
Cobalt will al...
03/02/2026
IBC Stand 10.B44Journalists: Click to visit Cobalt
Dr. Ciro Noronha, CTO, tapped as a panelist and speaker by many - and then there's the party!
Amsterda...
03/02/2026
IBC Stand 10.B44Journalists: Click to visit Cobalt
Growth Drives Cobalt Digital to Promote Dr. Ciro Noronha to CTO, and Appoint Anthony Tan as Director of Sale...
03/02/2026
IBC Stand 10.B44Journalists: Click to visit Cobalt
Dr. Ciro Noronha, CTO, tappe...
03/02/2026
Manufacturer plans also include solutions that provide a path to the cloud and redundancy updatesCABSAT Stand S1-I42Journalists: Click to visit Cobalt
Dubai - ...
03/02/2026
Award-Winning Product Portfolio is Being Presented on Smart Video Group Stand, and Company's Berend Blokzijl is Scheduled to Share RIST Insight on Innovatio...
03/02/2026
NEW Location IBC Stand 10.F42 Same Hall, NEW StandJournalists: Click to visi...
03/02/2026
TVBEurope spoke with our very own Dr. Ciro Noronha about RIST and more.Reliable Internet Stream Transport (RIST) is growing in popularity for contribution and d...
03/02/2026
NEW Location IBC Stand 10.F42 Same Hall, NEW StandJournalists: Click to visi...
03/02/2026
NEW Location IBC Stand 10.F42 Same Hall, NEW StandJournalists: Click to visit CobaltCatch Cobalt's Blue WAVE of Innovation in a New LocationHighlights t...
03/02/2026
Cobalt Digital Scores Best of Show Awards at IBC 2023 from TVB Europe and TV Technology
Amsterdam, 2 October 2023 - Cobalt Digital has announced that it has w...
03/02/2026
NAB NY Booth: 1126Cobalt Digital to Present New PACIFIC Ultra-Low Latency 4K HEVC Encoder / Decoder Platform at NAB NY 2023Cobalt's NAB NY Plans Have Live P...
03/02/2026
Cobalt's Inter BEE Line-up Targets 4K 2110 Processing with INDIGO Option and Offers High-Density Routing Solutions with New WAVE SeriesNew Mini Converters a...
03/02/2026
Cobalt Digital's NAB 2024 Plans Include a Simplified Path to ATSC 3.0
Other Highlights include Enhanced IP Multiviewers, Expanded Router and Control Panel ...