Sony Pixel Power calrec Sony

New Performance Optimizations Supercharge NVIDIA RTX AI PCs for Gamers, Creators and Developers

21/05/2024

NVIDIA today announced at Microsoft Build new AI performance optimizations and integrations for Windows that help deliver maximum performance on NVIDIA GeForce RTX AI PCs and NVIDIA RTX workstations.

Large language models (LLMs) power some of the most exciting new use cases in generative AI and now run up to 3x faster with ONNX Runtime (ORT) and DirectML using the new NVIDIA R555 Game Ready Driver. ORT and DirectML are high-performance tools used to run AI models locally on Windows PCs.

WebNN, an application programming interface for web developers to deploy AI models, is now accelerated with RTX via DirectML, enabling web apps to incorporate fast, AI-powered capabilities. And PyTorch will support DirectML execution backends, enabling Windows developers to train and infer complex AI models on Windows natively. NVIDIA and Microsoft are collaborating to scale performance on RTX GPUs.

These advancements build on NVIDIA's world-leading AI platform, which accelerates more than 500 applications and games on over 100 million RTX AI PCs and workstations worldwide.

RTX AI PCs - Enhanced AI for Gamers, Creators and Developers NVIDIA introduced the first PC GPUs with dedicated AI acceleration, the GeForce RTX 20 Series with Tensor Cores, along with the first widely adopted AI model to run on Windows, NVIDIA DLSS, in 2018. Its latest GPUs offer up to 1,300 trillion operations per second of dedicated AI performance.

In the coming months, Copilot+ PCs equipped with new power-efficient systems-on-a-chip and RTX GPUs will be released, giving gamers, creators, enthusiasts and developers increased performance to tackle demanding local AI workloads, along with Microsoft's new Copilot+ features.

For gamers on RTX AI PCs, NVIDIA DLSS boosts frame rates by up to 4x, while NVIDIA ACE brings game characters to life with AI-driven dialogue, animation and speech.

For content creators, RTX powers AI-assisted production workflows in apps like Adobe Premiere, Blackmagic Design DaVinci Resolve and Blender to automate tedious tasks and streamline workflows. From 3D denoising and accelerated rendering to text-to-image and video generation, these tools empower artists to bring their visions to life.

For game modders, NVIDIA RTX Remix, built on the NVIDIA Omniverse platform, provides AI-accelerated tools to create RTX remasters of classic PC games. It makes it easier than ever to capture game assets, enhance materials with generative AI tools and incorporate full ray tracing.

For livestreamers, the NVIDIA Broadcast application delivers high-quality AI-powered background subtraction and noise removal, while NVIDIA RTX Video provides AI-powered upscaling and auto-high-dynamic range to enhance streamed video quality.

Enhancing productivity, LLMs powered by RTX GPUs execute AI assistants and copilots faster, and can process multiple requests simultaneously.

And RTX AI PCs allow developers to build and fine-tune AI models directly on their devices using NVIDIA's AI developer tools, which include NVIDIA AI Workbench, NVIDIA cuDNN and CUDA on Windows Subsystem for Linux. Developers also have access to RTX-accelerated AI frameworks and software development kits like NVIDIA TensorRT, NVIDIA Maxine and RTX Video.

The combination of AI capabilities and performance deliver enhanced experiences for gamers, creators and developers.

Faster LLMs and New Capabilities for Web Developers Microsoft recently released the generative AI extension for ORT, a cross-platform library for AI inference. The extension adds support for optimization techniques like quantization for LLMs like Phi-3, Llama 3, Gemma and Mistral. ORT supports different execution providers for inferencing via various software and hardware stacks, including DirectML.

ORT with the DirectML backend offers Windows AI developers a quick path to develop AI capabilities, with stability and production-grade support for the broad Windows PC ecosystem. NVIDIA optimizations for the generative AI extension for ORT, available now in R555 Game Ready, Studio and NVIDIA RTX Enterprise Drivers, help developers get up to 3x faster performance on RTX compared to previous drivers.

Inference performance for three LLMs using ONNX Runtime and the DirectML execution provider with the latest R555 GeForce driver compared to the previous R550 driver. INSEQ=2000 representative of document summarization workloads. All data captured with GeForce RTX 4090 GPU using batch size 1. The generative AI extension support for int4 quantization, plus the NVIDIA optimizations, result in up to 3x faster performance for LLMs. Developers can unlock the full capabilities of RTX hardware with the new R555 driver, bringing better AI experiences to consumers, faster. It includes:

Support for DQ-GEMM metacommand to handle INT4 weight-only quantization for LLMs

New RMSNorm normalization methods for Llama 2, Llama 3, Mistral and Phi-3 models

Group and multi-query attention mechanisms, and sliding window attention to support Mistral

In-place KV updates to improve attention performance

Support for GEMM of non-multiple-of-8 tensors to improve context phase performance

Additionally, NVIDIA has optimized AI workflows within WebNN to deliver the powerful performance of RTX GPUs directly within browsers. The WebNN standard helps web app developers accelerate deep learning models with on-device AI accelerators, like Tensor Cores.

Now available in developer preview, WebNN uses DirectML and ORT Web, a Javascript library for in-browser model execution, to make AI applications more accessible across multiple platforms. With this acceleration, popular models like Stable Diffusion, SD Turbo and Whisper run up to 4x faster on WebNN compared to WebGPU and are now available for developers to use. Microsoft Build attendees can learn more about developing on RTX in the Accelerating development on Windows PCs w
LINK: https://blogs.nvidia.com/blog/rtx-advanced-ai-windows-pc-build/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

16/07/2026

The Gauge: Poland | June 2026

June brought stabilization to the television market. Poles spent an average of 3 hours and 36 minutes a day in front of their TV screens exactly the same as i...

16/07/2026

New studio monitoring leads Glensound's 60th year line-up...

Glensound returns to IBC with a major new addition to its intelligent loudspeaker range, the Greater Divine Supernal studio monitor, alongside recent developmen...

16/07/2026

Complete spectrum of innovation from British exhibitors a...

33 leading exhibitors are taking part in the GREAT Britain and Northern Ireland Pavilions and linked locations across IBC2026 (Amsterdam RAI, 11 14 September)...

16/07/2026

Hitomi Broadcast to showcase HDR colour verification and...

Hitomi Broadcast will introduce Spectra, a new HDR colour verification solution measured in picture, not using VPID, at IBC2026 (Hall 10, Stand A40). Expanding ...

16/07/2026

SMPTE Kicks Off 110th Anniversary Campaign

Share Copy link Facebook X Linkedin Bluesky Email...

16/07/2026

Cox Media Group Taps Waymark for AI Ad Creation Tools

Share Copy link Facebook X Linkedin Bluesky Email...

16/07/2026

Parks: Cable Broadband Sub Losses Slow Down

Share Copy link Facebook X Linkedin Bluesky Email...

16/07/2026

CatchLight, Sony Launch Initiative to Help Local Newsrooms

Share Copy link Facebook X Linkedin Bluesky Email...

16/07/2026

XR Launches XR ONE Ad Ops Platform

Share Copy link Facebook X Linkedin Bluesky Email...

16/07/2026

Zixi and Comcast Technology Solutions Partner to Provide...

Zixi, a leader in live video delivery and workflow orchestration, and Comcast Technology Solutions (CTS) today announced a strategic new integration to deliver ...

16/07/2026

Blackmagic Design Cameras Capture Immersive Flight for New Cirrus App

Blackmagic Design Cameras Capture Immersive Flight for New Cirrus App Brie Clayton July 15, 2026 0 Comments Leader in Personal Aviation taps URSA Cin...

16/07/2026

XenData Announces LTO Archive Appliances with both File and S3 Object Storage Interfaces

XenData Announces LTO Archive Appliances with both File and S3 Object Storage In...

16/07/2026

Sharpen the Sword, Skip the Downloads - Onimusha: Way of the Sword' Is Coming to GeForce NOW

Onimusha: Way of the Sword is coming to GeForce NOW at launch, with the playable...

16/07/2026

FIFA World Cup semi-finals deliver whopper audiences as RT Player surpasses 21 million streams across the tournament to date

Together the semi-finals had a combined reach of 1.98 million unique individuals...

15/07/2026

Inside DAZNs Multi-Market World Cup Effort With CTO Sandeep Tiku

The 2026 FIFA World Cup is a big deal for DAZN, which has distribution rights in three markets: Italy, Spain, and Japan. Each requires a different editorial app...

15/07/2026

SVG New Sponsor Spotlight: Qumulo's Chris Horn on Powering Global Media Workflows Across Edge, Core, and Cloud

As sports-media organizations manage rapidly growing content libraries and incre...

15/07/2026

FIFA World Cup 2026: Inside the HBS Non-Live London Production Hub

HBS director of digital Johannes Franken talks SVG Europe through the operation built to serve FIFA World Cup 2026 rights holders remotely from Stratford, east ...

15/07/2026

IBC2026 to Spotlight AI, Live Sports Production, Creator Economy, and Trust in Media

IBC has unveiled the conference program for IBC2026, with this year's event ...

15/07/2026

Vanessa Paradis Tour Adopts Sennheiser Spectera Wireless Ecosystem for 2026 Production

Software-defined wideband RF platform supports 96-kHz monitoring, streamlined fr...

15/07/2026

Telos Alliance Integrates AudioShake Source Separation Into Minnetonka AudioTools Server

New AI-powered module enables broadcasters and content owners to extract dialogu...

15/07/2026

AIMS Schedules Second IPMX Product Certification Event for August

Weeklong gathering at EBU headquarters will test new IPMX capabilities and expand certified product ecosystem...

15/07/2026

Force Tech Appoints Bryan Adams as Vice President of Integration

Force Tech has announced the appointment of Bryan Adams, CTS, as Vice President of Integration. Adams will oversee AV and broadcast integration project delivery...

15/07/2026

USA Sports and Bundesliga Announce Exclusive Multi-Year U.S. Media Rights Agreement

USA Sports has announced an exclusive English-language agreement with the Bundes...

15/07/2026

Inside ITV Sport's Stunning FIFA World Cup Studio in New York City With Paul McNamara

ITV Sport's FIFA World Cup 2026 coverage has been produced from one of the m...

15/07/2026

CatchLight, Sony Launch Equipment Initiative for Local Visual Journalists

Program will provide professional camera kits, training, and technical support to participating local newsrooms...

15/07/2026

CornerstoneSF Installs FOR-A HVS-Q12 Switcher in New UHD Production Facility

San Francisco church becomes first U.S. deployment of the 2 M/E production switcher...

15/07/2026

Steve Bornstein Joins Advisory Board of Scott Cokers New Global MMA Promotion

Former ESPN and NFL Network executive to advise startup league on media, distribution, technology, and fan engagement...

15/07/2026

Space City Home Network Executive Producer John Valek on Leaning Into Innovation, Access, and Opportunity

The Houston-based RSN is the live-game home of the Astros and Rockets...

15/07/2026

Freqport unveil the Dual FreqInOut FO1-2RK

Launched alongside new FreqSoft installer Designed to bridge the gap between hardware and software, Freqport's FreqInOut FO1 unit provides a simple way ...

15/07/2026

Expressive E's Summer Offers

Save up to 55% on software until 23 July 2026 Expressive E have just launched their Summer Offer sale, with discounts of up to 55% now applied across their ...

15/07/2026

Peel Stems 2 from zplane

Real-time stem-separation tool updated zplane have recently released a new and improved version of their real-time stem-separation plug-in which they say ma...

15/07/2026

Baby Audio SubCulture

A new benchmark in bass enhancement Described as a new benchmark in bass enhancement , Baby Audio's latest release has been designed to augment the lo...

15/07/2026

DMC Production Reimagines Live OB with Calrec

DMC Production's AR 1 and AR 2 units reverse the conventional OB workflow, keeping all production-critical processing at the venue while operators work remo...

15/07/2026

FCC to Vote on Replacing National Broadcast Ownership Cap

Share Copy link Facebook X Linkedin Bluesky Email...

15/07/2026

ATSC Updates Industry Audio Loudness Guidance

Share Copy link Facebook X Linkedin Bluesky Email...

15/07/2026

GigaCloud and Cubbit partner to deliver sovereign and res...

GigaCloud, a leading Ukrainian cloud service provider, and Cubbit, the first geo-distributed cloud storage enabler, today announced a new Business Alliance Part...

15/07/2026

SMPTE Launches 110th Anniversary Campaign to Advance Its...

SMPTE, the global society for media professionals, technologists, and engineers, has announced the launch of the SMPTE 110th Anniversary Campaign, a fundraising...

15/07/2026

STUDIO TECHNOLOGIES UNVEILS MODEL 762 STEREO LEVEL CONTRO...

Studio Technologies, a leading manufacturer of high-quality audio, video, and fiber-optic solutions, unveils the new StudioComm Model 762 Stereo Level Control, ...

15/07/2026

COW Jobs: Producer, Virtual Events - Hybrid, Full Time, Salaried

COW Jobs: Producer, Virtual Events - Hybrid, Full Time, Salaried Brie Clayton July 15, 2026 0 Comments Producer, Virtual Events (Hybrid | Full-time | ...

15/07/2026

SIMBA powers new streaming delivery network with Broadpea...

Brazilian media organization builds nationwide CDN with Broadpeak's high-performance software for low-latency streaming and new content distribution service...

15/07/2026

DHD Introduces Discovery Utility for Network-Connected Au...

DHD announces a new utility designed to increase the efficiency of its audio mixing systems during initial installation and subsequent configuration. Anyone w...

15/07/2026

BCNEXXT Brings Next-Generation Vipe to IBC2026 Breaking t...

BCNEXXT Brings Next-Generation Vipe to IBC2026, Breaking the 1:1 Channel-to-Server Ratio New innovations liberate broadcasters from legacy playout infrastructur...

15/07/2026

S&P Analysis: Three Quarters of Americans Watch Live Sports

Share Copy link Facebook X Linkedin Bluesky Email...

15/07/2026

Scripps Sports, Ion Score Women's Volleyball Rights

Share Copy link Facebook X Linkedin Bluesky Email...

15/07/2026

NVIDIA Introduces New Jetson Thor Computers to Advance Mainstream Robotics and Edge AI

General-purpose robots and autonomous machines are moving from research labs to ...