Sony Pixel Power calrec Sony

New Performance Optimizations Supercharge NVIDIA RTX AI PCs for Gamers, Creators and Developers

21/05/2024

NVIDIA today announced at Microsoft Build new AI performance optimizations and integrations for Windows that help deliver maximum performance on NVIDIA GeForce RTX AI PCs and NVIDIA RTX workstations.

Large language models (LLMs) power some of the most exciting new use cases in generative AI and now run up to 3x faster with ONNX Runtime (ORT) and DirectML using the new NVIDIA R555 Game Ready Driver. ORT and DirectML are high-performance tools used to run AI models locally on Windows PCs.

WebNN, an application programming interface for web developers to deploy AI models, is now accelerated with RTX via DirectML, enabling web apps to incorporate fast, AI-powered capabilities. And PyTorch will support DirectML execution backends, enabling Windows developers to train and infer complex AI models on Windows natively. NVIDIA and Microsoft are collaborating to scale performance on RTX GPUs.

These advancements build on NVIDIA's world-leading AI platform, which accelerates more than 500 applications and games on over 100 million RTX AI PCs and workstations worldwide.

RTX AI PCs - Enhanced AI for Gamers, Creators and Developers NVIDIA introduced the first PC GPUs with dedicated AI acceleration, the GeForce RTX 20 Series with Tensor Cores, along with the first widely adopted AI model to run on Windows, NVIDIA DLSS, in 2018. Its latest GPUs offer up to 1,300 trillion operations per second of dedicated AI performance.

In the coming months, Copilot+ PCs equipped with new power-efficient systems-on-a-chip and RTX GPUs will be released, giving gamers, creators, enthusiasts and developers increased performance to tackle demanding local AI workloads, along with Microsoft's new Copilot+ features.

For gamers on RTX AI PCs, NVIDIA DLSS boosts frame rates by up to 4x, while NVIDIA ACE brings game characters to life with AI-driven dialogue, animation and speech.

For content creators, RTX powers AI-assisted production workflows in apps like Adobe Premiere, Blackmagic Design DaVinci Resolve and Blender to automate tedious tasks and streamline workflows. From 3D denoising and accelerated rendering to text-to-image and video generation, these tools empower artists to bring their visions to life.

For game modders, NVIDIA RTX Remix, built on the NVIDIA Omniverse platform, provides AI-accelerated tools to create RTX remasters of classic PC games. It makes it easier than ever to capture game assets, enhance materials with generative AI tools and incorporate full ray tracing.

For livestreamers, the NVIDIA Broadcast application delivers high-quality AI-powered background subtraction and noise removal, while NVIDIA RTX Video provides AI-powered upscaling and auto-high-dynamic range to enhance streamed video quality.

Enhancing productivity, LLMs powered by RTX GPUs execute AI assistants and copilots faster, and can process multiple requests simultaneously.

And RTX AI PCs allow developers to build and fine-tune AI models directly on their devices using NVIDIA's AI developer tools, which include NVIDIA AI Workbench, NVIDIA cuDNN and CUDA on Windows Subsystem for Linux. Developers also have access to RTX-accelerated AI frameworks and software development kits like NVIDIA TensorRT, NVIDIA Maxine and RTX Video.

The combination of AI capabilities and performance deliver enhanced experiences for gamers, creators and developers.

Faster LLMs and New Capabilities for Web Developers Microsoft recently released the generative AI extension for ORT, a cross-platform library for AI inference. The extension adds support for optimization techniques like quantization for LLMs like Phi-3, Llama 3, Gemma and Mistral. ORT supports different execution providers for inferencing via various software and hardware stacks, including DirectML.

ORT with the DirectML backend offers Windows AI developers a quick path to develop AI capabilities, with stability and production-grade support for the broad Windows PC ecosystem. NVIDIA optimizations for the generative AI extension for ORT, available now in R555 Game Ready, Studio and NVIDIA RTX Enterprise Drivers, help developers get up to 3x faster performance on RTX compared to previous drivers.

Inference performance for three LLMs using ONNX Runtime and the DirectML execution provider with the latest R555 GeForce driver compared to the previous R550 driver. INSEQ=2000 representative of document summarization workloads. All data captured with GeForce RTX 4090 GPU using batch size 1. The generative AI extension support for int4 quantization, plus the NVIDIA optimizations, result in up to 3x faster performance for LLMs. Developers can unlock the full capabilities of RTX hardware with the new R555 driver, bringing better AI experiences to consumers, faster. It includes:

Support for DQ-GEMM metacommand to handle INT4 weight-only quantization for LLMs

New RMSNorm normalization methods for Llama 2, Llama 3, Mistral and Phi-3 models

Group and multi-query attention mechanisms, and sliding window attention to support Mistral

In-place KV updates to improve attention performance

Support for GEMM of non-multiple-of-8 tensors to improve context phase performance

Additionally, NVIDIA has optimized AI workflows within WebNN to deliver the powerful performance of RTX GPUs directly within browsers. The WebNN standard helps web app developers accelerate deep learning models with on-device AI accelerators, like Tensor Cores.

Now available in developer preview, WebNN uses DirectML and ORT Web, a Javascript library for in-browser model execution, to make AI applications more accessible across multiple platforms. With this acceleration, popular models like Stable Diffusion, SD Turbo and Whisper run up to 4x faster on WebNN compared to WebGPU and are now available for developers to use. Microsoft Build attendees can learn more about developing on RTX in the Accelerating development on Windows PCs w
LINK: https://blogs.nvidia.com/blog/rtx-advanced-ai-windows-pc-build/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

19/11/2026

Live From the UFL Draft: League's First Live Draft Broadcast Is Set To Innovate, Bring Viewers Close to the Action

With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...

19/11/2026

SVG Students To Watch: Niamh Campbell, Seton Hall University

The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone The future of live sports produ...

19/11/2026

RED Connect Adds Native Colorfront Color Management for Live RED Camera Feeds

RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...

19/11/2026

SMPTE Publishes Engineering Report on Content Provenance and Authenticity

SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...

19/11/2026

CTech and Skyline Communications Partner on Integrated SATCOM Operations for Defense

CTech and Skyline Communications have announced a partnership to deliver integra...

19/11/2026

EITB Deploys SMPTE ST 2110 Infrastructure with Lawo HOME mc DSP Processing

Euskal Irrati Telebista (EITB), the Basque Country's public media group, has completed Phase 1 of a five-studio renewal with the commissioning of a Lawo IP ...

19/11/2026

Esports Foundation Expands Road to Esports Nations Cup 2027 with New Qualifiers, Larger Rosters and National Rankings

The Esports Foundation (EF) has announced an expanded Road to ENC 2027 for the E...

19/11/2026

AWSN Holds First Women's Sports Awards Show, VEON: Women Who Win, in New York City

All Women's Sports Network (AWSN) held its first awards show, VEON: Women W...

19/11/2026

Gracenote Extends DIRECTV Partnership for Sports Hubs

Gracenote, the content intelligence business unit of Nielsen, has extended its relationship with DIRECTV. Gracenote will continue to supply visual imagery and p...

19/11/2026

AES Technical Committee Expands Loudness Website with Dialogue Intelligibility Content

The Audio Engineering Society (AES) Technical Committee on Broadcast and Online ...

19/11/2026

NDI 6.4 Adds Recording and Playback APIs, HEVC 4:4:4 and Wi-Fi Receiver Buffer

NDI has released NDI 6.4, which adds Recording and Playback APIs, support for HEVC 4:4:4 and a configurable receiver buffer for Wi-Fi. The update also includes ...

19/11/2026

Lemonlight Announces Hero, an AI Production Operating System for Video

Lemonlight, the video production company behind more than 50,000 brand videos, has announced Hero, an AI production operating system, along with a new AI agent ...

19/11/2026

FanConnect Brings JPEG XS Beyond the Control Room, Cuts In-Venue IPTV Latency 89% for University of Maryland Athletics

In a first-of-its-kind deployment at XFINITY Center, the digital signage/display...

19/11/2026

NBCU Intros Peacock Performance View for Premier League Coverage

For the first time on a US streaming service, real-time player identification, contextual stats, and visual insights appear right in the live stream, available ...

19/11/2026

Dome Productions Director of Engineering Mike Johnson To Retire at Years End

His career runs from the 2-in. videotape era to Canada's first HD and UHD live-production facilities...

19/11/2026

SVG GFX Forum Returns to NYC on Feb. 24 to Unite Graphics Tech and Creative Leaders

The popular sports-graphics event features a new Chairperson and new venue...

19/11/2026

Josephine Explores the Lingering Impact of Violence Through a Child's Eyes

Beth de Ara jo, Gemma Chan, Channing Tatum and Mason Reeves attend the premiere of Josephine at Eccles Theatre on January 23, 2026, in Park City, UT. (Photo b...

19/11/2026

Expressive E release Maestro Brass

New performance-focused brass library announced Expressive E's latest release brings together four meticulously sampled brass instruments: sousaphone, b...

19/11/2026

Korg introduce phase8 companion

Acoustic synthesizer gains free web editor The phase8 acoustic synthesizer has been an ongoing project for Korg Berlin. It was unveiled as an early prototyp...

19/11/2026

Impact GX49 & GX61 Mk3 from Nektar

MIDI controller keyboards upgraded Designed for users who want a full-size keyboard and hands-on DAW control but in a relatively compact footprint, Nektar&#...

19/11/2026

IK Multimedia unveil the iLoud Micro Monitor 2

Hugely popular compact monitor overhauled IK Multimedia's ultra-compact monitors have proven to be incredibly popular, and the company say that they'...

19/11/2026

Rohde & Schwarz brings company-wide technology and service expertise to critical infrastructure

Rohde & Schwarz brings company-wide technology and service expertise to critical...

19/11/2026

Global Impact, Local Action: Highlights from Nielsen Global Impact Day 2026

On October 8, 2026, Nielsen employees came together around the world to celebrate our fourteenth company-wide day of service, Nielsen Global Impact Day (NGID). ...

19/11/2026

Nexxen and Gracenote Partner to Expand Content-Based Targeting for CTV

Integrating Gracenote's content intelligence with Nexxen's unique CTV supply allows advertisers to more closely align campaigns with audience viewing ha...

19/11/2026

Nielsen Further Evolves Audio Measurement With Introduction of 1-Minute Qualifier

Enhancement Mirrors Local TV's Recent Move to 1-Minute Qualifier (1MQ) Upda...

19/11/2026

Samba Combines Streaming, Linear TV Data

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Charting the Progress of Brazil TV 3.0 with VVC

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Skydance to Combine Warner Bros. Television Group and Paramount Television Studios

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

19/11/2026

Australia's Seven Selects RTS Comms for New Headquarters

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Richard Burki Expands the Possibilities of Immersive Audi...

As Founder and Creative Director of Future Phonic Studios, the Netherlands' first Dolby Atmos music studio, Richard Burki has spent more than a decade pushi...

19/11/2026

Boris FX Black Friday Sale - 25% Off Everything

Boris FX Black Friday Sale - 25% Off Everything Brie Clayton November 19, 2026 0 Comments Check out the Boris FX Black Friday sale on Monday, November...

19/11/2026

Virtual Production Finds Its Middle Ground with Blackmagic Design

Virtual Production Finds Its Middle Ground with Blackmagic Design Brie Clayton November 19, 2026 0 Comments How Neon Vision is using PYXIS 12K and Ult...

19/11/2026

FL Studio Announces Black Friday Discounts of Up to 50% Across Its Software Lineup

FL Studio Announces Black Friday Discounts of Up to 50% Across Its Software Line...

19/11/2026

TBS Drama Series Tagusari Brothers Uses DaVinci Resolve Studio

TBS Drama Series Tagusari Brothers Uses DaVinci Resolve Studio Brie Clayton November 19, 2026 0 Comments TBS ACT streamlines post production for broad...

19/11/2026

Beeble launches SwitchX 3.0 with dynamic environments and greater creative control

Beeble launches SwitchX 3.0 with dynamic environments and greater creative contr...

19/11/2026

NDI Releases Latest Version With Recording, Playback APIs

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Newsmax Asks Court to Block Foxs Acquisition of Roku

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

HPA to Honor The Odyssey Director Christopher Nolan with Judges Award for Creativity and Innovation

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

19/11/2026

Australian Professional Leagues Renews Partnership with B...

Five-year deployment has automated APL's media supply chain from fixture to archive, managing over 200,000 assets Blue Lucy, the workflow orchestration and...

19/11/2026

Riding the Australian wave through co-pros

Riding the Australian wave through co-pros 11 November 2026 L-R: The Surfer, We Bury the Dead Australian stories are captivating global audiences and attracti...

19/11/2026

Screen Australia and Australian Film Television and Radio School announce the First Nations Producer Fellowship Program 2027

Screen Australia and Australian Film Television and Radio School announce the Fi...

19/11/2026

AES Adds Dialogue Intelligibility to Loudness Website

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Rise Awards 2026 Celebrate Inspirational Women in Broadcast

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

BPS Trial at Dominion Energy Substation Proves Successful

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Wisycom and DPA Prove Essential for Demanding and Unpredi...

iStreamU LLC, a rapidly growing production and systems integration company founded by longtime Producer/Director Ivan Gonzalez, has standardized its audio workf...

19/11/2026

Seven Scripps Research scientists named to Clarivate's 2026 list of Highly Cited Researchers

LA JOLLA, CA-Clarivate, a global information and analytics company, named seven ...

19/11/2026

The Day of the Jackal: Eddie Redmayne returns in first-look teaser for series 2 of global hit Sky Original, coming March 2027

Thursday 19 November 2026 The Day of the Jackal: Eddie Redmayne returns in firs...

19/11/2026

Why the world needs the next generation at the standards table

When I first started my career in lighting engineering, it felt cutting edge and rewarding to be designing solutions that affect all of us every day, whether at...