Sony Pixel Power calrec Sony

New Performance Optimizations Supercharge NVIDIA RTX AI PCs for Gamers, Creators and Developers

21/05/2024

NVIDIA today announced at Microsoft Build new AI performance optimizations and integrations for Windows that help deliver maximum performance on NVIDIA GeForce RTX AI PCs and NVIDIA RTX workstations.

Large language models (LLMs) power some of the most exciting new use cases in generative AI and now run up to 3x faster with ONNX Runtime (ORT) and DirectML using the new NVIDIA R555 Game Ready Driver. ORT and DirectML are high-performance tools used to run AI models locally on Windows PCs.

WebNN, an application programming interface for web developers to deploy AI models, is now accelerated with RTX via DirectML, enabling web apps to incorporate fast, AI-powered capabilities. And PyTorch will support DirectML execution backends, enabling Windows developers to train and infer complex AI models on Windows natively. NVIDIA and Microsoft are collaborating to scale performance on RTX GPUs.

These advancements build on NVIDIA's world-leading AI platform, which accelerates more than 500 applications and games on over 100 million RTX AI PCs and workstations worldwide.

RTX AI PCs - Enhanced AI for Gamers, Creators and Developers NVIDIA introduced the first PC GPUs with dedicated AI acceleration, the GeForce RTX 20 Series with Tensor Cores, along with the first widely adopted AI model to run on Windows, NVIDIA DLSS, in 2018. Its latest GPUs offer up to 1,300 trillion operations per second of dedicated AI performance.

In the coming months, Copilot+ PCs equipped with new power-efficient systems-on-a-chip and RTX GPUs will be released, giving gamers, creators, enthusiasts and developers increased performance to tackle demanding local AI workloads, along with Microsoft's new Copilot+ features.

For gamers on RTX AI PCs, NVIDIA DLSS boosts frame rates by up to 4x, while NVIDIA ACE brings game characters to life with AI-driven dialogue, animation and speech.

For content creators, RTX powers AI-assisted production workflows in apps like Adobe Premiere, Blackmagic Design DaVinci Resolve and Blender to automate tedious tasks and streamline workflows. From 3D denoising and accelerated rendering to text-to-image and video generation, these tools empower artists to bring their visions to life.

For game modders, NVIDIA RTX Remix, built on the NVIDIA Omniverse platform, provides AI-accelerated tools to create RTX remasters of classic PC games. It makes it easier than ever to capture game assets, enhance materials with generative AI tools and incorporate full ray tracing.

For livestreamers, the NVIDIA Broadcast application delivers high-quality AI-powered background subtraction and noise removal, while NVIDIA RTX Video provides AI-powered upscaling and auto-high-dynamic range to enhance streamed video quality.

Enhancing productivity, LLMs powered by RTX GPUs execute AI assistants and copilots faster, and can process multiple requests simultaneously.

And RTX AI PCs allow developers to build and fine-tune AI models directly on their devices using NVIDIA's AI developer tools, which include NVIDIA AI Workbench, NVIDIA cuDNN and CUDA on Windows Subsystem for Linux. Developers also have access to RTX-accelerated AI frameworks and software development kits like NVIDIA TensorRT, NVIDIA Maxine and RTX Video.

The combination of AI capabilities and performance deliver enhanced experiences for gamers, creators and developers.

Faster LLMs and New Capabilities for Web Developers Microsoft recently released the generative AI extension for ORT, a cross-platform library for AI inference. The extension adds support for optimization techniques like quantization for LLMs like Phi-3, Llama 3, Gemma and Mistral. ORT supports different execution providers for inferencing via various software and hardware stacks, including DirectML.

ORT with the DirectML backend offers Windows AI developers a quick path to develop AI capabilities, with stability and production-grade support for the broad Windows PC ecosystem. NVIDIA optimizations for the generative AI extension for ORT, available now in R555 Game Ready, Studio and NVIDIA RTX Enterprise Drivers, help developers get up to 3x faster performance on RTX compared to previous drivers.

Inference performance for three LLMs using ONNX Runtime and the DirectML execution provider with the latest R555 GeForce driver compared to the previous R550 driver. INSEQ=2000 representative of document summarization workloads. All data captured with GeForce RTX 4090 GPU using batch size 1. The generative AI extension support for int4 quantization, plus the NVIDIA optimizations, result in up to 3x faster performance for LLMs. Developers can unlock the full capabilities of RTX hardware with the new R555 driver, bringing better AI experiences to consumers, faster. It includes:

Support for DQ-GEMM metacommand to handle INT4 weight-only quantization for LLMs

New RMSNorm normalization methods for Llama 2, Llama 3, Mistral and Phi-3 models

Group and multi-query attention mechanisms, and sliding window attention to support Mistral

In-place KV updates to improve attention performance

Support for GEMM of non-multiple-of-8 tensors to improve context phase performance

Additionally, NVIDIA has optimized AI workflows within WebNN to deliver the powerful performance of RTX GPUs directly within browsers. The WebNN standard helps web app developers accelerate deep learning models with on-device AI accelerators, like Tensor Cores.

Now available in developer preview, WebNN uses DirectML and ORT Web, a Javascript library for in-browser model execution, to make AI applications more accessible across multiple platforms. With this acceleration, popular models like Stable Diffusion, SD Turbo and Whisper run up to 4x faster on WebNN compared to WebGPU and are now available for developers to use. Microsoft Build attendees can learn more about developing on RTX in the Accelerating development on Windows PCs w
LINK: https://blogs.nvidia.com/blog/rtx-advanced-ai-windows-pc-build/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

06/08/2026

USA Sports Rolls Into 2026 NASCAR Season With First Pace-Car Analyst on Selected Races

The broadcaster's 14-race schedule begins in Iowa and ends in November with ...

06/08/2026

SVG GameDay, Ep. 25: Chicago Bears Katlin Strange - Serving the Masses in the Windy City

In-venue and creative video staffers at the professional and collegiate level ha...

06/08/2026

Warner Bros Discovery's Anne Graham Details the Organization's Media-Ops and Metadata Consolidation Across Sports and Entertainment

As media organizations consolidate teams, technology platforms, and content libr...

06/08/2026

Dolby Vision 2 Begins Rollout on Selected 2026 Hisense TVs

Firmware updates introduce Dolby's next-generation picture engine, content-aware optimization, and new motion and ambient-light tools...

06/08/2026

TNT Sports Preps Wall-to-Wall Coverage of FIBA Women's Basketball World Cup 2026 from Sept. 4-13

TNT Sports will have wall-to-wall coverage of the upcoming FIBA Women's Bask...

06/08/2026

IBC 2026: swXtch.io Introduces groundSwXtch Software-Defined Multicast Overlay

swXtch.io (Stand 5.MR13) has unveiled groundSwXtch for Audio over IP (AoIP), a software application that lets broadcasters and media organizations move audio in...

06/08/2026

IBC 2026: Riedel Communications Showcases Integrated IP Production Workflows

At IBC2026, Riedel Communications (Stands: 10.A24, 10.A31, 10.A38) will bring modern media production to life with the Live Production Experience - a connected ...

06/08/2026

Sandy Grossman's Legacy as a Pioneering Director Earns Pro Football Hall of Fame's Pete Rozelle Award

The first live-sports director to receive the prestigious honor, eight-time Emmy...

06/08/2026

NBC Sports, Maryland Jockey Club Continue Partnership To Present Preakness Stakes Through 2032

NBC Sports will continue to present the Preakness Stakes on NBC and Peacock thro...

06/08/2026

IBC 2026: Cobalt Digital Brings New Practical Solutions to Evolving Broadcast Workflows

Cobalt Digital (Stand 8.F90) continues to reinforce its commitment to delivering...

06/08/2026

Wave Central Elevates Jeff Daubert to Director of Sales, Americas

Wave Central has promoted promotion Jeff Daubert to Director of Sales, Americas. In his expanded role, Daubert will lead Wave Central's sales strategy and ...

06/08/2026

KMH Integration Adds Architect Keith Hanadel to Expanding Full-Services Team

KMH Integration is expanding its ability to serve media, broadcast, and IT organizations by adding Keith Hanadel, an accomplished architect with decades of indu...

06/08/2026

Advanced Systems Group Promotes Michele Ferreira to Chief Business Officer

Advanced Systems Group (ASG) has promoted Michele Ferreira from Vice President of its Systems Integration team to the newly created position of Chief Business O...

06/08/2026

IBC2026: Appear Expands X, VX Platforms for Hybrid Live-Production Workflows

Demonstrations will include new JPEG XS, Dolby audio, cloud-gateway, stream-processing, and distribution capabilities...

06/08/2026

Live Media Group Acquires Gravity Media's U.S. Mobile-Production Assets, Adds Eight Units to Fleet

The deal includes three premium mobile units, engineering personnel, existing br...

06/08/2026

Broadcast Management Group, LiveU Power Vertical REMI Production for Amazon Prime's Obsessed Fest on TikTok

Broadcast Management Group produced Amazon Prime's inaugural Obsessed Fest a...

06/08/2026

IBC2026: Ikegami to Showcase Expanded UNICAM Camera and Monitoring Lineup

Exhibit will feature new variable-ND functionality, OLED viewfinders, remote-camera tools, and UHD production monitors...

06/08/2026

Sony Introduces FE 100-400mm Super-Telephoto Zoom Lens

Compact full-frame E-mount lens targets sports, wildlife, and other long-range shooting applications...

06/08/2026

Tennis Channel Lands Exclusive U.S. Coverage of 2026 International Tennis Hall of Fame Induction Ceremony

Live broadcast will honor Roger Federer and Mary Carillo on Aug. 29, with onsite...

06/08/2026

UTEP Upgrades Sun Bowl Stadium Video Display With Daktronics

End-zone board receives higher-resolution LED technology and an updated Show Control system ahead of the 2026 football season...

06/08/2026

Fender launch Fender Motion controllers

New 16- and 32-pad MIDI controllers now available Fender have just announced that the two new performance-focused controllers that were unveiled at NAMM 202...

06/08/2026

Lewitt update Space Replicator plug-in

Standalone version, performance improvements & more Lewitt have just released a significant update for their speaker and room virtualisation software, intro...

06/08/2026

Hallowed Bells from ebbandflow

Combines celeste samples with synth engine After launching earlier in 2026 with deFORM, ebbandflow have returned with their first sampled acoustic instrumen...

06/08/2026

SGL Carbon: Still on track to meet its 2026 annual targets

SGL Carbon's consolidated sales in the first half of 2026 totaled 394.2 million, down 13.0% from the prior year (H1 2025: 453.2 million). On the one hand,...

06/08/2026

BritBox & BBC's Poirot Origin Series Hercule' Reveals Cast

The BBC has announced casting for the forthcoming six-part series Hercule from Mammoth Screen and Agatha Christie Limited. Joining Bluemel are Henry Ashton (A ...

06/08/2026

FCC Votes to Modify TV Station Ownership Caps

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

LTN Showcases Live Event Master Control Capabilities for...

Proven offering builds on more than 20,000 live sporting events with greater automation, flexibility, and operational control LTN , the industry leader in tran...

06/08/2026

Hornets Tech brings new encoder and decoder range to IBC2...

Hornets Tech, a specialist in broadcast connectivity and IP video, is bringing a new range of encoders, decoders and an IPTV platform to IBC2026. Broadcast in...

06/08/2026

Introducing Adobe for ChatGPT: Create, edit and get work done - all in ChatGPT

Introducing Adobe for ChatGPT: Create, edit and get work done - all in ChatGPT Deepti Pradeep August 6, 2026 0 Comments The Adobe plugin in ChatGPT br...

06/08/2026

Hisense Adds Dolby Vision 2 to Select Models

Share Copy link Facebook X Linkedin Bluesky Email...

06/08/2026

MediaKind to showcase one unified portfolio at IBC2026

At IBC2026, MediaKind will make its first major appearance as a unified global powerhouse in video, showcasing one of the world's most comprehensive video i...

06/08/2026

Big Blue Marble to unveil AI-assisted piracy detection an...

Big Blue Marble (#5.A63) will demonstrate how its integrated technology and operational expertise help media companies scale premium services with less complexi...

06/08/2026

NIH expected to award Scripps Research nearly $4.2 million over 5 years to advance tools for vaccine design

LA JOLLA, CA-Scripps Research has received more than $500,000 in first-year fund...

06/08/2026

Improving vaccine design for Ebola, HIV and more

LA JOLLA, CA-Viruses are masters at invading our cells thanks to specialized proteins that coat their surfaces. When scientists design vaccines, they often crea...

06/08/2026

How a chemical reaction triggers brain inflammation in Alzheimer's disease

LA JOLLA, CA-The brain has its own immune system, which detects threats and mounts a defense. A growing body of evidence has shown that in Alzheimer's disea...

06/08/2026

Jin-Quan Yu elected to the National Academy of Sciences

LA JOLLA, CA-Scripps Research chemist Jin-Quan Yu has been elected to the National Academy of Sciences (NAS), one of the highest honors a scientist can achieve....

06/08/2026

Scripps Research ranks third in 2026 Cure Innovation Index

LA JOLLA, CA-Scripps Research ranked third in the inaugural 2026 Cure Innovation Index recognizing the top-performing institutes and centers across the United S...

06/08/2026

Scripps Research chemist Benjamin Cravatt elected to American Philosophical Society

Benjamin Cravatt, the Gilula Chair of Chemical Biology and a professor of chemis...

06/08/2026

Scripps Research immunologist Dennis Burton elected to American Academy of Arts and Sciences

LA JOLLA, CA-Dennis Burton, professor and the James & Jessie Minor Chair in Immu...

06/08/2026

How changes to proteins can alter drug interactions for new precision therapies

LA JOLLA, CA-Inside every human cell, proteins are constantly being tagged with small chemical modifications after they're produced. Known as post-translati...

06/08/2026

Scripps Research establishes endowed chair honoring renowned structural biologist Ian Wilson

LA JOLLA-Scripps Research has established the Ian Wilson Endowed Chair, a new fa...

06/08/2026

Scripps Research's Skaggs Graduate School awards doctoral degrees to 34th graduating class

Scripps Research's Skaggs Graduate School of Chemical and Biological Science...

06/08/2026

Scripps Research chemist Jin-Quan Yu is named a Fellow of the Royal Society

LA JOLLA, CA-Professor Jin-Quan Yu of Scripps Research has been elected to the Fellowship of the Royal Society, the U.K.'s national academy of sciences and ...

06/08/2026

Experimental HIV vaccine achieves a long-sought goal

LA JOLLA, CA-For years, researchers have been hoping for vaccines that protect people against not just one strain of HIV, but every strain of the quickly mutati...

06/08/2026

Calibr-Skaggs advances CLF065, a regenerative GLP-2 therapy, into two Phase 2 IBD studies

LA JOLLA, CA-The Calibr-Skaggs Institute for Innovative Medicines, the nonprofit...

06/08/2026

Chemists snap together complex 3D molecules from highly reactive radicals'-without losing their shape

LA JOLLA, CA-Building the complex 3D molecules needed for new medicines has alwa...

06/08/2026

A fentanyl countermeasure that adapts to combat future black-market drugs

LA JOLLA, CA-Fentanyl and related variants of the synthetic opioid kill more Americans each year than car accidents and gun violence combined. In too-high doses...