Sony Pixel Power calrec Sony

New Performance Optimizations Supercharge NVIDIA RTX AI PCs for Gamers, Creators and Developers


NVIDIA today announced at Microsoft Build new AI performance optimizations and integrations for Windows that help deliver maximum performance on NVIDIA GeForce RTX AI PCs and NVIDIA RTX workstations.

Large language models (LLMs) power some of the most exciting new use cases in generative AI and now run up to 3x faster with ONNX Runtime (ORT) and DirectML using the new NVIDIA R555 Game Ready Driver. ORT and DirectML are high-performance tools used to run AI models locally on Windows PCs.

WebNN, an application programming interface for web developers to deploy AI models, is now accelerated with RTX via DirectML, enabling web apps to incorporate fast, AI-powered capabilities. And PyTorch will support DirectML execution backends, enabling Windows developers to train and infer complex AI models on Windows natively. NVIDIA and Microsoft are collaborating to scale performance on RTX GPUs.

These advancements build on NVIDIA's world-leading AI platform, which accelerates more than 500 applications and games on over 100 million RTX AI PCs and workstations worldwide.

RTX AI PCs - Enhanced AI for Gamers, Creators and Developers NVIDIA introduced the first PC GPUs with dedicated AI acceleration, the GeForce RTX 20 Series with Tensor Cores, along with the first widely adopted AI model to run on Windows, NVIDIA DLSS, in 2018. Its latest GPUs offer up to 1,300 trillion operations per second of dedicated AI performance.

In the coming months, Copilot+ PCs equipped with new power-efficient systems-on-a-chip and RTX GPUs will be released, giving gamers, creators, enthusiasts and developers increased performance to tackle demanding local AI workloads, along with Microsoft's new Copilot+ features.

For gamers on RTX AI PCs, NVIDIA DLSS boosts frame rates by up to 4x, while NVIDIA ACE brings game characters to life with AI-driven dialogue, animation and speech.

For content creators, RTX powers AI-assisted production workflows in apps like Adobe Premiere, Blackmagic Design DaVinci Resolve and Blender to automate tedious tasks and streamline workflows. From 3D denoising and accelerated rendering to text-to-image and video generation, these tools empower artists to bring their visions to life.

For game modders, NVIDIA RTX Remix, built on the NVIDIA Omniverse platform, provides AI-accelerated tools to create RTX remasters of classic PC games. It makes it easier than ever to capture game assets, enhance materials with generative AI tools and incorporate full ray tracing.

For livestreamers, the NVIDIA Broadcast application delivers high-quality AI-powered background subtraction and noise removal, while NVIDIA RTX Video provides AI-powered upscaling and auto-high-dynamic range to enhance streamed video quality.

Enhancing productivity, LLMs powered by RTX GPUs execute AI assistants and copilots faster, and can process multiple requests simultaneously.

And RTX AI PCs allow developers to build and fine-tune AI models directly on their devices using NVIDIA's AI developer tools, which include NVIDIA AI Workbench, NVIDIA cuDNN and CUDA on Windows Subsystem for Linux. Developers also have access to RTX-accelerated AI frameworks and software development kits like NVIDIA TensorRT, NVIDIA Maxine and RTX Video.

The combination of AI capabilities and performance deliver enhanced experiences for gamers, creators and developers.

Faster LLMs and New Capabilities for Web Developers Microsoft recently released the generative AI extension for ORT, a cross-platform library for AI inference. The extension adds support for optimization techniques like quantization for LLMs like Phi-3, Llama 3, Gemma and Mistral. ORT supports different execution providers for inferencing via various software and hardware stacks, including DirectML.

ORT with the DirectML backend offers Windows AI developers a quick path to develop AI capabilities, with stability and production-grade support for the broad Windows PC ecosystem. NVIDIA optimizations for the generative AI extension for ORT, available now in R555 Game Ready, Studio and NVIDIA RTX Enterprise Drivers, help developers get up to 3x faster performance on RTX compared to previous drivers.

Inference performance for three LLMs using ONNX Runtime and the DirectML execution provider with the latest R555 GeForce driver compared to the previous R550 driver. INSEQ=2000 representative of document summarization workloads. All data captured with GeForce RTX 4090 GPU using batch size 1. The generative AI extension support for int4 quantization, plus the NVIDIA optimizations, result in up to 3x faster performance for LLMs. Developers can unlock the full capabilities of RTX hardware with the new R555 driver, bringing better AI experiences to consumers, faster. It includes:

Support for DQ-GEMM metacommand to handle INT4 weight-only quantization for LLMs

New RMSNorm normalization methods for Llama 2, Llama 3, Mistral and Phi-3 models

Group and multi-query attention mechanisms, and sliding window attention to support Mistral

In-place KV updates to improve attention performance

Support for GEMM of non-multiple-of-8 tensors to improve context phase performance

Additionally, NVIDIA has optimized AI workflows within WebNN to deliver the powerful performance of RTX GPUs directly within browsers. The WebNN standard helps web app developers accelerate deep learning models with on-device AI accelerators, like Tensor Cores.

Now available in developer preview, WebNN uses DirectML and ORT Web, a Javascript library for in-browser model execution, to make AI applications more accessible across multiple platforms. With this acceleration, popular models like Stable Diffusion, SD Turbo and Whisper run up to 4x faster on WebNN compared to WebGPU and are now available for developers to use. Microsoft Build attendees can learn more about developing on RTX in the Accelerating development on Windows PCs w
See more stories from nvidia

Most recent headlines


Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation

Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....


College of DuPage Enhances Event Communications with Clear-Com Systems

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......


Omdia: Mini LED Backlight LCD Display Market to Surpass OLED Displays in 2025

LONDON The latest Omdia Mini LED Backlight Market Tracker indicates that LCD TV displays equipped with mini-LED backlight units will hit 6.2 million units in 20...


ASTRA 1P Successfully Launched on SpaceX's Falcon 9 Rocket

CAPE CANAVERAL, Fla. SES has announced that the ASTRA 1P satellite was successfully launched by a SpaceX Falcon 9 rocket from Cape Canaveral Space Force Station...


GenAI to Boost Demand for Hybrid Data Platforms

STAMFORD, Conn. Demand for advanced data platforms is likely to grow significantly over the next three years as more organizations adopt intelligent application...


Viamedia to Provide Programmatic Ad Sales for Willow by Cricbuzz

LEXINGTON, Ky. Viamedia has announced a deal with Willow by Cricbuzz, a major provider of live, streaming and on-demand cricket, to provide programmatic ad sale...


Israel's Reshet 13 Deploys Deepdub's Ai-Based Deepdub Go Platform

TEL AVIV Deepdub, a provider of AI-based audiovisual dubbing and language localization services, has announced it is working with Reshet 13, one of Israels lead...


FCC Approves Gray Television, Marquee Broadcasting Deal

WASHINGTON, D.C. The FCC has issued a Memorandum and Order approving a deal between Gray Television and Marquee Broadcasting that would transfer station license...


Boris FX Continuum Adds Advanced AI Tools for VFX Artists and Content Creators

Boris FX Continuum Adds Advanced AI Tools for VFX Artists and Content Creators Jessie Electa Petrov June 21, 2024 0 Comments The 2024.5 release adds f...


New versions of Final Cut Pro for iPad and Mac available now

New versions of Final Cut Pro for iPad and Mac available now Brie Clayton June 21, 2024 0 Comments Today, Apple released Final Cut Pro for iPad 2, tra...


Christopher Barry, Cliff Ejikeme Get Expanded Role at A+E Networks

A+E Networks said that two senior finance execs, Christopher Barry and Cliff Ejikeme, have been given expanded roles at the company....


The CW Shares Fall Debut Dates

The CW has shared its fall premiere dates, which includes Inside The NFL back on Friday, August 30, with Ryan Clark hosting. The new season also offers the debu...


Local News Close-Up: Florida's Gulf Coast Has Reasons To Boast

Tampa-St. Petersburg is, by all accounts, a booming market. New arrivals are flocking in and cranes dot the landscape, building places for the newcomers to live...


Our America: In the Black' Back on ABC-Owned Stations' Digital Platforms

Our America: In the Black, a series from ABC Owned Television Stations, returns Thursday, June 20 with the nine-part Conversations With Arlan Hamilton. An entre...


Dominic Brown Joins WBTS Boston Weather Team

Dominic Brown is joining WBTS Boston's First Alert Meteorology team this week. He'll appear in the 4 and 7 p.m. weekday newscasts....


Netflix's Dallas Cowboys Cheerleaders Series Premieres

Netflix debuts America's Sweethearts: Dallas Cowboys Cheerleaders, a docuseries detailing the 2023-2024 cheer squad from beginning to end, June 20. There ar...


Competition to achieve trusted newsroom status as new campus is launched

A new platform dedicated to helping journalists win audience trust and tackle disinformation has been launched and with it a competition offering newsrooms (fro...


Give Me the Backstory: Get to Know Josh Margolin, the Filmmaker Behind Thelma

By Bailey Pennick One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. ...


More Choice for U.S. Subscribers

On Spotify, users discover and enjoy music, podcasts, and audiobooks, with various plans that meet our listeners' needs. We offer subscriptions for every st...


That's a Wrap on Cannes Lions 2024! Inside the Awards, Spotify Beach Action, and More

This week, Spotify returned to the South of France for the 2024 Cannes Lions Int...


NextGen TV Comes to Myrtle Beach-Florence, S.C.

MYRTLE BEACH, S.C. Leading television stations serving the Myrtle Beach-Florence, S.C. market have launched NextGen TV aka ATSC 3.0 broadcasts....


Get 1-Year License of Aiarty Image Enhancer for Free - Upscale Images, Enhance and Add Realistic Details

Get 1-Year License of Aiarty Image Enhancer for Free - Upscale Images, Enhance a...


Bollywood Romantic Comedy Fake Boyfriend Shot with Blackmagic Pocket Cinema Cameras

Bollywood Romantic Comedy Fake Boyfriend Shot with Blackmagic Pocket Cinema Came...


DI4D sees double in new short film

Double uses the companys PURE4D 2.0 solution to faithfully transfer actor Neil Newbon's facial performance onto his digital double By Jenny Priestley Pub...


Lawo: Dunn climbing the corporate ladder

Dunns new role brings additional management responsibilities under German law By Matthew Corrigan Published: June 21, 2024 Dunn's new role brings addi...


Wohler Technologies Names John Earnest Vice President

HAYWARD, Calif. Wohler Technologies has appointed John Earnest vice president of global sales and marketing....


Reuters Selects Sony Cameras for Its Worldwide Video Group

SYDNEY Sony has announced that the global news agency Reuters has selected Alpha and XDCAM cameras, G Master lenses and audio equipment to equip its video journ...


Vislink Names Donnie Gilliam Vice President Of Operations

OLIVE, N.J. Vislink has appointed Donnie Gilliam vice president of operation with responsibility for driving customer satisfaction, cost reduction and working c...


LG And Blacknut Launch Single Game Subscription Services

ENGLEWOOD CLIFFS, N.J. LG Electronics USA and Blacknut Cloud Gaming are bringing additional cloud gaming options to LG Smart TVs in the U.S. with the launch of ...


Lawo Elevates Jamie Dunn To Executive Board, Deputy CEO Role

RASTATT, Germany Lawo has announced that Jamie Dunn is taking on additional responsibility as Vorstand (member of the executive board) and deputy CEO sharing ...


DirecTV Adds Five Lionsgate Channels

LOS ANGELES DirecTV and Lionsgate have inked a new, wide-ranging licensing agreement that will immediately make five Lionsgate channels available to all DirecTV...


Gray Promotes Three Execs to New Leadership Positions

ATLANTA Gray Television, Inc. is promoting three executives to new leadership positions effective July 1, 2024. The three will work to help the company expand i...


Sonnet Announces High-Performance USB-C 20Gbps PCIe Card With Support for 2,000 MB/s Data Transfers

Sonnet Announces High-Performance USB-C 20Gbps PCIe Card With Support for 2,000 ...


Viamedia To Sell Programmatic Ads for Willow by Cricbuzz as Cricket Gains Popularity in the U.S.

Independent advertising rep firm Viamedia said it has made a deal to sell progra...


Team Whistle Integrates Sponsor GNC Into No Days Off' Series

Digital content company Team Whistle has integrated sponsor GNC into a new episode of its series No Days Off....


Emad Asghar Named VP/News Director at WNYW-WWOR New York

Emad Asghar has been named VP and news director at WNYW-WWOR New York. He's been with the station for 16 years, and had been assistant news director....


Hair Metal Gets Close-Up in Paramount Plus Docuseries

Docuseries N thing But a Good Time: The Uncensored Story of 80s Hair Metal will be on Paramount Plus late this year. There will be three parts....


Vertical Horizon: A 9:16 Social Video Content Production Masterclass

Vertical Horizon: A 9:16 Social Video Content Production Masterclass Leaders from HBS, Sky Sport, and Little Dot Sport break down the challenges of vertical vid...


T20 Cricket World Cup: Inside Look at Disney Star's Host Broadcast, Unilateral Productions

T20 Cricket World Cup: Inside Look at Disney Star's Host Broadcast, Unilater...


T20 Cricket World Cup: ICC, With Help of Quidich, Offers Apple Vision Pro Users Immersive Highlights

T20 Cricket World Cup: ICC, With Help of Quidich, Offers Apple Vision Pro Users ...


Asian Cinemas and Qube Cinema to expand footprint of EPIQ Premium Large Format across South India

Asian Cinemas and Qube Cinema to expand footprint of EPIQ Premium Large Format a...


Sweet Home' Season 3 Teaser Sets Stage for Final Battle to Save All

Back to All News Sweet Home' Season 3 Teaser Sets Stage for Final Battle to Save AllPlay Video Play Video Entertainment 21 June 2024 GlobalSouth Korea...


Baselight training. Paris. Les Lapins Bleus

Baselight accredited training partner, Les Lapins Bleus, is conducting more Baselight training in Paris in the months ahead. Click the links below for more inf...


Space Alliance wins 2024 Farnse d'Or award

Facebook Twitter LinkedIn Thales and Leonardo recognized for strengthening ties between Italy and France through space cooperation under Quirinal Treaty ...


Dynamics Processing for MIDI Velocity

By Craig Anderton Sure, you can follow your virtual instrument with an audio compressor. But there's a problem: an instrument's dynamics and expressive...


Industry signs Letter of Intent on MGCS

Facebook Twitter LinkedIn At the Eurosatory 2024 international defence trade fair, the managing directors of KNDS Deutschland, KNDS France, Rheinmetall La...


ASTRA 1P communications satellite successfully launched

Facebook Twitter LinkedIn The most powerful geostationary satellite ever designed to operate from 19.2 East Cape Canaveral, Florida, June 21, 2024 - AST...


June 20, 2024

Neuroscientist Xin Jin granted Pew and McKnight awards Jin is named a 2024 Pew Scholar and receives the McKnight Scholar Award, supporting her research in mappi...


Rosie Jones's Disability Comedy Extravaganza returns for a third series on free-to-air channel U&Dave and free streaming service, U

Free-to-air channel Dave and UKTV Play to be renamed U&Dave and U, following lau...


Get to Know Troy Lewis: 2024's Sally Menke Fellow and Editor of Daughters

I am still processing what it means to be part of the Sally Menke Fellowship and the Sundance Directors Labs, says Troy Lewis from a condo-turned-edit-bay at t...