Sony Pixel Power calrec Sony

New Performance Optimizations Supercharge NVIDIA RTX AI PCs for Gamers, Creators and Developers

21/05/2024

NVIDIA today announced at Microsoft Build new AI performance optimizations and integrations for Windows that help deliver maximum performance on NVIDIA GeForce RTX AI PCs and NVIDIA RTX workstations.

Large language models (LLMs) power some of the most exciting new use cases in generative AI and now run up to 3x faster with ONNX Runtime (ORT) and DirectML using the new NVIDIA R555 Game Ready Driver. ORT and DirectML are high-performance tools used to run AI models locally on Windows PCs.

WebNN, an application programming interface for web developers to deploy AI models, is now accelerated with RTX via DirectML, enabling web apps to incorporate fast, AI-powered capabilities. And PyTorch will support DirectML execution backends, enabling Windows developers to train and infer complex AI models on Windows natively. NVIDIA and Microsoft are collaborating to scale performance on RTX GPUs.

These advancements build on NVIDIA's world-leading AI platform, which accelerates more than 500 applications and games on over 100 million RTX AI PCs and workstations worldwide.

RTX AI PCs - Enhanced AI for Gamers, Creators and Developers NVIDIA introduced the first PC GPUs with dedicated AI acceleration, the GeForce RTX 20 Series with Tensor Cores, along with the first widely adopted AI model to run on Windows, NVIDIA DLSS, in 2018. Its latest GPUs offer up to 1,300 trillion operations per second of dedicated AI performance.

In the coming months, Copilot+ PCs equipped with new power-efficient systems-on-a-chip and RTX GPUs will be released, giving gamers, creators, enthusiasts and developers increased performance to tackle demanding local AI workloads, along with Microsoft's new Copilot+ features.

For gamers on RTX AI PCs, NVIDIA DLSS boosts frame rates by up to 4x, while NVIDIA ACE brings game characters to life with AI-driven dialogue, animation and speech.

For content creators, RTX powers AI-assisted production workflows in apps like Adobe Premiere, Blackmagic Design DaVinci Resolve and Blender to automate tedious tasks and streamline workflows. From 3D denoising and accelerated rendering to text-to-image and video generation, these tools empower artists to bring their visions to life.

For game modders, NVIDIA RTX Remix, built on the NVIDIA Omniverse platform, provides AI-accelerated tools to create RTX remasters of classic PC games. It makes it easier than ever to capture game assets, enhance materials with generative AI tools and incorporate full ray tracing.

For livestreamers, the NVIDIA Broadcast application delivers high-quality AI-powered background subtraction and noise removal, while NVIDIA RTX Video provides AI-powered upscaling and auto-high-dynamic range to enhance streamed video quality.

Enhancing productivity, LLMs powered by RTX GPUs execute AI assistants and copilots faster, and can process multiple requests simultaneously.

And RTX AI PCs allow developers to build and fine-tune AI models directly on their devices using NVIDIA's AI developer tools, which include NVIDIA AI Workbench, NVIDIA cuDNN and CUDA on Windows Subsystem for Linux. Developers also have access to RTX-accelerated AI frameworks and software development kits like NVIDIA TensorRT, NVIDIA Maxine and RTX Video.

The combination of AI capabilities and performance deliver enhanced experiences for gamers, creators and developers.

Faster LLMs and New Capabilities for Web Developers Microsoft recently released the generative AI extension for ORT, a cross-platform library for AI inference. The extension adds support for optimization techniques like quantization for LLMs like Phi-3, Llama 3, Gemma and Mistral. ORT supports different execution providers for inferencing via various software and hardware stacks, including DirectML.

ORT with the DirectML backend offers Windows AI developers a quick path to develop AI capabilities, with stability and production-grade support for the broad Windows PC ecosystem. NVIDIA optimizations for the generative AI extension for ORT, available now in R555 Game Ready, Studio and NVIDIA RTX Enterprise Drivers, help developers get up to 3x faster performance on RTX compared to previous drivers.

Inference performance for three LLMs using ONNX Runtime and the DirectML execution provider with the latest R555 GeForce driver compared to the previous R550 driver. INSEQ=2000 representative of document summarization workloads. All data captured with GeForce RTX 4090 GPU using batch size 1. The generative AI extension support for int4 quantization, plus the NVIDIA optimizations, result in up to 3x faster performance for LLMs. Developers can unlock the full capabilities of RTX hardware with the new R555 driver, bringing better AI experiences to consumers, faster. It includes:

Support for DQ-GEMM metacommand to handle INT4 weight-only quantization for LLMs

New RMSNorm normalization methods for Llama 2, Llama 3, Mistral and Phi-3 models

Group and multi-query attention mechanisms, and sliding window attention to support Mistral

In-place KV updates to improve attention performance

Support for GEMM of non-multiple-of-8 tensors to improve context phase performance

Additionally, NVIDIA has optimized AI workflows within WebNN to deliver the powerful performance of RTX GPUs directly within browsers. The WebNN standard helps web app developers accelerate deep learning models with on-device AI accelerators, like Tensor Cores.

Now available in developer preview, WebNN uses DirectML and ORT Web, a Javascript library for in-browser model execution, to make AI applications more accessible across multiple platforms. With this acceleration, popular models like Stable Diffusion, SD Turbo and Whisper run up to 4x faster on WebNN compared to WebGPU and are now available for developers to use. Microsoft Build attendees can learn more about developing on RTX in the Accelerating development on Windows PCs w
LINK: https://blogs.nvidia.com/blog/rtx-advanced-ai-windows-pc-build/...
See more stories from nvidia

North America Stories

03/12/2025

FCC Sets Deadlines for Comments on Nexstar Acquisition of Tegna

WASHINGTON The Federal Communications Commission has opened a docket for comments on the proposed $6.2 billion Nexstar acquisition for Tegna and set deadlines f...

03/12/2025

Brightcove Unveils New AI Features

MILAN, Italy Brightcove has released seven new features designed to expand global reach, improve audience engagement, enhance live-streaming quality and streaml...

03/12/2025

Great American Media to Launch Pure Flix Familia in 2026

NEW YORK Great American Media said it plans to launch Pure Flix Familia, a dedicated Spanish-language platform, in 2026....

03/12/2025

FanDuel Sports Network Launches on Vizio

SOUTHPORT, Conn. Main Street Sports Group has announced that the FanDuel Sports Network app is now available directly on Vizio and on smart TVs with Vizio OS. T...

03/12/2025

Telia Taps Harmonic for Broadband Upgrade in Norway

SAN JOSE, Calif. Harmonic has announced that Telia, the second-largest telecom operator in Norway, is modernizing its broadband network with the company's c...

03/12/2025

Todd Ziegler to Take Reins of Sinclair's Green Bay, Wis., Stations

GREEN BAY, Wis. Sinclair said Jay Zollar, vice president and general manager of WLUK-WCWF here, will retire Dec. 31 after 26 years running the stations. Station...

02/12/2025

Case Study: How Mid-Atlantic Sports Network Moved to All-IP Distribution in 60 Days

Case Study: How Mid-Atlantic Sports Network Moved to All-IP Distribution in 60 D...

02/12/2025

2025 Sports Broadcasting Hall of Fame: Lee Corso, Coach, Commentator, Firebrand

2025 Sports Broadcasting Hall of Fame: Lee Corso, Coach, Commentator, FirebrandBy Ken Kerschbaumer Tuesday, December 2, 2025 - 7:00 am Print This Story | S...

02/12/2025

SVG All-Stars: Dan Nabors, Senior Director, Remote Engineering, TNT Sports

SVG All-Stars: Dan Nabors, Senior Director, Remote Engineering, TNT SportsThe veteran tech leader is helping guide Warner Bros. Discovery's at-home' re...

02/12/2025

National Lacrosse League Opens Season With New Cloud-Based Official Replay-Review System

National Lacrosse League Opens Season With New Cloud-Based Official Replay-Revie...

02/12/2025

Platinum White Paper: The Cinematic Look in Live Production - Bridging Aesthetics and Real-Time Broadcast Technology with Grass Valley

Platinum White Paper: The Cinematic Look in Live Production - Bridging Aesthetic...

02/12/2025

SVG India Announces Advisory Board; JioStar's Prashant Khanna Named Chairman

SVG India Announces Advisory Board; JioStar's Prashant Khanna Named ChairmanBy Ken Kerschbaumer Tuesday, December 2, 2025 - 11:15 am Print This Story |...

02/12/2025

SVG Summit 2025 Preview: New AI Production Tools Workshop' Features ESPN, Fox Sports, NBC Sports NEXT, PGA Tour, PlayOn, and USGA

SVG Summit 2025 Preview: New AI Production Tools Workshop' Features ESPN, F...

02/12/2025

Release Rundown: What to Watch in December, From Atropia to Endless Cookie

Written and directed by Hailey Gates, Atropia won the U.S. Grand Jury Prize: Dramatic at the 2025 Sundance Film Festival....

02/12/2025

Revolutionizing Defense: L3Harris' Advanced Counter-UAS Cutting-Edge Technologies Offer Scalable Solutions for NATO

The lightweight and highly portable CORVUS-RAVEN, recently demonstrated at the V...

02/12/2025

L3Harris Enhancing Marine Corps' Resilient, Multi-Orbit SATCOM Operations

The lightweight, rugged Panther 2 tri-band VSAT delivers high-speed data communications for Internet, VPN connectivity and video transmission over commercial an...

02/12/2025

Nielsen Global Impact Day 2025: Expanding our global impact

NGID volunteers in the United States NGID volunteers in Mexico NGID volunteers in India NGID volunteers in Spain NGID volunteers in Australia NGID voluntee...

02/12/2025

FCC Issues Reminder on Audio-Description Rule Deadlines

WASHINGTON The Federal Communications Commission's Media Bureau has issued a reminder that stations in DMAs 111 through 120 must implement its audio descrip...

02/12/2025

Sony Unveils Alpha 7 V Full-Frame Mirrorless Camera

SAN DIEGO Sony Electronics today introduced the Alpha 7 V (ILCE-7M5), the fifth generation of its Alpha 7 full-frame mirrorless lineup, powered by the newly dev...

02/12/2025

FCC Sets Comment Deadlines for Nexstar-Tegna Merger

WASHINGTON The Federal Communications Commission has opened a docket for comments on Nexstar Media Group's proposed $6.2 billion acquisition of Tegna and se...

02/12/2025

Veronica Rodriguez, Matt Schnaars and Jeff Warshaw Join NAB Board

WASHINGTON The National Association of Broadcasters has added a trio of media executives, Veronica Rodriguez, Matt Schnaars and Jeff Warshaw, to its board of di...

02/12/2025

Brightcove Unveils New Features

MILAN, Italy Brightcove has released seven new features designed to expand global reach, improve audience engagement, enhance live-streaming quality and streaml...

02/12/2025

BCNEXXT and NPC Media Sign Partnership Agreement for Vipe...

BCNEXXT, the developers of the advanced playout platform Vipe, today announced a new Service Provider Partner agreement with NPC Media, the Australian managed p...

02/12/2025

DPA Microphones N Series Wireless Mic System Now Availabl...

DPA Microphones today announces the immediate availability of its new N-Series Digital Wireless Microphone System for customers throughout the U.S. In addition ...

02/12/2025

Hiltron Reports a Well Attended and Successful Space Tech...

Hiltron Communications reports a well attended and successful Space Tech Expo exhibition, held at the Messe Bremen from Tuesday November 18 through Thursday Nov...

02/12/2025

The HELM powers Riverfire with flawless timecode precisio...

The beginning of September saw Riverfire by Australian Retirement Trust, in association with Channel 9 and Triple M, kick off the 2025 Brisbane Festival in spec...

02/12/2025

SGM Lighting and ACT Entertainment Announce Exclusive US...

SGM Lighting is pleased to announce an exciting new partnership with ACT Entertainment, under which ACT will serve as the exclusive distributor for SGM's ne...

02/12/2025

Harmonic Powers Telias NextGeneration Broadband Upgrade i...

Harmonic (NASDAQ: HLIT) today announced that Telia, the second largest telecom operator in Norway, is modernizing its broadband network with the company's i...

02/12/2025

Keepit and TIM AG enters distribution partnership for the...

European cloud data protection specialist Keepit is expanding its sales network in the DACH region and has gained TIM AG, one of the leading value-added distrib...

02/12/2025

Calrec pushes beyond traditional broadcasting with flexib...

Featured products at ISE 2026 This year s ISE 2026 theme "Push Beyond" reflects Calrec s direction of travel. The company is dedicated to supporting the AV an...

02/12/2025

Czech TV Implements Landmark LiveU OB Project in Central...

Czech Television, the national public broadcaster, has deployed one of the largest LiveU live production projects in the region for live sports and news coverag...

02/12/2025

Leader expands cinematic camera support for Live Producti...

Test & measurement innovator, Leader Electronics, has announced the release of v8.2 software for its ZEN and ZEN-W Series, bringing advanced cinematic camera se...

02/12/2025

Accedo and Magine Pro agree to merge SaaS businesses

Global provider of video streaming software and services, Accedo, and OTT platform provider, Magine Pro, have signed a binding agreement to carve out and merge ...

02/12/2025

Skandha Media Services New VP Sales Role Signals Bold Gro...

With proven success in broadcast, OTT, and content supply chains, K.S Avinash set to scale Skandha's service-first approach across APAC Skandha Media Servi...

02/12/2025

AJA Video Systems Joins RAVENNA Community

AJA Video Systems has joined the RAVENNA community, a network of partners devoted to advancing the RAVENNA standard for distributing real-time audio over intern...

02/12/2025

Report: ATSC 3.0 Would Boost Wireless Efficiency, Sustainability

HUNT VALLEY, Md. Sinclair and its wholly-owned subsidiary One Media Technologies have released a new report focused on how ATSC 3.0, the IP-based NextGen TV sta...

02/12/2025

FCC Issues a Reminder on Audio Description Rule Deadlines

WASHINGTON The Federal Communications Commission's Media Bureau has issued a reminder that stations in DMAs 111 through 120 must implement its audio descrip...

02/12/2025

ATSC Members Elect 4 to Board of Directors

WASHINGTON Members of the Advanced Television Systems Committee have elected four industry veterans to three-year terms on the organization's board of direc...

02/12/2025

Survey: Younger Gen Z Consumers Spend 5.1 Hours a Day on Social Media

A new survey from S&P Global Market Intelligence Kagan highlights how important social media is for younger consumers, with Gen Z spending 5.1 hours a day on so...

02/12/2025

Faculty Notes: Fall/Winter 2025

Faculty Notes: Fall/Winter 2025 Recent accomplishments, releases, and events by Berklee faculty. December 1, 2025 By Editorial Staff The cast of Kind of M...

02/12/2025

NVIDIA Partners With Mistral AI to Accelerate New Family of Open Models

Today, Mistral AI announced the Mistral 3 family of open-source multilingual, multimodal models, optimized across NVIDIA supercomputing and edge platforms. M...

02/12/2025

Ring In The Holidays With Our Biggest Sale Ever On Ivory II Pianos!

Ring In The Holidays With Our Biggest Sale Ever On Ivory II Pianos!From now until December 31st, you can save 50% or more on every Ivory II piano and collection...

02/12/2025

Made in America: How Stranger Things' Electrified the US Economy

Back to All News Made in America: How Stranger Things' Electrified the US Economy Entertainment 02 December 2025 GlobalUnited States Link copied to cl...

02/12/2025

NVIDIA and AWS Expand Full-Stack Partnership, Providing the Secure, High-Performance Compute Platform Vital for Future Innovation

At AWS re:Invent, NVIDIA and Amazon Web Services expanded their strategic collab...

01/12/2025

L3Harris and PentenAmio Formalise Agreement to Advance Key Management and Secure Communications Technology

L3Harris and PentenAmio formalise their teaming agreement at MilCIS 2025, streng...

01/12/2025

Artemis II: A Mission of Veterans, Firsts and Lunar Dreams

Artemis II is NASA's first crewed flight test of the Space Launch System rocket and Orion spacecraft. The crew, from left: Commander Reid Wiseman, Pilot Vic...

01/12/2025

Wooden Camera Releases Accessory Collection for Canon EOS C50

IRVINE, Calif. Wooden Camera has introduced its new Accessory Collection for the Canon EOS C50. The new lineup includes a low-profile, gimbal-ready cage, expand...

01/12/2025

FCC to Vote on LPTV Rules at December Public Meeting

WASHINGTON The Federal Communications Commission has released a tentative agenda for its Dec. 18 Open Commission Meeting that will include a vote on a report an...