![](//www.4rfv.com/4rfv_news_images/nvidia_scripts/QRKOIODDREBU_0.jpg)
NVIDIA today announced at Microsoft Build new AI performance optimizations and integrations for Windows that help deliver maximum performance on NVIDIA GeForce RTX AI PCs and NVIDIA RTX workstations.
Large language models (LLMs) power some of the most exciting new use cases in generative AI and now run up to 3x faster with ONNX Runtime (ORT) and DirectML using the new NVIDIA R555 Game Ready Driver. ORT and DirectML are high-performance tools used to run AI models locally on Windows PCs.
WebNN, an application programming interface for web developers to deploy AI models, is now accelerated with RTX via DirectML, enabling web apps to incorporate fast, AI-powered capabilities. And PyTorch will support DirectML execution backends, enabling Windows developers to train and infer complex AI models on Windows natively. NVIDIA and Microsoft are collaborating to scale performance on RTX GPUs.
These advancements build on NVIDIA's world-leading AI platform, which accelerates more than 500 applications and games on over 100 million RTX AI PCs and workstations worldwide.
RTX AI PCs - Enhanced AI for Gamers, Creators and Developers NVIDIA introduced the first PC GPUs with dedicated AI acceleration, the GeForce RTX 20 Series with Tensor Cores, along with the first widely adopted AI model to run on Windows, NVIDIA DLSS, in 2018. Its latest GPUs offer up to 1,300 trillion operations per second of dedicated AI performance.
In the coming months, Copilot+ PCs equipped with new power-efficient systems-on-a-chip and RTX GPUs will be released, giving gamers, creators, enthusiasts and developers increased performance to tackle demanding local AI workloads, along with Microsoft's new Copilot+ features.
For gamers on RTX AI PCs, NVIDIA DLSS boosts frame rates by up to 4x, while NVIDIA ACE brings game characters to life with AI-driven dialogue, animation and speech.
For content creators, RTX powers AI-assisted production workflows in apps like Adobe Premiere, Blackmagic Design DaVinci Resolve and Blender to automate tedious tasks and streamline workflows. From 3D denoising and accelerated rendering to text-to-image and video generation, these tools empower artists to bring their visions to life.
For game modders, NVIDIA RTX Remix, built on the NVIDIA Omniverse platform, provides AI-accelerated tools to create RTX remasters of classic PC games. It makes it easier than ever to capture game assets, enhance materials with generative AI tools and incorporate full ray tracing.
For livestreamers, the NVIDIA Broadcast application delivers high-quality AI-powered background subtraction and noise removal, while NVIDIA RTX Video provides AI-powered upscaling and auto-high-dynamic range to enhance streamed video quality.
Enhancing productivity, LLMs powered by RTX GPUs execute AI assistants and copilots faster, and can process multiple requests simultaneously.
And RTX AI PCs allow developers to build and fine-tune AI models directly on their devices using NVIDIA's AI developer tools, which include NVIDIA AI Workbench, NVIDIA cuDNN and CUDA on Windows Subsystem for Linux. Developers also have access to RTX-accelerated AI frameworks and software development kits like NVIDIA TensorRT, NVIDIA Maxine and RTX Video.
The combination of AI capabilities and performance deliver enhanced experiences for gamers, creators and developers.
Faster LLMs and New Capabilities for Web Developers Microsoft recently released the generative AI extension for ORT, a cross-platform library for AI inference. The extension adds support for optimization techniques like quantization for LLMs like Phi-3, Llama 3, Gemma and Mistral. ORT supports different execution providers for inferencing via various software and hardware stacks, including DirectML.
ORT with the DirectML backend offers Windows AI developers a quick path to develop AI capabilities, with stability and production-grade support for the broad Windows PC ecosystem. NVIDIA optimizations for the generative AI extension for ORT, available now in R555 Game Ready, Studio and NVIDIA RTX Enterprise Drivers, help developers get up to 3x faster performance on RTX compared to previous drivers.
Inference performance for three LLMs using ONNX Runtime and the DirectML execution provider with the latest R555 GeForce driver compared to the previous R550 driver. INSEQ=2000 representative of document summarization workloads. All data captured with GeForce RTX 4090 GPU using batch size 1. The generative AI extension support for int4 quantization, plus the NVIDIA optimizations, result in up to 3x faster performance for LLMs. Developers can unlock the full capabilities of RTX hardware with the new R555 driver, bringing better AI experiences to consumers, faster. It includes:
Support for DQ-GEMM metacommand to handle INT4 weight-only quantization for LLMs
New RMSNorm normalization methods for Llama 2, Llama 3, Mistral and Phi-3 models
Group and multi-query attention mechanisms, and sliding window attention to support Mistral
In-place KV updates to improve attention performance
Support for GEMM of non-multiple-of-8 tensors to improve context phase performance
Additionally, NVIDIA has optimized AI workflows within WebNN to deliver the powerful performance of RTX GPUs directly within browsers. The WebNN standard helps web app developers accelerate deep learning models with on-device AI accelerators, like Tensor Cores.
Now available in developer preview, WebNN uses DirectML and ORT Web, a Javascript library for in-browser model execution, to make AI applications more accessible across multiple platforms. With this acceleration, popular models like Stable Diffusion, SD Turbo and Whisper run up to 4x faster on WebNN compared to WebGPU and are now available for developers to use. Microsoft Build attendees can learn more about developing on RTX in the Accelerating development on Windows PCs w
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
27/07/2024
CLEVELAND Telos Alliance has introduced StudioCore and StudioEdge both members of the company's Axia lineup of AoIP studio consoles and accessories....
27/07/2024
NEW YORK The saga for rights to NBA games continues, with Warner Bros. Discovery filing a lawsuit in state court in New York against the NBA. The lawsuit claims...
27/07/2024
NEW YORK While YouTube recently reported slower than expected growth in its ad revenue for Q2 2024, a new survey indicates that many advertisers still have a re...
27/07/2024
QuickLink StudioPro 4K Video Production Platform to Make its IBC 2024 Debut
Brie Clayton July 26, 2024
0 Comments
QuickLink, the leading global provid...
27/07/2024
Amazon Prime Video said that global viewership for its superheroes gone bad series The Boys grew by 20% from Season 3....
27/07/2024
Dermot Mulroney has been cast as Chief Dom Pascal in the upcoming season of Chicago Fire on NBC. Season 13 begins September 25....
27/07/2024
The Hispanic TV Summit, which happens September 11 in New York and is presented by Next TV, Broadcasting+Cable and Multichannel News, will give out awards to th...
27/07/2024
Media companies like to warn marketers about the perils of cutting their ad spending, and they may have a cautionary tale in Pepsi, which slid into third place ...
26/07/2024
by Ianeta Le'i
I honestly don't remember the first time I met Bryson Ch...
26/07/2024
(L-R) Louise (Karen Gillan) and Antonina (Margaret Sophie Stein) strike up an un...
26/07/2024
Last month, Spotify's annual Songs of Summer predictions made their return, ...
26/07/2024
Summer is peak season for some of our favorite sports and events. Whether you're rooting for the home team at the ballpark or cheering for your country as i...
26/07/2024
Nine talented young professionals completed their vocational training at SGL Carbon in Meitingen from the beginning of June to mid-July, achieving an overall gr...
26/07/2024
Orders1 of $5.2 billion; book-to-bill of 1.0x
Revenue of $5.3 billion, up 13%
...
26/07/2024
(Editor's note: TVTech reached out to several station groups to determine the impact of the CrowdStrike outage on operations. Many, including NextStar Media...
26/07/2024
NEWPORT BEACH, Calif. Bitcentral has integrated Pixalate's ad fraud protection, privacy and compliance analytics solution Post-Bid Analytics and Reporting i...
26/07/2024
Aldous Huxley's classic novel Brave New World is a science fiction thriller set in a murky future with a highly ordered society. While Huxley and other sc...
26/07/2024
Hollyland Adds Pyro 7 All-in-one Video Monitor, TX and RX to Pyro Series
Brie Clayton July 26, 2024
0 Comments
Seven-inch 2.4/5GHz wireless monitor wi...
26/07/2024
Geddy Lee Asks Are Bass Players Human Too? Graded Using DaVinci Resolve Studio
Brie Clayton July 26, 2024
0 Comments
Blackmagic today announced that t...
26/07/2024
Another reminder of the popularity of ad-supported connected TV comes in a survey by Premion and Advertiser Perceptions which found that 61% of the marketers th...
26/07/2024
Nielsen's Gracenote unit said it is selling its metadata about the content of television shows and movies for use in targeting connected-TV advertising camp...
26/07/2024
CBS premieres 13 Days in Ferguson, a special about the aftermath of a police shooting of a young Black man in 2014, on Friday, August 9. The special features Ce...
26/07/2024
Disney and Warner Bros. Discovery announced the launch of their long-awaited premium streaming bundle for the United States. For $16.99 per month, subscribers w...
26/07/2024
It provides multi-voltage output (14.4V, 28V, and 48V) through two XLR4 outputs and one XLR3, offering power to cameras, monitors, and lighting equipment
By Je...
26/07/2024
The lawsuit submitted by investor Scott Baker claims the deal would cost Paramount shareholders $1.65 billion
By Jenny Priestley
Published: July 26, 2024
...
26/07/2024
Florida-based Video Village Miami provides on-set video assist for local commercials and music videos. Frank Collins established the outfit in 2019 after a 20-y...
26/07/2024
QuickLink, the leading global provider of multi-camera video productions and remote contribution solutions, will present QuickLink StudioPro at IBC 2024 (Stand ...
26/07/2024
Relo Metrics (formerly GumGum Sports), the leading AI-powered sponsorship analytics platform for real-time data decisions, today launched an industry-leading in...
26/07/2024
Anton/Bauer, a leading provider of mobile power systems for the film and television industry, has announced the launch of the VCLX LI 1600. The latest evolution...
26/07/2024
Bitcentral, the leading provider of professional media solutions for broadcast and digital video, today announces that it has integrated Pixalate, the ad fraud ...
26/07/2024
Cobalt Iron Inc., a leading provider of SaaS-based enterprise data protection, today announced that Secure Automated Backup with Compass , a cloud backup-as-a-s...
26/07/2024
VisualOn IBC2024 Exhibitor Preview
Sept. 13-16
Amsterdam
Stand 5.A52
As video streaming consumption surges, service providers face significant challenges wi...
26/07/2024
Quanteec
IBC2024 Exhibitor Preview
Sept. 13-16
RAI Amsterdam
Stand 1.A05
Quanteec, a global provider of video delivery technology for broadcasters, will s...
26/07/2024
Witbe
IBC2024 Exhibitor Preview
Sept. 13-16
Amsterdam
Stand 5.F84
At IBC2024, Witbe will showcase the power of its automated testing and proactive monitori...
26/07/2024
WASHINGTON, D.C. The Federal Communications Commission has announced the launch of its new Mobile Speed Test app. The new app features an enhanced user interfac...
26/07/2024
LONDON In a notable landmark for the use of cloud-based services at the Olympics, Alibaba Cloud and Olympic Broadcasting Services (OBS), has today announced the...
26/07/2024
NEW YORK As part of a $2.5 billion media rights deal with the NBA announced on July 24, NBCUniversal and the NBA have also announced an 11-year agreement for ri...
26/07/2024
BEAVERTON, Ore. Versatile Video Coding (VVC) promises to play a pivotal role in driving advancements in video compression technology, with organizations across ...
26/07/2024
COLUMBUS, Ohio The political news channel PurpleTV has expanded it reach with news that it has launched on Channel 25.1 in Columbus, Ohio on TV Station WXOH, wh...
26/07/2024
NEW YORK As part of a push into the contextual advertising business, Nielsen's Gracenote has announced that it is developing new contextual categories to gi...
26/07/2024
Puget Systems Returns to SIGGRAPH 2024 to Demonstrate its On-Premises Generative...
26/07/2024
Dreamtek Delivers Innovative A/V, Live Production and Post Workflows with Blackm...
26/07/2024
Dejero to bring even smarter' mobile internet connectivity solutions to IBC...
26/07/2024
The 2024 Paris Olympic Games are about to begin, and Capitol Broadcasting is rea...
26/07/2024
Berklee Alumni Nominated for 2024 Emmy Awards Twenty-one Berklee alumni received Emmy nominations this year for music composition, sound mixing, and sound editi...
26/07/2024
Jennifer Lyons, president and general manager of WBBM Chicago, is moving into a ...
26/07/2024
Kennan Oliphant has been named VP of news and station manager at WWJ Detroit. He will report to Jennifer Lyons, who has added a regional GM role that gives her ...
26/07/2024
Charlie Hustle & The Matter of Pete Rose, a four-part docuseries, debuts on HBO and Max July 24. The series details the life of the baseball superstar, includin...
26/07/2024
By Craig Anderton
It's been a while since we've had a post for sound design fans. So, let's create some crazy FX for sci-fi/suspense/horror movies,...