Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

21/08/2026

Indiana Pacers Selects DAZN As Exclusive Streaming Partner

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Chyron To Showcase Newsroom Advancements At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Broadpeak to Launch Multiview as a Service at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

University of Maryland Deploys Sony FX30 Cameras

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Study: FAST Sports Programming Surges

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Spectrum SportsNet LA Launches in Former Cox Markets

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

ESPN Airs Its Most-Watched WNBA Game

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Wisycom Wireless and DPA Microphones Support Pope Leo XIV...

When hundreds of thousands of people gather to hear a single voice, there is no room for compromise. Every word must be delivered clearly, every wireless transm...

21/08/2026

Telestream and ScorePlay Turn Live Sports into Immediate...

Telestream, a global leader in media workflow technologies, today announced a strategic partnership with ScorePlay, the AI-powered media infrastructure that spo...

21/08/2026

NUGEN Audio Launches New Post and Producer Subscription P...

NUGEN Audio announces the launch of its new Post Plan and Producer Plan, two flexible subscription offerings designed to give audio professionals short term acc...

21/08/2026

Join the Screen Currency 2026 Ask Me Anything (AMA) Online

Join the Screen Currency 2026 Ask Me Anything (AMA) Online 20 August 2026 (L-R): Adrian Coates, Grainne Brunsdon, Deirdre Brennan, Rachael Perkins Got questio...

20/08/2026

NEP's Summer of Soccer Didn't End at World Cup: 1,100+ Domestic Productions Follow the Final

From host-broadcaster and rightsholder support in June and July to MLS, NWSL, US...

20/08/2026

SVG GameDay, Ep. 27: San Jose Sharks' Emily Garner - Production Tales From the Shark Tank

In-venue and creative video staffers at the professional and collegiate level ha...

20/08/2026

IBC 2026: Veritone To Showcase Enterprise AI and Media Supply Chain Automation

At IBC this year, Veritone (14.A56) is bringing two connected themes to the booth: architectural independence in enterprise AI, and the automation of the media ...

20/08/2026

Telestream and ScorePlay Partner to Connect Live Sports Ingest with Media Management

Telestream and ScorePlay have announced a partnership combining Telestream's...

20/08/2026

Grand Slam of Curling and Rock League Sign Multi-Year Deal with ESPN

The Grand Slam of Curling and Rock League have announced a three-year agreement with ESPN, bringing more than 300 hours of live curling coverage to U.S. audienc...

20/08/2026

Nielsen Announces Measurement Enhancements Ahead of Fall TV Season

Nielsen has announced a series of enhancements to its Big Data + Panel currency measurement methodology, taking effect August 31. The updates were developed in ...

20/08/2026

ORF Deploys Net Insight Nimbra Platform for Nationwide IP Contribution Network

Net Insight has been selected by service provider Big Blue Marble (formerly ORS Group) to provide its Nimbra platform as the core media transport solution for a...

20/08/2026

2026 US Open Launches Fan Activations Across New York City

The 2026 US Open will bring a series of free fan activations across New York City ahead of and during the tournament, which runs August 23-September 13. We...

20/08/2026

Bridge Technologies Adds TS Playout to VB330 and VB220 Monitoring Probes

Bridge Technologies will announce a transport stream (TS) playout feature for its VB330 and VB220 compressed monitoring probes at IBC2026 (Booth 1.A71). The fe...

20/08/2026

IBC 2026: ENCO To Showcase AI and Automation Solutions

ENCO will demonstrate solutions across captioning, translation, AI production tools, automation, and virtual production at IBC2026 (Stand 7.A34, Amsterdam RAI, ...

20/08/2026

IBC 2026: MultiDyne MRMC To Exhibit for First Time as Part of MultiDyne Organization

MultiDyne Video and Fiber Optic Systems will demonstrate camera robotics and mot...

20/08/2026

IBC 2026: Chyron Showcases Newsroom Workflow Solutions

Chyron will demonstrate news workflow solutions at IBC2026 (Stand 7.A23), marking the company's 60th anniversary. Highlights include updates to PRIME HTML, ...

20/08/2026

Spectrum SportsNet LA Now Available to Customers in Former Cox Markets

Spectrum SportsNet LA, the exclusive television home of the Los Angeles Dodgers, is now available to Spectrum customers in former Cox markets following the clos...

20/08/2026

IBC 2026: swXtch.io Launches Expanded SRT Distribution and Native Multicast Services

swXtch.io will unveil expanded Global SRT Distribution and native multicast tran...

20/08/2026

Transformation Church Deploys Riedel Artist Intercom System

Riedel Communications has announced that Transformation Church in the United States has deployed a communications system built around the Artist intercom ecosys...

20/08/2026

Apple at 50: Author and CBS Sunday Morning Correspondent David Pogue on How a Tech Giant Became a Media Powerhouse

The bestselling author and longtime Apple observer explores how product launches...

20/08/2026

Orlando Magic's David Storm Reflects on the Franchises First Year With Its New ST 2110 Control Room and Massive Center-Hung Videoboard

The Orlando Magic entered last season with a dramatically upgraded in-venue prod...

20/08/2026

Indiana Pacers Name DAZN Exclusive Streaming Home Beginning 2026-27 Season

Pacers Sports and Entertainment has announced a partnership with DAZN, making it the exclusive streaming home of Indiana Pacers basketball. A team-branded strea...

20/08/2026

Ratings Roundup: Scotty Scheffler Win Tops the Week, ESPN Posts Most-Watched WNBA Game Ever on Cable

Ratings Roundup is a rundown of recent ratings news and is derived from press re...

20/08/2026

NHL Announces Germany Expansion with FC Bayern Partnership and 2027 Global Series Games in Munich and Cologne

The NHL has announced two major developments tied to its Germany growth strategy...

20/08/2026

SoundBridges TURN server tutorial

Set up your own private remote collaboration infrastructure SoundBridge have recently put together a tutorial video that provides users with a step-by-step ...

20/08/2026

Neyrinck revive Avid D-Control surfaces

New V-Control Pro features restore basic functionality Neyrinck's V-Control software has long been keeping older Avid control surfaces compatible with n...

20/08/2026

ROSE AYLING-ELLIS BEGINS FILMING SERIES TWO OF ITVS BAFTA-WINNING THRILLER CODE OF SILENCE

TV, BritBox and Mammoth Screen have announced that filming is now underway on th...

20/08/2026

Nielsen Incorporates New Enhancements To Improve Its Data Measurement Leading Into The New Fall TV Season

New York August 19, 2026 Nielsen today shared a number of key enhancements t...

20/08/2026

FAST Sports Programming Surges at More Than Twice the Rate of Sports Channel Growth

New Gracenote Data Hub analysis finds sports program titles up 31.2% and individ...

20/08/2026

Charter Completes $34.5 Billion Cox Acquisition

Share Copy link Facebook X Linkedin Bluesky Email...

20/08/2026

SubtitleNEXT makes a significant leap in localisation eff...

At IBC, Profuz Digital will showcase at stand 8.A88 the SubtitleNEXT platform delivering innovative AI transcription integrations and stunning new features boos...

20/08/2026

Transformation Church Elevates Production Communications...

Riedel Communications today announced that Transformation Church, one of the fastest-growing and most influential digital ministries in the United States, has d...

20/08/2026

QuickLink Showcases New 4K Capabilities Across StudioEdge and StudioCall at IBC 2026

QuickLink Showcases New 4K Capabilities Across StudioEdge and StudioCall at IBC ...

20/08/2026

The Boys Season Five Graded with DaVinci Resolve Studio

The Boys Season Five Graded with DaVinci Resolve Studio Brie Clayton August 20, 2026 0 Comments Colorist Siggy Ferstl uses Depth Map to bring a three ...

20/08/2026

Adobe Firefly expands its creative AI studio: generate music, speech, and sound effects in one place

Adobe Firefly expands its creative AI studio: generate music, speech, and sound ...

20/08/2026

Broadpeak launches Multiview as a Service to accelerate m...

Multiview available via SaaS for streaming platforms and operators through broadpeak.io, with live demonstrations at IBC2026 Broadpeak , a leader in streaming ...

20/08/2026

Techex Appoints Stuart Almond as Chief Revenue Officer

Techex, a leading provider of live broadcast infrastructure solutions, has appointed Stuart Almond as Chief Revenue Officer, further strengthening its executive...

20/08/2026

MediaCity Studios upgrades with Avid

Avid today announced that MediaCity Studios has upgraded its production infrastructure with an enhanced end-to-end Avid production ecosystem, including the dep...

20/08/2026

MS Now to Launch $7.99 DTC Service

Share Copy link Facebook X Linkedin Bluesky Email...

20/08/2026

Nielsen Details Improvements to Audience Measurement Capabilities

Share Copy link Facebook X Linkedin Bluesky Email...