Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

15/09/2026

IBC 2026: Pixitmedia by DataCore to Showcase Cloud and Connected Production Workflows

At IBC2026, Pixitmedia by DataCore will showcase its latest capabilities designe...

15/09/2026

IBC 2026: Quantum Introduces Autonomous Data Management, Dramatically Reducing Storage Costs While Increasing Efficiency and Availability

Quantum Corp. today announced the release of Quantum Autonomous Data Management ...

15/09/2026

PGA Tour Taps Mike Mahar as Chief Technology Officer to Drive Digital, Data, AI Strategy

Former Wyndham Hotels & Resorts technology executive will focus on fan engagemen...

15/09/2026

Creator Sports Network and FAN.live Launch 3D NFL Watch Party for Creators

Creator Sports Network (CSN) and FAN.live have announced a partnership giving CSN's network of more than 2,000 vetted creators access to live 3D NFL broadca...

15/09/2026

IBC 2026 In Review: Our Complete Collection of Video Interviews with Industry Thought Leaders

SVG and SVG Europewere all over the IBC 2026 show floor out in Amsterdam, bringi...

15/09/2026

Rise Announces 2026 Awards Shortlist

Rise WIB has announced the shortlist for the Rise Awards 2026, returning to Troxy in London on Tuesday, November 17. The awards recognize outstanding women, adv...

15/09/2026

Major League Table Tennis Announces 2026-27 Media Distribution Lineup

Major League Table Tennis (MLTT) has announced its media distribution lineup for the 2026-27 season, beginning September 11. Every match will stream live on the...

15/09/2026

Willow Sports to Air 700 Hours of Free Asian Games Coverage for U.S. and Canadian Viewers

Willow Sports has announced it will serve as the exclusive U.S. and Canadian hom...

15/09/2026

Gravity Media to Broadcast MXGP of Australia Championship Finale

Gravity Media has announced it will provide outside broadcast production and technical services for the MXGP of Australia, the finale of the 2026 FIM World Moto...

15/09/2026

Scott Coker and Peter Y. Levin Launch Ki MMA Global MMA Promotion

Co-founders Scott Coker and Peter Y. Levin have unveiled Ki MMA, a new global mixed martial arts promotion launching in the first quarter of 2027. The announcem...

15/09/2026

Sony Announces FE 400mm F4.5 GM OSS and FE 600mm F6.3 GM OSS Super-Telephoto Lenses

Sony Electronics has announced two new G Master super-telephoto prime lenses for...

15/09/2026

Former NEP Group Exec Saeed Izadi Opens The Matrix, Next-Gen Remote Production Center in Singapore

GlobeCast provides facility for AI-power automated production core...

15/09/2026

Gravity Media Set to Deliver 2026 FIM World Motorcross Championship

Gravity Media, a leading global provider of production and content, and media services and facilities, is empowering Tourism and Events Northern Territory (NT) ...

15/09/2026

Audient unveil flagship Horizon interfaces

New Thunderbolt audio interfaces aimed at pro studios Audient's latest announcement sees the company introduce three new high-end audio interfaces desig...

15/09/2026

Sennheiser launch the Spectera SKM handheld

Completes core wireless system line-up The latest addition to Sennheiser's Spectera range is now shipping, completing the core elements of the company&#...

15/09/2026

Schwabe Digital reveal HiFAL 2

High-frequency dynamics plug-in upgraded Schwabe Digital have just released a major free update for their acclaimed high-frequency dynamics processing plug-...

15/09/2026

LUNA 3.0 & UAD Spark Studio from Universal Audio

DAW update launched alongside all-in-one subscription bundle The latest version of Universal Audio's DAW software has just arrived, and has been release...

15/09/2026

Rupert Neve Designs introduce three plug-ins

Three popular hardware units go virtual Rupert Neve Designs are entering the software market in style, with not one, but three of their sought-after hardwar...

15/09/2026

Argo M Powers Cloudbass' Next Generation OB Fleet

When longstanding OB specialist Cloudbass made the decision to expand its fleet to accommodate remote production facilities for a leading UK sports broadcaster&...

15/09/2026

Study: 3 in 4 U.S. TV Viewers Use Smartphones While Watching TV

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Agent TiVo Will Help Track Down Your Show

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Nielsen Marketing Cloud Launches Data Enrichment Capabilities

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Six Berklee Alumni Win at 2026 Emmy Awards

Six Berklee Alumni Win at 2026 Emmy Awards The recipients were recognized for their contributions to Widow's Bay, Beef, South Park, and Bad Bunny's Su...

15/09/2026

OWC Announces Acquisition of OpenDrives, Expanding Software-Defined Video and Rich Media Storage Management Capabilities

OWC Announces Acquisition of OpenDrives, Expanding Software-Defined Video and Ri...

15/09/2026

Podcast The Vertical Buzz Shot with Blackmagic Pocket Cinema Camera 6K Pro

Podcast The Vertical Buzz Shot with Blackmagic Pocket Cinema Camera 6K Pro Brie Clayton September 14, 2026 0 Comments Production team builds premium p...

15/09/2026

Grass Valley Launches AVORA at IBC2026

Grass Valley Launches AVORA at IBC2026 Brie Clayton September 14, 2026 0 Comments New standalone solution gives production teams everything they need ...

15/09/2026

Brandon Woody Joins Berklee Student Ensemble for Signature Series Concert

Brandon Woody Joins Berklee Student Ensemble for Signature Series Concert The acclaimed trumpeter, composer, and bandleader will lead a Berklee student ensemb...

15/09/2026

IBC2026 Announces IBC Innovation Award Winners

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

IEEE BTS to Host Broadcast Technology Forum at NAB Headquarters

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Huw Mills Joins Technetix as SVP, Global Operations

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

TiVo Introduces Agent TiVo

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Study: Younger Fans Are Watching More Sports Than Ever

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

NFL Melbourne Game Scores 18.5 Million U.S. Viewers on Netflix

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Applications open for Future Leaders Delegation to BitSummit 2027

Applications open for Future Leaders Delegation to BitSummit 2027 15 September 2026 Applications are open for Screen Australia's annual Future Leaders Dele...

15/09/2026

Red Seat Ventures' Supercast Launches Live Streaming, Bringing Real-Time Video and Community to Subscribers

Red Seat Ventures' Supercast Launches Live Streaming, Bringing Real-Time Vid...

15/09/2026

Arqiva recognised with Armed Forces Covenant Silver Award

Arqiva recognised with Armed Forces Covenant Silver AwardPresented to organisations that demonstrate outstanding support for the Armed Forces community -- Sh...

14/09/2026

ESPNs MNF Gets in Tune With Apple Music, Adds Ludacris to In the Air Tonight Open

Lil Baby's Dead Fresh kicks off ESPN's Week 1 Monday Night Football, ...

14/09/2026

ESPN's Monday Night Football Begins Its Super Bowl Run With Year 2 of Flagship, New Tech, and 4K HDR Distribution

With Super Bowl LXI waiting in Los Angeles, ESPN will use the regular season to ...

14/09/2026

Give Me the Backstory: Get to Know Padraic McKinley, the Director of The Weight

By Bailey Pennick One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. ...

14/09/2026

Sony expand WH headphone line-up

Three new models introduced Sony have just announced the launch of three new pairs of headphones that span their premium, mid-range and entry-level line-ups...

14/09/2026

Audient unveil Horizon interfaces

New flagship Thunderbolt units aimed at pro studios Audient's latest announcement sees the company introduce three new high-end audio interfaces designe...

14/09/2026

Cobalt Digital to Bring New and Enhanced Practical Solutions to Evolving Broadcast Workflows at IBC2026

Cobalt Digital IBC Stand 8.F90 // Journalists: Click to visit Cobalt Highlights...

14/09/2026

TV Tech Unveils Best of Show Winners at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

14/09/2026

TV Skyline Becomes 'World's First Ultrix FR30 Customer

Share Copy link Facebook X Linkedin Bluesky Email...

14/09/2026

Bitmovin AI Scene Analysis Selected by Nine to Enhance it...

Bitmovin, a leading provider of video streaming solutions, has announced that Australia's largest media company, Nine Entertainment (Nine), has deployed Bit...

14/09/2026

Creativepool Annual 2026 Winners Announced

Creativepool Annual 2026 Winners Announced Brie Clayton September 13, 2026 0 Comments The creative industry's Most' awards celebrates another...

14/09/2026

Inside DPA's N-Series at IBC2026: Wireless audio without compromise

At IBC2026, Ren M rch explains how the N-Series combines DPA's renowned microphone technology with a high-performance wireless platform, offering a wide tu...