Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

12/09/2026

Matrox, NVIDIA Integrate ORIGIN, Holoscan For Media

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Ross Video Debuts New Live Production Technology at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

FCC Nominee Thumann Severs to Testify in Senate Sept. 17

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

TV Skyline Becomes The World's First Ultrix FR30 Customer

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Ikegami Introduces VN Versions of Four UNICAM XE Cameras At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Riedel Technology Powers Record Breaking Esports World Cu...

WUPPERTAL, Germany Sept. 11, 2026 From July 6 to Aug. 23, 2026, Paris hosted the Esports World Cup (EWC), a seven-week live production spanning eight stages...

12/09/2026

Mediacom Deploys Riedel Easy5G for Wireless Camera Covera...

Riedel Communications today announced that Mediacom has purchased and deployed Easy5G , Riedel's Private 5G solution, for live broadcast coverage of La Vuel...

12/09/2026

A Decade of Innovation AMP VISUAL TV Builds on Ten Years...

AMP VISUAL TV is continuing the evolution of its production infrastructure with further investments in Riedel technology across its OB fleet and fixed productio...

12/09/2026

Touring Video Expands Flexible Production Workflows With...

Riedel Communications today announced that Touring Video, a premier entertainment mobile production service company, continues to expand its production workflow...

12/09/2026

Atomos Expands Accessory Ecosystem with New SHAPE and Sma...

Atomos (7.B19) today announced new third-party accessories for Sumo PRO-19 and Shinobi 7 II, developed by SHAPE and SmallRig to give production teams more ways ...

12/09/2026

Deity Microphones Brings PR 2ii, TC-2, and D4RX to IBC2026

Deity Microphones Brings PR 2ii, TC-2, and D4RX to IBC2026 Brie Clayton September 11, 2026 0 Comments The Deity PR-2ii arrives with production firmwar...

12/09/2026

Blackmagic Design Announces Special Pricing for Ultra HD Products

Blackmagic Design Announces Special Pricing for Ultra HD Products Brie Clayton September 11, 2026 0 Comments Now customers can afford to upgrade to Ul...

12/09/2026

Grass Valley EDIUS Future Assurance Program launched at IBC2026

Grass Valley EDIUS Future Assurance Program launched at IBC2026 Brie Clayton September 11, 2026 0 Comments New program gives EDIUS customers access to...

12/09/2026

Berklee Students Develop New Ideas for Live Entertainment and Travel in London

Berklee Students Develop New Ideas for Live Entertainment and Travel in London This summer, a group of music business students collaborated with Heathrow, Bri...

11/09/2026

IBC 2026: Calrec Launches Type RT Console and Apex M6 Modular I/O Platform

Calrec will introduce two new products at IBC2026 (Stand 8.C47, RAI Amsterdam, September 11-14): the Type RT broadcast production console and the Apex M6 Modula...

11/09/2026

IBC 2026: Grass Valley Launches AVORA All-in-One Live Production Platform

Grass Valley has announced AVORA, a standalone all-in-one live production solution launching at IBC2026 (Booth 9.A01 and IBC Future Tech Zone, Stand 14.C49, Sep...

11/09/2026

IBC 2026: CAMB.AI Launches Streaming SDK and Dashboard for Multilingual Live Broadcasting

CAMB.AI is introducing its Streaming SDK and Streaming Dashboard at IBC2026, wit...

11/09/2026

IBC 2026: EVS Launches XT-S Software-Defined Multi-Application Server

EVS has announced XT-S, a software-defined server platform that runs multiple live production applications on a common hardware foundation. The platform debuts ...

11/09/2026

IBC 2026: EKT Showcases Linux-Based ATSC 3.0 Converter Box

EKT is demonstrating a new Linux-based ATSC 3.0 set-top box at IBC2026. The second-generation product moves away from Android to reduce memory costs, with Linux...

11/09/2026

IBC 2026: Sennheiser Group to Showcase Wireless, Monitoring, and Broadcast Workflow

The Sennheiser Group will exhibit at IBC2026 (Hall 8, Booth D50, September 11-14...

11/09/2026

Ludacris Joins Chris Stapleton and Cindy Blackman Santana for Monday Night Footballs In the Air Tonight Open

ESPN's Monday Night Football will open its 2026-27 season with a new renditi...

11/09/2026

Dalet Integrates NVIDIA Synthetic Content Detection into Dalet Flex

Dalet has announced an integration of NVIDIA's Synthetic Video Detector AI model into Dalet Flex, enabling media organizations to identify potentially AI-ge...

11/09/2026

IBC 2026: MC-IF Demonstrates VVC Capabilities

The Media Coding Industry Forum (MC-IF) will demonstrate Versatile Video Coding (VVC) capabilities at IBC2026 (Hall 2, Stand 2.B13), as the codec moves toward c...

11/09/2026

IBC 2026: Sony to Demonstrate Live, News, Cinema, and Immersive Production

Sony will exhibit at IBC2026 (Hall 13, September 11-14), demonstrating products across live production, news, cinema, and immersive and spatial content workflow...

11/09/2026

Wave Central Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

Wave Central, a Domo Broadcast Company, has been named a recipient of a 2026 Tec...

11/09/2026

IBC 2026: SNS Validates EVO Compatibility With Avid Media Composer 2026.8, Adds Browser-Based Upload to Outpost

Studio Network Solutions (SNS) is bringing a pair of workflow updates to IBC2026...

11/09/2026

IBC 2026: iodyne to Demo Pro Mini Smart Drive Across Four Partner Booths

iodyne will co-exhibit with Hedge at IBC2026 (Booth 7.A36, September 11-14) and appear across three additional partner booths, marking the first public demonstr...

11/09/2026

SVG GameDay, Ep. 30: Freelance Graphics Operator Corinne Yamada - Philly-Based Graphics Creation

In-venue and creative video staffers at the professional and collegiate level ha...

11/09/2026

CBS Sports Goes HDR Across Its Entire NFL Package, Heads to Rio in Week 3

The network will phase in HDR crew by crew while expanding Next Gen Stats integration, SkyDry availability, and onsite studio shows...

11/09/2026

IBC 2026: CAMB.AI Unveils the World's First Multilingual Broadcasting Agent Powered by NVIDIA

CAMB.AI is introducing its new Streaming SDK and Streaming Dashboard at IBC2026,...

11/09/2026

Netflix Goes Down Under With NBC Sports, NEP for NFL From Melbourne

Massive host operation at Melbourne Cricket Ground featured 54 cameras, 25,000 ST 2110 flows, REMI studio production in Stamford, and global distribution to mor...

11/09/2026

FOX Sports Homogenizes Coverage With Upscaled Game Tech, Seamless Integration With Studio Shows in L.A.

Production Anywhere Remote Kit (PARK) & AR-fueled Stage B are two key pieces to ...

11/09/2026

Get to Know This Fall and Winter's Filmmakers Through These 36 Sundance Institute-Supported Films

By Ramona Flume and Lucy Spicer There's a particular kind of magic that hap...

11/09/2026

Film Festival Watch: 8 Sundance Institute-Supported Films to See at the 2026 Toronto International Film Festival

By Jessica Herndon The fall film season is kicking off, and Sundance Institute-...

11/09/2026

Positive Grid announce the Spark Pedal

Spark series gains compact modelling stompbox Positive Grid's Spark amps have become a popular part of the company's line-up, offering a convenient ...

11/09/2026

Rapid Flow release omniGRID

New flagship sequencing plug-in revealed Rapid Flow have just launched a new 16-track sequencer plug-in which they say has been designed for total rhythmic...

11/09/2026

Rohde & Schwarz unveils the air-cooled R&STM1 medium-power UHF transmitter at IBC 2026

Rohde & Schwarz unveils the air-cooled R&S TM1 medium-power UHF transmitter at I...

11/09/2026

TV Usage Kicks Usual Summer Slowdown, Fueled by World Cup and Streaming in Nielsen's July Gauge Reports

FIFA World Cup 2026 and Peacock's Love Island USA' Power NBCU-Versant ...

11/09/2026

Atomos Debuts New HDR Monitors at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Lightware Launches LARA 2 with New Architecture for More...

Lightware has announced the launch of LARA (Lightware Advanced Room Automation) 2.0, a major upgrade to its built-in room automation platform, introducing impro...

11/09/2026

MusiMap launches latest technology unlocking new commerci...

10 September 2026 - MusiMap, the B2B music intelligence company that is transforming how companies can harness the emotional power of music to reach consumers a...

11/09/2026

Matrox Video Integrates Matrox ORIGIN with NVIDIA Holosca...

Matrox Video today announced an integration between Matrox ORIGIN and NVIDIA Holoscan for Media, enabling Matrox ORIGIN media services to be provisioned, config...

11/09/2026

Net Insight brings cloud-native live media orchestration...

Net Insight today announced that its cloud-native live media orchestration is now available through Oracle Cloud Marketplace, providing broadcasters, production...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Biggest functionality boost yet makes Buttons the perfect...

Version 1.8 will bring advanced routing control, new workflow tools, boosted control panel flexibility and ease of integration into IP networks...

11/09/2026

Ikegami Announces Four New UNICAM XE Series Cameras

Ikegami announces four additions its UNICAM XE range of 4K-UHD cameras with the introduction of the UHK-X700VN, UHK-X750VN, UHK-X600VN and UHK-X650VN. Developed...