Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/11/2026

Canon Brings PTZ and Multicamera Setup, Control and Management into a Single Platform

Share Copy link Facebook X Linkedin Bluesky Email...

04/11/2026

Gov. Newsom Proposes Expanding Film and TV Tax Credit to $1B

Share Copy link Facebook X Linkedin Bluesky Email...

04/11/2026

Netflix Deploys Beta AI Discover' Feature

Share Copy link Facebook X Linkedin Bluesky Email...

04/11/2026

MaxxKonnect Group Acquires FCCInfo.com from Cavell, Mertz & Associates

Share Copy link Facebook X Linkedin Bluesky Email...

04/11/2026

RTE mixes 2026 World Football Championship commentary wit...

RT combined Calrec's Type R system with its SMPTE ST 2110 network to rethink how it mixed commentary for the 2026 World Football Championship. Where six co...

04/11/2026

NAB Show New York 2026 Innovation

NAB Show New York 2026 Innovation David Kirk November 3, 2026 0 Comments Now in its 11th year, NAB Show New York was established as an East Coast vari...

04/11/2026

Cheddar Turns to Playbox Neo for Playout

Share Copy link Facebook X Linkedin Bluesky Email...

04/11/2026

Rethink: SRT Is De Facto' Standard Among Open Internet Transport Protocols

Share Copy link Facebook X Linkedin Bluesky Email...

04/11/2026

Bob Daniel Joins ASG as Storage and Workflow Solutions Ar...

Advanced Systems Group (ASG) has appointed Bob Daniel as Storage and Workflow Solutions Architect within the Enterprise Storage team. Daniel has over 30 years o...

03/11/2026

Grass Valley Wins Tender to Support France Tlvisions' Move to IP Production for Franceinfo

Grass Valley has announced that France T l visions has completed the first phase...

03/11/2026

WELT TV and SES Extend Satellite Distribution Agreement in Germany

SES and WELT TV have renewed their partnership under a new multi-year agreement for satellite distribution in Germany. The agreement runs into the next decade a...

03/11/2026

Eutelsat OneWeb to Provide LEO Connectivity for SES's Multi-Orbit Finnair Service

Eutelsat's OneWeb low Earth orbit (LEO) network will provide connectivity as...

03/11/2026

CONMEBOL Renews GRUP MEDIAPRO Partnership Through 2030

CONMEBOL has renewed its agreement with GRUP MEDIAPRO, which will continue to run the CONMEBOL Hub's end-to-end operation through 2030. The Hub handles prod...

03/11/2026

Aggreko Returns as Official Temporary Power Partner for 2026 Las Vegas Grand Prix

Aggreko has returned as Official Temporary Power Partner for the FORMULA 1 HEINE...

03/11/2026

Gravity Media Debuts IP-Based Nova 110 OB Truck in Belgium

Gravity Media has deployed its fully IP-based OB truck, Nova 110, in Belgium for the first time. It made its operational debut supporting a UEFA Europa League m...

03/11/2026

NFL and TMRW Sports Unveil Premier Flag, Professional Flag Football League Launching Summer 2027

The NFL and TMRW Sports have unveiled Premier Flag, the brand identity for a new...

03/11/2026

Stephen Arnold Music Creates Atlanta Hip-Hop-Influenced Sonic Branding for Gray Media's Hawks Broadcasts

Stephen Arnold Music has developed the original musical theme and sonic branding...

03/11/2026

Monumental Sports Network Rolls Out Monumental+ App Enhancements

Monumental Sports Network (MNMT), the local media rights holder for the NHL's Washington Capitals, NBA's Washington Wizards and WNBA's Washington My...

03/11/2026

Gravity Media SMARThead Robotic Cameras Make U.S. Debut at NYC Marathon via CP Communications

has brought its specialist SMARThead robotic camera technology to the United Sta...

03/11/2026

FOX LATAM Builds Mexico City Facility Into Roaring Production Hub for Latin America and FOX Deportes

In under two years, a seven-person startup has grown to more than 270 staffers, ...

03/11/2026

Youth Olympics in Dakar Make History, and Samsung Is There To Capture It

Olympics history is currently being made in Dakar. During the next two weeks, the Youth Olympic Games, which began on Oct. 31 and conclude on Nov. 13, are the f...

03/11/2026

Sinclair Broadcast Groups Paul Spinelli on the Impact of Upcoming C-Band Repack

There are many challenges in the sports-video-production industry that keep personnel up at night, and one that's currently on the minds of individuals in b...

03/11/2026

SVG Sit-Down: Telstras Amanda Leighton on Dynamic Connect and the Future of Managed Services

Telstra Broadcast Services may call Australia home but this year it continued to...

03/11/2026

Myburgh launch the M28

Employs German-made CK12 capsule Myburgh have announced that their long-awaited M28 microphone is now shipping. Said to be the ideal choice for engineers in...

03/11/2026

iZotope introduce Photon

New AI-powered denoise & stem separation tool announced iZotope have just released a new GPU-powered tool that pairs stem separation with a powerful selecti...

03/11/2026

Rohde & Schwarz to demonstrate technologies supporting Europe's sovereignty and security at Space Tech Expo Europe

Rohde & Schwarz to demonstrate technologies supporting Europe's sovereignty ...

03/11/2026

Nielsen launches CMI Journey in New Zealand, revealing what drives consumer decisions and the media that influence them

New path-to-purchase research solution connects 30 consumer categories and more ...

03/11/2026

Malaysia's festive advertising trends reveal opportunities for smarter media planning, latest Nielsen data shows

Latest Nielsen data reveals a surge in advertising investment during key festive...

03/11/2026

aconnic launches iSphir OT security family, focusing on secure field connectivity and industrial resilience

aconnic AG (ISIN: DE000A0LBKW6), Munich, announces the launch of the iSphir OT s...

03/11/2026

Utopai Studios Taps Former Disney AI Exec Hans Ku as New Chief Product Officer

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

CBS Stations Bring AR/VR Coverage to Midterms

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

AWARN: Request to Shut Off ATSC 3.0 Protection Is Inappropriate'

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

Sinclair Taps Jennifer Lopez to Lead Boise, Idaho, Stations

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

Jaime Eskridge Named GM of Gray's WLFI in Lafayette, Ind.

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

LPTV Advocates Continue to Push for Voluntary 1.0 Shutdown

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

Gravity Media SMARThead Makes Its NYC Marathon Debut

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

PlayBox Neo Puts Playout for News Outlet Cheddar in the C...

PlayBox Neo has taken 24/7 playout for the news outlet Cheddar to the cloud. Powered by PlayBox Neo's own CDN and the full PlayBox Neo Suite media platform,...

03/11/2026

Blendkit for Unreal

Blendkit for Unreal Brie Clayton November 3, 2026 0 Comments Blendkit expands ecosystem with new Unreal Engine integration alongside 8th anniversary l...

03/11/2026

Blackmagic Design Announces New UltraStudio Express HD

Blackmagic Design Announces New UltraStudio Express HD Brie Clayton November 3, 2026 0 Comments New capture and playback solution with 3G-SDI, HDMI an...

03/11/2026

Berklee Artists Return for Performances at Bostons Snowport Holiday Market

Berklee Artists Return for Performances at Bostons Snowport Holiday Market Presented through a partnership between Snowport, Mohegan Sun, and Berklee, the wee...

03/11/2026

Grass Valley wins Public Tender to Support France Televis...

Grass Valley announced that France T l visions has completed the first phase of its Genesys production infrastructure renewal program for Franceinfo, moving the...

03/11/2026

Sony Opens New Creative Possibilities with XYN Spatial Capture Solution Updates

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

Disney AI Exec Hans Ku Joins Utopai Studios as Chief Product Officer

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

Matthew Wallis Joins TBD Post as Head of Post and Operations

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

Broadcasters Tap New Tech to Power Midterm Election Night Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

CBS Stations Brings AR/VR Coverage to Midterms

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

Nugen Audio Unveils VisLM 3 Loudness Metering

Share Copy link Facebook X Linkedin Bluesky Email...

03/11/2026

SmallHD Launches Focus 504 Monitor with PageOS

SmallHD announced the launch of the new Focus 504 Monitor, featuring a low-profile form factor, die-cast aluminum construction, professional-grade I/O, and the ...

03/11/2026

Ryan Webb ICLS Lighting Dexter Resurrection with Astera

Gaffer Webb helped light the pivotal Kill Room scene with Astera QuikSpot...