Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

20/10/2026

ESPN Is Bringing Its Funday Football' Animated Alternate Broadcast Series to Super Bowl LXI, and This Time It's Star Wars' Themed

Sony's Beyond Sports technology will power real-time animation of the game, ...

20/10/2026

NBA App Adds Game Pulse, Ai-Based Chat Feature to Keep Fans Tuned In

The NBA is putting on a full-court press when it comes to digital offerings this year, and that includes some great new features on the NBA App as well as a new...

20/10/2026

Op-Ed: AI Is Making It Cheaper To Build. Sports Needs To Make It Cheaper To Learn

Testing what works is an important part of developing successful fan engagement....

20/10/2026

CBS Sports Amplifies Coverage of U.S. Open Cup Final With Fan Cam in Supporters Section, Onsite Studio Programming

One fan in The Nordecke will wear the device via headset on Wednesday night Spo...

20/10/2026

NBA on NBC Production Team Ready To Build on Year 1 Success, Expands Use of Graphics for Analysis on Tap

Regular-season game coverage will continue to be a mix of REMI and onsite produc...

20/10/2026

Grass Valley Adds Bridge Technologies to Media eXchange Layer Initiative

Grass Valley has added Bridge Technologies to the company's Media eXchange Layer (MXL) initiative, demonstrating how this has supported the containerization...

20/10/2026

Gravity Media Drives Lifted Entertainment's Im A Celebrity... The Wild Frontier, Through Rapid-Deployment IP Production

Gravity Media has rapidly deployed complete IP-based broadcast infrastructure fo...

20/10/2026

Ateme, Viamedia Provide Access to Programmatic TV Advertising to Independent and Regional Operators

Ateme has announced a strategic partnership with Viamedia, the ad tech company b...

20/10/2026

AES Show 2026: Industry Panel Examines Live Entertainment Delivery in Dolby Atmos

As concerts and other live performances reach audiences through global streaming...

20/10/2026

Media Links Powers Live Broadcast Contribution at the All-Asia Games 2026

Media Links' Xscend platform and MDP3020 IP media gateways supported live broadcast contribution for the All-Asia Games, that recently took place in Japan. ...

20/10/2026

Op-Ed: One Sprint Season, Two Season Launches. How MLS Creative Teams Can Prepare for 2027

For Major League Soccer creative teams, 2027 is going to be unlike any year they...

20/10/2026

NHL Constructs Massive Manitoba Cabin Setting for 2026 NHL Heritage Classic on Oct. 25

The National Hockey League (NHL) has given a first look at its planned transform...

20/10/2026

FloSports, National Lacrosse League Begin Exclusive Multiyear Global Streaming Partnership

FloSports and the National Lacrosse League (NLL) have entered into a multiyear m...

20/10/2026

AMWA Takes Home Technology & Engineering Emmy Award for Development of NMOS Discovery, Registration and Connection

The Advanced Media Workflow Association (AMWA) has received a 2026 Technology & ...

20/10/2026

Pearl TV Makes Major Progress Toward Affordable NEXTGEN TV Converter Boxes

Pearl TV has made significant progress in its industry-wide initiative to make NEXTGEN TV converter boxes more affordable and accessible to consumers, marking a...

20/10/2026

37th SPORTEL Awards Honor Best in Content, Sports Productions

The 37th edition of SPORTEL Awards took place on Monday, Oct. 19 at the Grimaldi Forum Monaco, under the High Patronage of H.S.H. Prince Albert II of Monaco. Ch...

20/10/2026

Sistemas de Video Comunicacin S.A. Starts Partnership With Amagi for Media Tech Modernization in South America

Amagi has announced a strategic partnership with Sistemas de Video Comunicaci n ...

20/10/2026

Eurosport, TNT Sports Continue Coverage of Tour de France and La Vuelta a Espaa in Europe

The home of cycling coverage is secure as Eurosport and TNT Sports today extend ...

20/10/2026

Give Me the Backstory: Get to Know Itab Azzam and Jack MacInnes, the Directors of One in a Million

By Ramona Flume One of the most exciting things about the Sundance Film Festiva...

20/10/2026

SUNDANCE INSTITUTE NAMES TRACY BRADY AS CHIEF MARKETING, BRAND AND COMMUNICATIONS OFFICER

Veteran Entertainment and Brand Executive to Lead Global Communications Strategy...

20/10/2026

UJAM release Beatmaker & Usynth Bounce

Inspired by late-90s & early-2000s R&B, hip-hop & club music UJAM have just introduced two new virtual instruments that bring together a versatile selection...

20/10/2026

Groove Synthesis release 3rd Wave Terminal

Synth gains free editor & librarian application Back at Superbooth 2026, Groove Synthesis gave us a sneak preview of a desktop software application that off...

20/10/2026

Calrec appoints Video Progetti as Italian partner

With more than 30 years in the Italian broadcast market, Video Progetti will offer the complete Calrec range, giving broadcasters the freedom to choose and scal...

20/10/2026

Pearl TV Issues Progress Report on Low-Cost 3.0 Converters in Advance of NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

USSI Global Ups Ted Korte to Chief Technology Officer

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

The Weather Company Unveils Weather Story Assist

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

Calrec appoints Video Progetti as Italian distribution pa...

Calrec has appointed Video Progetti, the Rome- and Milan-based broadcast distributor and AV system integrator, as its distribution partner for Italy. Media comp...

20/10/2026

FOR-A and Canon team up for a unified approach to PTZ pro...

FOR-A has collaborated with Canon to integrate PTZ camera control into the software-defined MixBoard production switcher. The resulting seamless operations wer...

20/10/2026

KRK Monitors Help The Beat Garden Grow a Sound That is Al...

Great music rarely happens in isolation. It emerges when artists, producers, and songwriters exchange ideas, challenge one another, and find unexpected creative...

20/10/2026

BeckTV, Beam Dynamics and Providius Connect Broadcast Sys...

Collaboration gives broadcast teams a faster path from network alerts to the affected equipment, system dependencies and support information BeckTV, Beam Dyna...

20/10/2026

NHK Super Hi-Vision Cameras Join Journey to the Red Planet

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

Kokusai Denki to Debut New Broadcast Camera Viewfinder at 2026 NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

PrimeTime Lighting Systems Unveils Duo Stream Plug-and-Play Lighting

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

OWC Makes OWC Dock Ejector 2.1 Available for General Release

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

Amagi Expands its South American Presence

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

University of Washington Opens Four-Control-Room IP Produ...

University of Washington Intercollegiate Athletics has brought its new Sundodger Studios production facility on air, with Grass Valley cameras and production sw...

20/10/2026

Miri Technologies to Showcase Whats New and Whats Next fo...

Live demos will include upgrades for the X510 bonding router, self-serve management for NetConnect data plans and a technology preview of future developments ...

20/10/2026

Jigsaw24 Appoints Alex Battrick as Pre-Sales Solution Con...

Jigsaw24 has appointed Alex Battrick as Pre-Sales Solution Consultant, strengthening its technical expertise as the company expands its offering across live pro...

20/10/2026

COW Jobs: Toronto Freelance Crew Call - Your Story - open, ongoing

COW Jobs: Toronto Freelance Crew Call - Your Story - open, ongoing Brie Clayton October 19, 2026 0 Comments Toronto Freelance Crew Call - Your Story (...

20/10/2026

Give your photos a second chance with Open Eyes in Lightroom on mobile

Give your photos a second chance with Open Eyes in Lightroom on mobile Shambhavi Kadam October 19, 2026 0 Comments You know the frustration. Everyone ...

20/10/2026

Paperwolf Studio launches eight creative OpenFX plugins for DaVinci Resolve

Paperwolf Studio launches eight creative OpenFX plugins for DaVinci Resolve Brie Clayton October 19, 2026 0 Comments Datamosh, slit-scan, camcorder lo...

20/10/2026

MLBs Regional Broadcast Rights Worth $1.6B Despite RSN Disruption

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

PSSI Ups Tracy Michaels to Vice President of Engineering

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

Hearst Television Adds Chris Plourde as VP, Strategy and Distribution

Share Copy link Facebook X Linkedin Bluesky Email...

20/10/2026

Scripps Research bestows inaugural Distinguished Alumni Awards

LA JOLLA, CA-The Scripps Research Alumni Network has announced the two divisional winners of its inaugural awards program, created to honor institute alumni for...

20/10/2026

2026 UNTAPPED Development Lab participants announced

2026 UNTAPPED Development Lab participants announced 20 October 2026 Top (L-R): Becki Bouchier, Carly Brand, Leslie Hornung. Bottom (L-R): Joseph Meldrum, Elle...

20/10/2026

Boston Conservatory Center Stage Presents Romantic Musical Comedy She Loves Me

Boston Conservatory Center Stage Presents Romantic Musical Comedy She Loves Me Conservatory musical theater students will perform the charming production, set...

20/10/2026

Rachel McFarlanes American Dialogue Premieres at Carnegie Hall

Rachel McFarlanes American Dialogue Premieres at Carnegie Hall The alum composer and violinists commissioned work is part of Sphinx Virtuosis nationwide tour ...

20/10/2026

FOR-A and Canon team up for a unified approach to PTZ production

Collaboration delivers comprehensive camera control and switching in a single intuitive interface...