Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

27/10/2026

Bitcentral Launches Fusion MediaShare to Help Stations Groups Manage Content Across Markets

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

Hearst Television VP, Sales Gerry McGavick Sets Retirement

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

SiliconDust Continues Push for Dropping 3.0 Encryption During Nationwide EAS Test

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

Gravity Media Specialist Flypack, RF Cameras Conquer Red Bull Rampage

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

Parks Study: HDR Is a Pivotal Point of Difference

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

Netskrt Partners With Oracle for More Reliable, Cost-Effective Streaming

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

Telefonica AMPPs up Movistar Plus Playout with Grass Vall...

First 20 channels move to software-defined playout as TSA considers the requirements of almost 40 additional Movistar Plus linear services. Telef nica Servici...

27/10/2026

Bitcentral Launches Fusion MediaShare to Help Station Gro...

Bitcentral, a news production and media workflow technology company, today announced Fusion MediaShare, a cloud-native service that helps station groups discove...

27/10/2026

KT Studio Genie Launches Genie Shorts - a Native 9-16 Ver...

Amagi, the media industry cloud company, today announced that KT Studio Genie (KTSG), the content subsidiary of KT Corporation, has completed a zero-downtime mi...

27/10/2026

Philippe Mercier, CAS, Captures Explosive Drama and Fast-Paced Action for Qubcois Medical Series STAT

Philippe Mercier, CAS, Captures Explosive Drama and Fast-Paced Action for Qu b c...

27/10/2026

Sfoor Labs releases 37 audio plugins for Windows, including five free effects

Sfoor Labs releases 37 audio plugins for Windows, including five free effects Brie Clayton October 27, 2026 0 Comments Sfoor Labs has released Windows...

27/10/2026

YouTube to Commence AV2 Streaming in 2027

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

Pebble builds on Middle East momentum following CABSAT 20...

Pebble, the leading automation, content management and integrated channel specialist, is building on a successful CABSAT 2026, with major customer projects, new...

27/10/2026

Limecraft Brings No-Code Workflows plus Smarter Subtitlin...

Limecraft today announces version 2026.7 of its cloud-based media production and delivery platform, introducing a Workflow Library, expanded AI-assisted transcr...

27/10/2026

TV Globo affiliate NSC TV selects Appear to power satelli...

X5 and X20 platforms connect six locations across Santa Catarina, enabling resilient IP distribution and centralised broadcasting operations Appear ASA (Appear...

27/10/2026

Matthews Studio Equipment Unveils 33 Sliding Leg C-Stand

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

Tegna Hires Mellynda Hartel to Lead Florida Stations

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

ATSC 3.0 Team's Work on Interference Canceling, Signal Reception Scores Win

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

How the B2X Standard Will Advance Interchangeable Networks

Share Copy link Facebook X Linkedin Bluesky Email...

27/10/2026

DPA Microphones and Wisycom Deliver Exceptional Productio...

Set in the 72 hours leading up to D Day, Pressure is a tense historical drama starring Brendan Fraser as Supreme Allied Commander Dwight Eisenhower and Andrew...

27/10/2026

How AI Is Changing the Pace of Discovery for Millions Living With Dementia

There are 57 million people worldwide living with dementia today. For the researchers working to help them, the obstacle isn't a lack of effort - it's t...

26/10/2026

SVG GameDay, Ep. 36: Columbus Crews Erik Shear - Shows in the Heart of American Soccer

In-venue and creative video staffers at the professional and collegiate level ha...

26/10/2026

SVG Sit-Down: Amagis Dan Marshall on Cloudport and the Power of Channel Building

The company helps content owners take advantage of the burgeoning FAST business to give viewers more choices Amagi EVP, Global Sales, SaaS, Dan Marshall has se...

26/10/2026

Behind The Mic: Troy Aikman to be Free Agent Following Super Bowl LXI as Negotiations Continue

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

26/10/2026

Diversified Launches Google Beam Demo Centers in Four U.S. Cities

Diversified has launched Google Beam demo centers in Los Angeles, Chicago, Nashville and Newark. The centers let businesses try HP Dimension with Google Beam, a...

26/10/2026

NDTV Adopts Amagi AdFlow Orchestrator for FAST and Connected TV Ad Monetization

Indian news broadcaster NDTV has adopted Amagi's AdFlow Orchestrator to improve channel performance on FAST (Free Ad-supported Streaming TV) and Connected T...

26/10/2026

TEGNA and Houston Comets Announce Multi-Year Local Broadcast Partnership on KHOU and KTBU

TEGNA and the Houston Comets have announced a multi-year partnership making KHOU...

26/10/2026

Spurs and Sinclair Announce Over-the-Air Media Partnership

The San Antonio Spurs have named Sinclair Broadcast Group their new over-the-air media partner, bringing Spurs basketball to local fans beginning with the 2026-...

26/10/2026

FOX Sports to Broadcast BIG NOON KICKOFF and FOX NFL SUNDAY From West Point and Annapolis for Veterans Day Weekend

FOX Sports will mark Veterans Day weekend with two days of NFL and college footb...

26/10/2026

DIRECTV Adds Hurricanes, Blue Jackets, Wild and Blues Regional Channels in NHL Deal

DIRECTV has signed a multi-year distribution agreement with the NHL for four tea...

26/10/2026

NBC Sports Ian Kuchta on the Growing Complexity of Sports Transmission and the Importance of Network Redundancy

How does NBC Sports manage transmission operations for the Super Bowl, Winter Ol...

26/10/2026

Texas Athletics and McCombs' Business of Sports Institute Launch Bevo Lab for Sports AI and Analytics

University of Texas Athletics and the Business of Sports Institute (BOSI) in the...

26/10/2026

Game Creek Video's Lauren Mitchell, Gianna Nigro Lead Yogi-Based Team as Female EIC Duo

Classmates at Ithaca College and in the Game Creek Video Apprenticeship Program,...

26/10/2026

NAB Show New York and SMPTE Summit to Co-Locate in 2027

NAB Show New York and the SMPTE Summit will co-locate at the Javits Center in 2027, bringing together two leading events serving the media and entertainment ind...

26/10/2026

Game Creek Video Supplies Tech Infrastructure, Mobile Units for Milwaukee's Portion of the Fall Classic

A 10-person team at American Family Field is supporting live game and studio pro...

26/10/2026

NoiseWorks Audio launch Complete Bundle

Combining four plug-ins aimed at vocal and dialogue work NoiseWorks Audio have announced the Complete Bundle, a collection which brings together VoiceAssist...

26/10/2026

RME introduce the ADI-2/4 Pro EX

Boasts improved A-D & D-A specs RME's flagship converter and headphone amp has just been treated to an upgrade that introduces redesigned converter circ...

26/10/2026

AgileTV launches Play+ the new TV service for the Nordic region together with local teleoperator lcom

The company has partnered with the telecom provider lcom to launch Play , its n...

26/10/2026

Gray Names Jennifer Rieffer GM of WBTV Charlotte

Share Copy link Facebook X Linkedin Bluesky Email...

26/10/2026

NUGEN Audio VisLM 3 Delivers an Array of Tools to Help Pr...

NASHVILLE, OCTOBER 26, 2026 NUGEN Audio has launched VisLM 3, the newest generation of its award-winning loudness metering solution, ahead of AES Show 2026: N...

26/10/2026

CaptionX Launches Clips: Turns Long Videos Into Shorts, Working Entirely From the Transcript

CaptionX Launches Clips: Turns Long Videos Into Shorts, Working Entirely From th...

26/10/2026

Horror Film Killer Rental Shot with Blackmagic Design Cameras

Horror Film Killer Rental Shot with Blackmagic Design Cameras Brie Clayton October 26, 2026 0 Comments Genre mixing film shot with eight URSA Mini Pro...

26/10/2026

PlottoFilm puts script breakdown, storyboards and AI shot generation in one browser workspace for indie filmmakers

PlottoFilm puts script breakdown, storyboards and AI shot generation in one brow...

26/10/2026

NUGEN Audio VisLM 3 Delivers an Array of Tools to Help Professionals Adapt to Evolving Production Workflows

NUGEN Audio VisLM 3 Delivers an Array of Tools to Help Professionals Adapt to Ev...

26/10/2026

Coalition Urges Federal Action to Bring Film and TV Production Home'

Share Copy link Facebook X Linkedin Bluesky Email...

26/10/2026

How to Protect Your Station From PHP2Shell

Share Copy link Facebook X Linkedin Bluesky Email...

26/10/2026

Audio-Technica Expands U.S. Presence with New Hollywood Facility

Share Copy link Facebook X Linkedin Bluesky Email...

26/10/2026

NCAA Ups Its Game to Heighten Fan Experiences

Share Copy link Facebook X Linkedin Bluesky Email...

26/10/2026

YouView joins ChangeTheFace to help advance inclusion in technology

YouView joins ChangeTheFace to help advance inclusion in technologyOct 26, 2026 Building a more inclusive technology industry takes shared action. That's w...