Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

13/08/2026

ASG Adds Eran Binyamin Zeitoun as Senior Technical Program Manager

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

Vinten To Feature Manual, Robotic Camera Support Offerings At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

SMPTE Unveils IBC 2026 Plans

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

IP Showcase on the Water Announces Schedule for IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

Spectrum, Optimum Ink New Deals for News Carriage and Ads

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

IAB Tech Lab Updates Privacy Standards

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

Suitest Highlights New AI-Powered Device Testing and Qual...

Suitest's Test Automation Platform Simplifies Video Quality Assurance, Monitoring, and Device Certification Across the OTT Ecosystem At IBC2026, Suitest, a...

13/08/2026

Cinegy showcases powerful, agile, cost-effective media so...

Cinegy GmbH, the premier provider of software-defined television technology, will have its key software solutions ready to demonstrate at SET Expo 2026 (18 20...

13/08/2026

Scripps Research establishes endowed chair honoring Peter K. Vogt, influential pioneer in cancer research

Scripps Research has established the Peter K. Vogt Endowed Chair, a new faculty ...

13/08/2026

New research offers fresh insights for how to make better vaccines

LA JOLLA, CA-A vaccine's molecular structure plays a key role in determining how the immune system responds and prepares to protect the body from future exp...

12/08/2026

Op-Ed: The Versioning Playbook - How Rights Holders are Getting More From Live Events

Traditional live sports production has focused on creating the best possible pro...

12/08/2026

IBC 2026: FOR-A to Demonstrate Production and Processing Solutions

FOR-A will showcase a range of broadcast and production products at IBC2026 (Stand 2.B53, Amsterdam RAI, September 11-14), including software-based switching, A...

12/08/2026

IBC 2026: AMWA and EBU to Demo NMOS BCP-008 Multi-Vendor IP Status Reporting

The Advanced Media Workflow Association (AMWA) and EBU will host live demonstrations of NMOS BCP-008 Minimum Status Reporting at IBC2026 (September 11-14) on th...

12/08/2026

IBC 2026: Dalet Launches Solution Suites for Media Production and Archive Management

Dalet has announced Dalet Solution Suites, a portfolio of cloud-native solutions...

12/08/2026

Net Insight Enables Centralized Remote Production of Blinkfestivalen 2026 for NRK

Net Insight has announced that DMC Production Norway has selected its Open Live ...

12/08/2026

Zixi Appoints Alyson Stewart as Senior Director of Sales

Zixi has appointed Alyson Stewart as Senior Director of Sales. Stewart will be responsible for direct sales and partnerships, with a focus on broadcasters, medi...

12/08/2026

LiveU Powers Host Broadcast Operations at 2026 Glasgow Games

LiveU's LU900Q intelligent production unit was deployed as part of the host broadcast operation for the Games in Glasgow (July 23-August 2, 2026). Host broa...

12/08/2026

Disney+ and ESPN Acquire Multi-Year Formula E Rights Beginning 2026/27 Season

Disney , ESPN, and Formula E have announced a multi-year deal bringing all Formula E races to Disney and ESPN in the U.S. and to Disney in most international...

12/08/2026

PSSI Launches X-LIVE Managed Service for Live Event Transmission

PSSI has launched X-LIVE, a managed service offering dedicated engineering resources and Appear encoding infrastructure for live event signal processing and tra...

12/08/2026

MoonPay X Games League Draws 18.3 Million Viewers in Inaugural Summer Season

The inaugural MoonPay X Games League Summer Season reached 18.3 million unique live viewers across three stops on ABC and ESPN, a 78.5% increase compared to the...

12/08/2026

IBC 2026: BBright Adds RIST Support to IP-Gateway

BBright will showcase an expanded IP-Gateway at IBC2026, adding support for all RIST profiles to its existing support for MPEG Transport Stream over IP with SMP...

12/08/2026

IBC 2026: BBright Adds EBU OGraf Graphics Support to UHD and ST 2110 Playout Platform

BBright will demonstrate EBU OGraf animated graphics support in its software-bas...

12/08/2026

Interra Systems to Showcase QC and Monitoring Solutions at SET Expo 2026

Interra Systems will demonstrate its ORION, BATON, BATON Captions, and VEGA solutions at SET Expo 2026 (August 17-20, Distrito Anhembi, S o Paulo) at partner Li...

12/08/2026

DPA Microphones Appoints Raul Contreras as West Coast Regional Sales Manager

DPA Microphones has appointed Raul Contreras as West Coast Regional Sales Manager. In the role, Contreras will oversee sales and customer relationships througho...

12/08/2026

Save the Date: SVG LIVE! Returns to LA Nov. 10 to Spotlight Sports & Entertainment Production

Live spectacles ranging from the Super Bowl and FIFA World Cup to the Oscars and...

12/08/2026

Love, Separation, and the Cost of Comfort in How to Divorce During the War

Writer-Director Andrius Bla evi ius and crew attend the premiere of How to Divorce During the War at The Ray Theatre on January 26, 2026, in Park City, UT. (P...

12/08/2026

SSL 360 gets a major update

Enhanced DAW & plug-in control for the UC1, UF8 and UF1 The software that powers SSL's range of control surfaces has just received a major update that d...

12/08/2026

Triton Audio launch the Tilt EQ

In-line preamp features one-knob EQ In addition to their range of in-line preamps, Triton Audio recently managed to squeeze a compressor into an enclosure t...

12/08/2026

AudioRoute from Arvital Audio

Captures system audio with or without a DAW Depending on your setup, capturing system audio in a DAW can be a tedious process, so much so that Arvital Audio...

12/08/2026

2026 NATIONAL NAIDOC AWARDS TO BROADCAST ON NITV LIVE AND DIRECT FROM MPARNTWE

2026 NATIONAL NAIDOC AWARDS TO BROADCAST ON NITV LIVE AND DIRECT FROM MPARNTWE 12 August, 2026 Media releases First Nations excellence will be celebrated l...

12/08/2026

More than six million sports fans stay with SBS for Tour de France and Tour de France Femmes Avec Zwift

More than six million sports fans stay with SBS for Tour de France and Tour de F...

12/08/2026

Nielsen Introduces Groundbreaking Streaming Ad Measurement in Brazil

Nielsen is cementing Digital Ad Intel as the new go-to currency for digital ad intelligence in Brazil-now with streaming monitoring in the mix. S o Paulo, Augu...

12/08/2026

LPTV Advocates Petition FCC for Voluntary 5G Broadcasts

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Tubi Media Group Inks Content Discovery Deal with Gracenote

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Matrox Video Showcases IP-Based and Software-Defined Tech...

As Matrox Video celebrates 50 years of trusted innovation, the company will showcase its portfolio of interoperable IP technologies and software-defined innovat...

12/08/2026

SMPTE Showcases AI and Open Media Workflows and Industry...

SMPTE, the home of media professionals, technologists and engineers, today announced a program of expert-led sessions, professional workshops and networking eve...

12/08/2026

Berklee Announces Full Details for Inaugural Block Party, a Music Festival Next to Fenway Park

Berklee Announces Full Details for Inaugural Block Party, a Music Festival Next ...

12/08/2026

ACLU Requests ABC Station Probe Documents from FCC

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Roger Keating To Retire from Hearst Television

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Netflix Closes U.S. Upfronts, Nearly Doubles Ad Commitments

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

CBS Pittsburgh Debuts New AR/VR News Studio

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Matthews Intros T-Go Extreme Rigging Solutions

Matthews Studio Equipment introduces T-Go Mounting Solutions extreme camera rigging systems, engineered for the most demanding environments in motion picture pr...

12/08/2026

Anton Bauers EDEN Becomes Only Mobile Power Station in it...

Anton/Bauer, a Videndum brand and the industry leader in mobile power solutions for broadcast and cinematic production, announces that the EDEN Mobile Power Sta...

12/08/2026

TAG Video Systems Cuts Hardware Costs for Customers with...

TAG Video Systems, the global leader in software-based IP monitoring and multiviewer solutions, today announced a memory usage optimization that lowers the tota...

12/08/2026

Unified Streaming Launches Trusted Media - C2PA in Dynami...

Unified Streaming announces Trusted Media, a new solution that enables broadcasters, streaming platforms, and premium content owners to attach verifiable authen...

12/08/2026

Tedial Powers the AI-Driven Media Supply Chain at IBC 202...

Combining intelligent automation, composable business services and user-centric experiences The media industry is entering a new phase where AI intelligence is...

12/08/2026

DPA Microphones Appoints Raul Contreras as West Coast Reg...

DPA Microphones welcomes Raul Contreras as its new West Coast Regional Sales Manager. In this role, Contreras will oversee sales and customer relationships thro...