Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

19/08/2026

FOX and NBCUniversal Score with FIFA World Cup 2026 Success in Nielsen's June Gauge Reports

World Cup Games Generate 84 Billion Minutes Across FOX, Fox Sports 1 and NBCU...

19/08/2026

The Gauge: Poland | July 2026

July brought typical peak-holiday drops in viewership, driven primarily by viewers stepping away from screens and a visible decline in reach across both traditi...

19/08/2026

Carr Calls ABC Suit 'Meritless

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Henry Alexander Joins BCE as Sales Director

Henry joins BCE as the company accelerates its commercial strategy and expands its international presence across the media, broadcast and technology markets. He...

19/08/2026

iWedia Announces Advanced Android DRAM Optimisation Proce...

iWedia, a leading provider of software solutions for connected TV devices, today announced a major milestone in Android platform optimization with the successfu...

19/08/2026

NTP Technology announces ST 2110-30-RAVENNA 128-channel A...

NTP Technology announces that ST 2110-30 audio-over-IP connectivity with AES67 and RAVENNA capabilities is now available for the brand's world-class audio i...

19/08/2026

ORF goes full IP with Net Insight in nationwide network o...

Net Insight has been selected to provide its Nimbra platform by the service provider Big Blue Marble, formerly ORS Group, as the core media transport solution f...

19/08/2026

Coventry City Trophy Parade Extends LiveU LIQ Beyond the...

LiveU has supported Coventry City FC and several other top-flight UK football clubs through one of their most demanding live production challenges of the year, ...

19/08/2026

Nature Seekers Documentary Shot with Blackmagic URSA Cine 12K LF

Nature Seekers Documentary Shot with Blackmagic URSA Cine 12K LF Brie Clayton August 18, 2026 0 Comments Filming endangered turtles required camera...

19/08/2026

Neyrinck Brings D-Control Consoles Back to Life on Apple Silicon with D-Control Basic

Neyrinck Brings D-Control Consoles Back to Life on Apple Silicon with D-Control ...

19/08/2026

ABC Files First Amendment Lawsuit Against FCC

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Nielsen: Fox and NBCUniversal Score with FIFA World Cup 2026

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

ESPN Co-Founder Bill Rasmussen Dies At 93

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Study: NBA Ad Revenue Hit $2.1 Billion Last Season

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Nexstar's WNCN Donates ENG Van for Training

Share Copy link Facebook X Linkedin Bluesky Email...

19/08/2026

Riedel Brings Professional Live Production Into the Class...

Riedel Communications today announced that Edith Cowan University (ECU) in Perth, Australia, implemented a comprehensive communications infrastructure that brin...

19/08/2026

QuickLink Showcases New 4K Capabilities Across StudioEdge...

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, will spotlight a major leap forward in remote guest con...

19/08/2026

EMAM together with PlayBox Neo and SNEWS launch combined...

Integrated platform melds media asset management, playout automation and newsroom workflows EMAM, PlayBox Neo and SNEWS have officially launched Nuvex, a conne...

19/08/2026

Screen Australia releases the Private Investment Toolkit to strengthen screen industry financing pathways

Screen Australia releases the Private Investment Toolkit to strengthen screen in...

19/08/2026

Do Aussies truly value local content? Unpacking Screen Currency 2026 with Deirdre Brennan

Do Aussies truly value local content? Unpacking Screen Currency 2026 with Deirdr...

19/08/2026

RT TO AIR HISTORIC KATIE TAYLOR FIGHT IN CROKE PARK

On Saturday September 5 Katie Taylor will step into the ring for the fight of her life against Flora Pili in front of 80,000 fans in Croke Park. A legendary fig...

18/08/2026

SportStream 2026 Virtual Event Set for September 15-17

SportStream 2026, a free three-day virtual event, will take place September 15-17. One registration provides access to all three days of live programming and on...

18/08/2026

IBC 2026: BeckTV to Debut BeckFlow Documentation Platform

BeckTV will introduce BeckFlow to the European market at IBC2026, demonstrated on the Providius stand (10.F53). BeckFlow is a web-based schematic documentation...

18/08/2026

IBC 2026: Boland Communications to Introduce ST 2110 Option for 4K Monitors

Boland Communications will introduce a SMPTE ST 2110 input option for its 4K monitors at IBC2026, along with a new 55-inch super-narrow bezel display for video ...

18/08/2026

Seattle Seahawks Integrate Dolby OptiView with Dolby Vision for Fan Streaming

Dolby Laboratories and the Seattle Seahawks have announced a partnership integrating Dolby OptiView into the Seahawks' live streaming coverage, making the S...

18/08/2026

Insights from BMG's Graham Taylor on the Role of a Sports Producer in Live Broadcast Production

For BMG Executive Producer of Sports Production, Graham Taylor, producing live s...

18/08/2026

TMRW Sports Names Rufus Hack as President of Golf

TMRW Sports has appointed Rufus Hack as President of Golf, a newly created role in which he will lead the company's golf businesses including TGL presented ...

18/08/2026

SMT To Deliver Race Technology for Freedom 250 IndyCar Broadcast

SMT will provide race technology for FOX Sports' coverage of the Freedom 250 Grand Prix of Washington, D.C. on August 23, when the NTT INDYCAR SERIES races ...

18/08/2026

HMA's Creator Collective Pairs Digital Creators, Beat Writers in New Model for Local-Sports Coverage

The live, YouTube-native roundtables combine fan voices, credentialed reporters,...

18/08/2026

Behind The Mic: FOX Sports Shares Broadcast Lineup for 2026 NFL Season and College Football Season

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

18/08/2026

Miami Heats Ed Filomia on Rebuilding Kaseya Centers Video Infrastructure and 29 Years With the Heat

The industry legend sounds off on replacing the Heat's iconic Medusa score...

18/08/2026

Bill Rasmussen, ESPN Founder and Sports Broadcasting Hall of Famer, Dies at 93

William F. Rasmussen, the sports fan-turned broadcaster and entrepreneur whose out-of-the-box idea of a 24-hour cable sports network, ESPN, changed forever the ...

18/08/2026

DAZN Completes Acquisition of ViewLift

DAZN Group has completed its acquisition of ViewLift, a provider of streaming and digital solutions for sports content owners. The acquisition was first announc...

18/08/2026

American Association of Professional Baseball Adds SI TV as Broadcast Partner

The American Association of Professional Baseball (AAPB) has added SI TV, Sports Illustrated's 24/7 streaming channel, as a broadcast partner for the remain...

18/08/2026

Esports Foundation Postpones Inaugural Esports Nations Cup to November 2027

The Esports Foundation has announced that the inaugural Esports Nations Cup (ENC), originally scheduled for November 2026 in Riyadh, will be postponed to Novemb...

18/08/2026

Diversified Launches Global Managed Services Practice

Diversified has announced a new Global Managed Services Practice, consolidating the company's managed services capabilities into one organization. Rob Mello...

18/08/2026

Appear Completes REMI Proof of Concept with Thoroughbred Racing Productions

Appear has completed a proof of concept with Thoroughbred Racing Productions (TRP), demonstrating multi-camera remote live production over bonded 5G cellular an...

18/08/2026

IBC 2026: Riedel Implements Live Production Infrastructure at Edith Cowan University

Riedel Communications has announced that Edith Cowan University (ECU) in Perth, ...

18/08/2026

Panoramic from Panorama Labs

Company launch with stereo-imaging tool Panoramic is the debut release from Panorama Labs, a new company formed by mastering engineer Nicholas Di Lorenzo. C...

18/08/2026

Focusrite extend Control 2 support

Control software now available for older interfaces Focusrite have just announced the launch of an update that extends Control 2 software support their Scar...

18/08/2026

Call for the 20th Annual South African Film and Television Awards (SAFTAs20) Jury

The National Film and Video Foundation (NFVF), an agency of the Department of Sp...

18/08/2026

Corridor Television Pays $27,000 for Violating FCCs EAS Rules

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Disney's ABC Files First Amendment Lawsuit Against the FCC

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Lightware Integrates with SpectralBot to Accelerate AV Tr...

Lightware announces an integration with SpectralBot that helps system integrators and AV operators troubleshoot faster using augmented reality (AR), AI-assisted...

18/08/2026

Command Frame for After Effects

Command Frame for After Effects Scott Black August 18, 2026 0 Comments Free download, demonstrations, hands-on tests, and creator resources Want to t...

18/08/2026

Dot Group to show how cutting carbon cuts cost - live at...

At Stand 14.A57, the data company will demonstrate GreenDot and IBM Aspera together, giving media and entertainment businesses real-time visibility of what thei...