Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

06/03/2026

TNT Sports Acquires Exclusive U.S. English Language Broadcast Rights to FIBA Men's and Women's Tournaments

TNT Sports and the International Basketball Federation (FIBA) have reached a mul...

06/03/2026

OffBall to Partner with TOGETHXR Across Commercial Strategy and Operations

OffBall and TOGETHXR, two influential young media companies in sports, announce a strategic and operational partnership in a shared push to scale and create inn...

06/03/2026

InfoComm 2026 Names Shure as Exclusive Headline Partner, Showcasing Audio and Innovation Across Key Activations and Stages

InfoComm 2026, a destination for AV, IT, broadcast, and AI-driven systems, annou...

06/03/2026

LTN, MediaKind Partner to Deliver Integrated Reliable IP Transport and Edge Processing

LTN and MediaKind announce a strategic partnership to integrate MediaKind's ...

06/03/2026

X Games Brings First-Ever Summer Championship Event to New Orleans in July

X Games and the Greater New Orleans Sports Foundation (GNOSF) announce that New Orleans, Louisiana, will host the first-ever X Games Championship event - the fi...

06/03/2026

Chyron Releases New Edition of AXIS Maps

As part of a busy start of the year at Chyron, the AXIS team developed a set of improvements for AXIS Maps. The features released empower users with more flexib...

06/03/2026

BeckTV Launches BeckFlow at 2026 NAB Show While Highlighting its Latest Design and Integration Projects

At the 2026 NAB Show, BeckTV, a premier systems integrator for the broadcast ind...

06/03/2026

Net Insight Sets New Standard for Live Media Operations with Nimbra Live Intelligence

At NAB Show 2026, Net Insight introduces Nimbra Live Intelligence, which definin...

06/03/2026

SES Adds New MEO Capacity as Latest O3b mPOWER Satellites Enter Commercial Service

SES announces that it has added new Medium Earth Orbit (MEO) satellite capacity ...

06/03/2026

LucidLink Launches Connect to Extend Instant Access to Data Stores

LucidLink, the cloud-native file streaming platform for instant, secure access to large files, announce LucidLink Connect, a new solution that enables real-time...

06/03/2026

Case Study: Panasonic Projection Brings Paddington to Life in London's West End

Panasonic helped bring the world of Paddington: The Musical to life through imme...

06/03/2026

SVG GameDay, Ep. 6: Cincinnati Bengals' Alex Schweppe - Welcome to the Jungle

In-venue and creative video staffers at the professional and collegiate level ha...

06/03/2026

Ratings Roundup: Post Olympics High, NHL on ESPN Viewership Spikes Over 50%

Ratings Roundup is a rundown of recent rating news and is derived from press releases and reports around the industry. In this week's edition, NASCAR Cup Se...

06/03/2026

Riedel Communications Demos Product Innovations at 2026 NAB Show

At the 2026 NAB Show, Riedel Communications opens with a clear message to the North American market: production technology does not have to be complex. This ye...

06/03/2026

SVG Sit-Down: Midco Sports' Andy Price and Craig DeWit on How the Dakotas-Based RSN Is Redefining Regional Sports Media

Midco Sports isn't your typical regional sports network. Backed by nearly a ...

06/03/2026

Inside the Paralympics with OBS Producer Josephine Xiaofan

The stories around the Paralympics are really touching and the athletes, the atmosphere it is all amazing and we want to use new technologies to help us tell th...

06/03/2026

Apple TV Kicks Off F1 Era in U.S. With Driver Tracker, On-Board Cameras, Multiview, Sky Sports Feed

Apple TV subscribers will have access to as many as 30 additional live feeds acr...

06/03/2026

Ten Years On, South African Hip-Hop Artist Kwesta Reflects on DaKAR II'

Ten years after its release, South African hip-hop artist Kwesta's DaKAR II is still making waves. With 51.8 million streams on Spotify, the album continues...

06/03/2026

Statement on the appointment of Dr Nicholas Pappas AM as SBS Chair

Statement on the appointment of Dr Nicholas Pappas AM as SBS Chair Media releases The SBS Board and Executive have welcomed the appointment of Dr Nicholas P...

06/03/2026

Nielsen: 46 Billion Minutes of Women's Sports were Consumed in 2025*

Nielsen Highlights Women's Sports Viewership Milestones Ahead of International Women's Day on March 8 New York March 5, 2026 According to Nielsen&#...

06/03/2026

MXL Moves Into Stable Production Release

Share Copy link Facebook X Linkedin Bluesky Email...

06/03/2026

LTN, MediaKind Partner on Industry Transition From C-Band to IP

Share Copy link Facebook X Linkedin Bluesky Email...

06/03/2026

Roku Unveils 'Roklue' Interactive Content Discovery Feature

Share Copy link Facebook X Linkedin Bluesky Email...

06/03/2026

FCC Releases Tentative Agenda for March Open Meeting

Share Copy link Facebook X Linkedin Bluesky Email...

06/03/2026

ESPN to Air Animated Version of Capitals vs. Rangers NHL Game

Share Copy link Facebook X Linkedin Bluesky Email...

06/03/2026

Tedial to Highlight AI-Fueled Media Lifecycle at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

06/03/2026

esRadio Advances with DHD RX2 Audio Production Consoles

Spanish FM and online broadcaster esRadio has selected DHD RX2 audio production consoles for use at its studio headquarters in Madrid. Part of the Libertad Digi...

06/03/2026

LucidLink launches Connect to extend instant access to da...

LucidLink, the cloud-native file streaming platform for instant, secure access to large files, today announced LucidLink Connect, a new solution that enables re...

06/03/2026

BeckTV Launches BeckFlow at 2026 NAB Show While Highlight...

At the 2026 NAB Show, BeckTV, a premier systems integrator for the broadcast industry, is launching BeckFlow, the first web-based schematic documentation platfo...

06/03/2026

Net Insight sets a New Standard for Live Media Operations...

At NAB Show 2026, Net Insight introduces Nimbra Live Intelligence defining a new category and setting a new standard for live operations: the Open Media Platfor...

06/03/2026

Interra Systems Focuses on StreamingFirst QC Monitoring a...

At the 2026 NAB Show, Interra Systems will showcase its latest advancements in automated QC, real-time monitoring, and captioning reinforcing its position as ...

06/03/2026

Riedel Communications at 2026 NAB Show

At the 2026 NAB Show, Riedel Communications opens with a clear message to the North American market: production technology does not have to be complex. This yea...

06/03/2026

LTN and MediaKind partner to deliver integrated reliable...

New partnership combines on-prem video processing with reliable IP transport to support the transition from C-Band satellite to IP distribution LTN and MediaKi...

06/03/2026

Teaser revealed for Saturday Night Live UK

Friday 6 March 2026 Teaser revealed for Saturday Night Live UKTurn on cookies to view this content. Go to Privacy options and select Accept All'. Privacy...

06/03/2026

Announcing 'Barbara - Becoming Shirin David'

Back to All News Announcing Barbara - Becoming Shirin David Entertainment 06 March 2026 GlobalGermany Link copied to clipboard Available exclusively on N...

06/03/2026

F1: Bringing real Formula 1 sound to cinema

Discover how the F1 sound team turned a real Grand Prix into a cinematic experience. Director Joseph Kosinski and his team worked directly with the Formula On...

06/03/2026

Arvato Systems Joins Initiative D21 e. V.

Arvato Systems Joins Initiative D21 e. V. Shaping digital transformation together Collaboration in Germanys largest network for the digital society Membersh...

06/03/2026

ABC clients recognised in latest TAG certification release, reinforcing industry trust in digital advertising

The Trustworthy Accountability Group (TAG) is a global initiative dedicated to c...

06/03/2026

Death of John McHugh

We are deeply saddened to hear the very sad news of the death of our friend and colleague, John McHugh. John was an exceptionally talented creative leader who s...

06/03/2026

A Nation Holds Its Breath Again

First exclusive look at RT 's promo as Ireland prepare to take on Czechia Every Moment, Every Generation https://youtu.be/2ijo96EadLU 36 years after Geor...

06/03/2026

March 05, 2026

A new clue to how the body detects physical force Scripps Research scientists offer new insight into how the body detects light touch and how disruptions in tha...

05/03/2026

SVG GFX Forum Draws 250+ Industry Pros To Talk Creative Philosphy, AR/XR, Future of Live Sports Graphics

More than 250 sports-graphics professionals packed into The Cutting Room in New ...

05/03/2026

Cosm Atlanta Set to Open at Centennial Yards on June 10

Cosm announces that it will open its third immersive entertainment venue at downtown Atlanta's Centennial Yards on June 10, 2026. Its first public event wil...

05/03/2026

The CW Network to Broadcast Six Banana Ball Games During 2026 Season

Following last year's broadcast television debut, The CW Network is growing its partnership with the Savannah Bananas, announcing that it will be the exclus...

05/03/2026

AT&T Named Founding Partner and Official Connectivity Provider of TGL Presented by SoFi

TGL presented by SoFi, the primetime, men's team golf league, announces AT&T...