Sony Pixel Power calrec Sony

Taking AI to Warp Speed: Decoding How NVIDIA's Latest RTX-Powered Tools and Apps Help Developers Accelerate AI on PCs and Workstations

31/07/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for RTX PC users.

NVIDIA is spotlighting the latest NVIDIA RTX-powered tools and apps at SIGGRAPH, an annual trade show at the intersection of graphics and AI.

These AI technologies provide advanced ray-tracing and rendering techniques, enabling highly realistic graphics and immersive experiences in gaming, virtual reality, animation and cinematic special effects. RTX AI PCs and workstations are helping drive the future of interactive digital media, content creation, productivity and development.

ACE's AI Magic During a SIGGRAPH fireside chat, NVIDIA founder and CEO Jensen Huang introduced James - an interactive digital human built on NVIDIA NIM microservices - that showcases the potential of AI-driven customer interactions.

Using NVIDIA ACE technology and based on a customer-service workflow, James is a virtual assistant that can connect with people using emotions, humor and contextually accurate responses. Soon, users will be able to interact with James in real time at ai.nvidia.com.

James is a virtual assistant in NVIDIA ACE. NVIDIA also introduced the latest advancements in the NVIDIA Maxine AI platform for telepresence, as well as companies adopting NVIDIA ACE, a suite of technologies for bringing digital humans to life with generative AI. These technologies enable digital human development with AI models for speech and translation, vision, intelligence, realistic animation and behavior, and lifelike appearance.

Maxine features two AI technologies that enhance the digital human experience in telepresence scenarios: Maxine 3D and Audio2Face-2D.

Developers can harness Maxine and ACE technologies to drive more engaging and natural interactions for people using digital interfaces across customer service, gaming and other interactive experiences.

Tapping advanced AI, NVIDIA ACE technologies allow developers to design avatars that can respond to users in real time with lifelike animations, speech and emotions. RTX GPUs provide the necessary computational power and graphical fidelity to render ACE avatars with stunning detail and fluidity.

With ongoing advancements and increasing adoption, ACE is setting new benchmarks for building virtual worlds and sparking innovation across industries. Developers tapping into the power of ACE with RTX GPUs can build more immersive applications and advanced, AI-based, interactive digital media experiences.

RTX Updates Unleash AI-rtistry for Creators NVIDIA GeForce RTX PCs and NVIDIA RTX workstations are getting an upgrade with GPU accelerations that provide users with enhanced AI content-creation experiences.

For video editors, RTX Video HDR is now available through Wondershare Filmora and DaVinci Resolve. With this technology, users can transform any content into high dynamic range video with richer colors and greater detail in light and dark scenes - making it ideal for gaming videos, travel vlogs or event filmmaking. Combining RTX Video HDR with RTX Video Super Resolution further improves visual quality by removing encoding artifacts and enhancing details.

RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. Users with an RTX GPU-powered PC can send files to the Filmora desktop app and continue to edit with local RTX acceleration, doubling the speed of the export process with dual encoders on GeForce RTX 4070 Ti or above GPUs. Popular media player VLC in June added support for RTX Video Super Resolution and RTX Video HDR, adding AI-enhanced video playback.

Read this blog on RTX-powered video editing and the RTX Video FAQ for more information. Learn more about Wondershare Filmora's AI-powered features.

In addition, 3D artists are gaining more AI applications and tools that simplify and enhance workflows, including Replikant, Adobe, Topaz and Getty Images.

Replikant, an AI-assisted 3D animation platform, is integrating NVIDIA Audio2Face, an ACE technology, to enable improved lip sync and facial animation. By taking advantage of NVIDIA-accelerated generative models, users can enjoy real-time visuals enhanced by RTX and NVIDIA DLSS technology. Replikant is now available on Steam.

Adobe Substance 3D Modeler has added Search Asset Library by Shape, an AI-powered feature designed to streamline the replacement and enhancement of complex shapes using existing 3D models. This new capability significantly accelerates prototyping and enhances design workflows.

New AI features in Adobe Substance 3D integrate advanced generative AI capabilities, enhancing its texturing and material-creation tools. Adobe has launched the first integration of its Firefly generative AI capabilities into Substance 3D Sampler and Stager, making 3D workflows more seamless and productive for industrial designers, game developers and visual effects professionals.

For tasks like text-to-texture generation and prompt descriptions, Substance 3D users can generate photorealistic or stylized textures. These textures can then be applied directly to 3D models. The new Text to Texture and Generative Background features significantly accelerate traditionally time-consuming and intricate 3D texturing and staging tasks.

Powered by NVIDIA RTX Tensor Cores, Substance 3D can significantly accelerate computations and allows for more intuitive and creative design processes. This development builds on Adobe's innovation with Firefly-powered Creative Cloud upgrades in Substance 3D workflows.

Topaz AI has added NVIDIA TensorRT acceleration for multi-GPU workflows, enabling parallelization across multiple GPUs for supercharged rendering speeds - up to 2x faster with two GPUs over a single GPU system, and scaling further with additional GPUs.

Getty Images has updat
LINK: https://blogs.nvidia.com/blog/ai-decoded-siggraph-chat-rtx-update/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

12/11/2026

The Software-Defined Shift: A Discussion on the Technologies Reshaping Live Sports Production

Industry leaders examine how Dynamic Media Facility, Media eXchange Layer, and c...

12/11/2026

SVG Students to Watch: Addison Carnow, University of North Carolina

The junior Tar Heel is embracing the technical and creative challenges of live production while emerging as a leader and mentor in the control room...

12/11/2026

Gracenote Survey: 78% of Viewers 18-24 Want a Single Program Guide Across Streaming Services

Gracenote, Nielsen's content intelligence business, has released its fifth a...

12/11/2026

RTL Deutschland and NHL Expand Partnership, Bringing NHL Monday Night Hockey to Free-to-Air TV in Germany

RTL Deutschland will bring the NHL to free-to-air TV in Germany starting Nov. 30...

12/11/2026

Clear-Com Supports Global Student Broadcast On Air 2026 With Station-IC, Eclipse HX and FreeSpeak Cell

Clear-Com supported On Air 2026, a 24-hour student-led broadcast connecting 45 u...

12/11/2026

uniqFEED Opens Remote Operations Center in Madrid for LaLiga Virtual Advertising

uniqFEED has opened a Remote Operations Center (ROC) in Madrid, Spain. It is already operational, delivering virtual advertising for LaLiga matches. The ROC is ...

12/11/2026

Disney, ESPN and NBA Present Third Dunk the Halls Animated Christmas Day Game

Disney, ESPN and the NBA will present Dunk the Halls, the third real-time animated NBA game using Sony's Beyond Sports data visualization technology, on Chr...

12/11/2026

Van Wagner Launches RELAY Digital Platform for College Athletics Websites and Apps

Van Wagner has launched Van Wagner RELAY, a digital platform for official athlet...

12/11/2026

Vizrt Acquires Chyron in Major Consolidation of Broadcast Graphics Market

Deal brings together two of the industry's most established graphics brands and significantly expands Vizrt's footprint in U.S. sports and regional broa...

12/11/2026

Euro TV Upgrades OB Van with Lawo mc36 MkII and VSM

Euro TV Production GmbH of Austria has upgraded its outside broadcast vehicle with Lawo technology. The mc 36 Classic console in service since 2019 was replaced...

12/11/2026

Tagboard Launches Spark Resize Beta to Convert Graphics to New Aspect Ratios

Tagboard has launched Spark Resize, an AI-assisted tool now in beta that takes an existing graphic and produces a new version for a different aspect ratio or sc...

12/11/2026

At Second-Annual SVG LIVE! Event, Live Production's Biggest Names Go Inside the Tentpole Playbook

Ben Winston, Glenn Weiss, and FIFA's Jenni-Lee Van Gelder headlined a day fo...

12/11/2026

AWS, NFL Launch Next Gen Trends, Opening In-Season Tracking Data to Fans

Free interactive platform visualizes team tendencies, formations, and schemes, updated weekly...

12/11/2026

Sports Broadcasting Hall of Famer Charlie Jablonski: A True Broadcasting Power Broker

Sports Broadcasting Hall of Famer Charlie Jablonski's broadcasting career is...

12/11/2026

UVI release Twin 88 Keys

Blend between concert grand & vintage electric pianos UVI's latest release combines a concert grand with a vintage electric piano in a single instrument...

12/11/2026

Universal Audio reintroduce UAD Cooper Time Cube Delay

Native version of popular effects plug-in arrives Many of the plug-ins that used to require Universal Audios Apollo interfaces or DSP accelerators have made...

12/11/2026

Audient launch the iD Mk3 line-up

Four next-generation interfaces announced Following on from the release of their new flagship Thunderbolt interfaces, Audient have refreshed the design of t...

12/11/2026

Rohde & Schwarz and Connektica showcase automated RF test systems for satellite payloads and radar at Space Tech Expo

Rohde & Schwarz and Connektica showcase automated RF test systems for satellite ...

12/11/2026

78% of young adults want a single program guide across their streaming services, up from 58% last year

Gracenote's 2026 State of Play report signals a rising retention risk: More ...

12/11/2026

Blackmagic Design Announces Blackmagic Ambisonic Microphone

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

12/11/2026

CES Honors LGs Signature OLED, Wallpaper TVs

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

12/11/2026

Broadsmart launches monetization capabilities to power OT...

Broadpeak and Magnite enable advertising on Afree TV to unlock new revenue opportunities for African content providers Broadsmart, a technology integrator deli...

12/11/2026

PlayBox Neo makes an impact delivering flexible broadcast...

PlayBox Neo is perceived in the industry as an innovator way ahead of its time, already making a profound impact in the Asia-Pacific region, where the company i...

12/11/2026

Filmbankmedia selects Fincons Group s AllRights to manage...

This agreement marks the next step in a multi-year digital transformation programme as distribution expands across more clients and markets, requiring reliable ...

12/11/2026

Euro TV Upgrades OB Vehicle With Lawo Console

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

12/11/2026

Scripps Names Christina Hartman Chief Technology Officer

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

12/11/2026

ABC Names Martin Ortiz GM of WTVD-TV Raleigh-Durham

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

12/11/2026

Adobe, Google Expand AI and Creative Tool Integration

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

12/11/2026

NIH awards $7 million to study what makes immune responses last

LA JOLLA, CA-Central to many immune responses are antibodies, which identify foreign substances and help remove them from the body. The immune cells that produc...

12/11/2026

Bill & Ted Rock Opera Taken to New Heights After Student Workshop

Bill & Ted Rock Opera Taken to New Heights After Student Workshop Emerging artists from Berklee, Boston Conservatory, and Emerson collaborated with industry p...

12/11/2026

HPA Sets 2027 Tech Retreat Theme Around a Changing Industry

The Hollywood Professional Association (HPA) today announced the theme and program focus for the 2027 HPA Tech Retreat, taking place Feb. 14-18, 2027 in La Quin...

12/11/2026

Jeremiah Slovarp on building Jereco from the ground up in rural Montana

An island in rural MontanaJeremiah Slovarp owns Jereco in Bozeman, Montana, and teaches music technology and recording arts at Montana State University. He star...

12/11/2026

Introducing Ask the AI GP'

Who am I and whats an AI GP? Im Kathryn Hodgkinson, and Ive recently qualified as an Artificial Intelligence Governance Professional (AIGP), a certification awa...

12/11/2026

RT Coverage of European Political Community Summit in Dublin

RT will provide extensive coverage of the European Political Community Summit in Dublin across television, radio and online on Thursday, 12 November 2026. As p...

11/11/2026

Charlotte Hornets Become One of NBAs First Teams With WiFi 7 at Spectrum Center

Hornets Sports & Entertainment (HSE) and Spectrum have installed WiFi 7 as part of Spectrum's Managed WiFi solution within Charlotte's recently renovate...

11/11/2026

The Minor League Resolution Crisis: Bridging the Gap Between Living Room 4K and In-Venue Reality

As 4K displays normalize in living rooms and economy flights, aging minor league...

11/11/2026

Northwestern University Taps Grass Valley for Control Room Tech at Ryan Field

Northwestern University has deployed Grass Valley production switching and camera technology at its new Ryan Field stadium in Evanston, Illinois. The installati...

11/11/2026

Central Christian Church Links Remote Production Teams With Clear-Com's Gen-IC Virtual Intercom

Central Christian Church has transformed communication across its live productio...

11/11/2026

Capital One Arena Receives New Tech Enhancements to Upgrade the Fan Experience

Monumental Sports & Entertainment developed the new Cisco Command Center for all of the building's technology Prior to the start of the busy October schedu...

11/11/2026

OutKick Debuts New Studio for The Craig Carton Show in New York as Nashville Powers Distributed Production Operation

The new Manhattan set is the latest addition to a network of studios, home setup...

11/11/2026

MLB Network Turns Up the Production for Fourth-Annual MLB Awards in Las Vegas

With a remodeled set, an expanded camera package, and a Steve Aoki performance, MLB Network's production team raises the bar again at The Chelsea...

11/11/2026

Spitfire Audio & Eric Whitacre launch Eternity

Third collaboration with Grammy-winning composer & conductor Spitfire Audio have announced the release of Eternity, the third sample library to be created a...

11/11/2026

Modbap release Wax Theory

Eurorack experts launch vinyl-inspired plug-in When praised Eurorackers Modbap revealed their first software effect recently, they stated it was the first r...

11/11/2026

Nielsen Announces Pricing of $1.4 Billion Offering of Senior Secured Notes by its Affiliate

New York, NY - November 10, 2026 - Neptune BidCo US Inc. (the Issuer or the C...

11/11/2026

Pliant Technologies Ships CrewCom Flex

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

11/11/2026

Blue Lucy Integrates With Comcast Technology Solutions

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

11/11/2026

Hitomi Broadcast appoints Hibino Technos Inc. as value-ad...

New partnership strengthens local access to Hitomi s precision timing solutions, with MatchBox, MatchBox Glass and Spectra on show at Inter BEE 2026 Hitomi Br...

11/11/2026

Frequency Ads and OpenGlass Deploy Stream-Native In-Scene...

Frequency, the engine behind many of the worlds leading streaming television channels, and OpenGlass, the first SSP built for advanced CTV advertising, today an...

11/11/2026

Operative Appoints Brian Beirne as Senior Vice President...

Operative today announced the appointment of Brian Beirne as Senior Vice President, Commercial Growth. Beirne returns to Operative at a pivotal moment, as its U...