Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

28/05/2026

Calrec Scales ImPulseV to Expand Choice in Virtualized Audio Workflows

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

Berliner Ensemble Upgrades Backstage Infrastructure With...

Riedel Communications today announced that Berliner Ensemble, one of Berlin's five major theater companies, has expanded its backstage communications and te...

28/05/2026

Digital Alert Systems Ed Czarnecki to Speak on Advanced E...

Company's VP Government and International to Address How Broadcasters Can Operationalize Advanced Emergency Information for NextGen TV Digital Alert Syst...

28/05/2026

Radio BGM Upgrades and Futureproofs with DHD SX2 Audio Mi...

Radio BGM (https://radiobgm.org.uk/), Llanellis multiple-award-winning community and hospital radio station, has invested in a DHD SX2 audio mixing console and ...

28/05/2026

Calrec Scales ImPulseV to Empower Broadcasters with Great...

Further strengthening its virtualisation strategy to fully support broadcasters as they enter a new broadcast age, Calrec announces an expansion to its ImPulseV...

28/05/2026

NAB, MPA and NCTA Defend Current TV Ratings System

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

Amazon MGM Studios, AWS Launch the GenAI Creators' Fund

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

AudioShake Launches New Copyright Compliance System

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

ITV Studios Deploys Cuez Live Production Platform

Share Copy link Facebook X Linkedin Bluesky Email...

28/05/2026

ACT Entertainment Introduces Green Hippo Estuary Series a...

Green Hippo, an ACT Entertainment brand, will pull back the curtain on the Estuary Series, a next-generation media control platform engineered for the scale, sp...

28/05/2026

ZEISS Introduces Panoptes 65 Cinema Lenses at Cine Gear E...

First Hands-On Opportunity at Universal Studios Lot, June 5-6 Oberkochen, Germany, May 27, 2026 ZEISS is launching their new Panoptes 65 primes at Cine Gear ...

28/05/2026

Wooden Camera Releases New Accessories for Blackmagic URS...

Irvine, CA May 20, 2026 Wooden Camera today announced the release of new accessories for the Blackmagic URSA Cine Immersive. The new lineup includes a redes...

28/05/2026

Six films, one unmissable collection. First Facts documentaries debut on 10 Streaming

Six films, one unmissable collection. First Facts documentaries debut on 10 Stre...

28/05/2026

Emma Watkins brings all-new Emma's Dance Club to ABC Kids

Emma Watkins brings all-new Emma's Dance Club to ABC Kids 28 May 2026 Emmas Dance Club. Image credit: Sarah Wilson. The ABC, Screen Australia and Screen N...

28/05/2026

Cool Concentric Text for Cavalry

Cool Concentric Text for Cavalry Simon Ubsdell May 27, 2026 0 Comments In this tutorial I'll show you how to make this popular text effect that is...

28/05/2026

Wild Conamara, a major two-part natural history documentary series, airs this week on RT

RT presents Wild Conamara, a two-part natural history documentary that brings a...

28/05/2026

The Name's Gaming Cloud Gaming: 007 First Light' Launches on GeForce NOW

License to stream, shaken and stirred. GeForce NOW is dialing up the espionage with the launch of 007 First Light, letting members slip into James Bond's r...

28/05/2026

NVIDIA Research Advances Robotics From Simulation to the Real World

Robotics is entering a new phase: moving from controlled demos and scripted automation toward generalizable, reliable embodied autonomy in the real world. At ...

28/05/2026

May 21, 2026

Scripps Research's Skaggs Graduate School awards doctoral degrees to 34th graduating class May 21, 2026 Scripps Research's Skaggs Graduate School of ...

28/05/2026

May 27, 2026

Scripps Research chemist Jin-Quan Yu is named a Fellow of the Royal Society Yu is honored by the U.K.'s national academy of sciences for his work in synthet...

27/05/2026

Telestream Appoints Benjamin Desbois as CEO, Effective July 1

Telestream has announced that its Board of Directors has appointed Benjamin Desbois as Chief Executive Officer, effective July 1, 2026. Desbois, currently Teles...

27/05/2026

FOX MLB Leads Live-Event Categories; ESPN Is Tops Overall at 47th Annual Sports Emmy Awards

ESPN garnered 10 awards; NBC's Sunday Night Football received the Outstandin...

27/05/2026

Matrox Video Marks 50th Anniversary, Announces New Product Launch for June

Matrox Video is celebrating its 50th anniversary, marking five decades of operations from its headquarters in Montreal, Canada. Founded in 1976, the company has...

27/05/2026

MLB Announces Fan Engagement Initiatives for Americas 250th Anniversary

Major League Baseball has announced a series of initiatives tied to America's Semiquincentennial, including a national marketing campaign, Fourth of July br...

27/05/2026

Advanced Systems Group Hires Brian Gross as Account Manager for Audio Team

Advanced Systems Group (ASG) has announced that Brian Gross has joined the company as an Account Manager on its Audio team, based in the Burbank office. He will...

27/05/2026

Nielsen Research: Hispanic Fans, Asian Markets Drive Global Soccer Audience Ahead of World Cup 2026

Nielsen has released new research on soccer fandom ahead of the FIFA World Cup 2...

27/05/2026

ESL FACEIT Group Debuts First Ever Esports Vertical Stream Co-Developed With TikTok

ESL FACEIT Group (EFG) has unveiled a new partnership with TikTok to bring broad...

27/05/2026

Two Weeks Away: FIFA Outlines Production Plans for Highly Anticipated North American-Based World Cup

FIFA's Oscar Sanchez gives a deeper look to how this tournament will be cove...

27/05/2026

SVG Students To Watch: Maggie Lynn, Virginia Tech

The soon-to-be senior from Charlottesville is building her skills in replay, TD, and even creative content for HokieVision and its ACC Network productions In t...

27/05/2026

A Global Festival of Football: FOX Sports Illustrates Strategy to Bring Every FIFA Mens World Cup Match to the U.S. Audience

FOX Sports' Mike Davies breaks down the vision for this summer's showcas...

27/05/2026

Top-Tier Storytelling: Host Broadcast Services Works at Capturing the Atmosphere of the FIFA Mens World Cup

HBS's Paul King, FIFA's Oscar Sanchez preview how the masses at home wil...

27/05/2026

Matt Gangl & Pete Macheska on FOX MLBs Huge Night and an Unforgettable Postseason Run

FOX's MLB coverage dominated the night at the 47th Annual Sports Emmy Awards...

27/05/2026

FOXs Mike Davies and Team on Outstanding Technical Team Win for 2025 World Series

One of the most memorable Postseasons in baseball history would have had no memo...

27/05/2026

NBC Sports Rob Hyland Reflects on an Unforgettable Sunday Night Football Season

NBC's Sunday Night Football is among the most decorated and most watched programs in the history of television. It added to its jam-packed trophy case on Tu...

27/05/2026

Prime Videos John Ward and Mike Francis on Groundbreaking NBA on Prime Video Studio

The 2026 Sports Emmys marked a watershed moment for Prime Video Sports. After bu...

27/05/2026

Countdown to FIFA World Cup 2026: SVG Launches SportsTechLive Blog in Lead-up to Winter Games

With the Opening Match just over two weeks away, the entire sports-production-te...

27/05/2026

Spotify Brings Long-Form Magazine Articles to Audio

Spotify already brings together listeners' favorite music, podcasts, and audiobooks in one place. Now, we're trialing a new format that expands the cont...

27/05/2026

Podcast Clips Make Your Favorite Moments Easier to Save and Share

The best podcast moments deserve more than just a mental note. That's why today, we're making those moments easier to save and share with clips. Whethe...

27/05/2026

Spotify and Netflix Partner With Jay Shetty to Bring On Purpose' to Video Across Both Platforms

On Purpose is one of the most popular podcasts in the world, known for conversat...

27/05/2026

Olivia Rodrigo Brings Billions Club Live to Barcelona: Watch the Concert Film Now

On May 8, 1,500 of Olivia Rodrigo's top fans gathered in Barcelona's Tea...

27/05/2026

JZ Microphones announce the MU-1

Hybrid design combines large-diaphragm capsule & ribbon JZ Microphones have teamed up with Grammy-winning producer and engineer Marc Urselli to develop a ne...

27/05/2026

Tape Effects Collection from AIR Music Tech

Three new plug-ins inspired by classic tape effects AIR Music Tech's latest release delivers a set of plug-ins that aim to capture the character, moveme...

27/05/2026

The Crow Hill Company's Absurdly Quiet Piano goes Pro

Piano played on the edge of silence The Crow Hill Company's Vaults collection offers a continual rotation of instruments that are given away for free fo...

27/05/2026

Arturia release Memory V

Recreates Moog's iconic Memorymoog polysynth Arturia's vast software instrument range offers a combination of new and old, with innovative modern so...

27/05/2026

Accentize introduce free dxLevel plug-in

Offers loudness levelling for speech and dialogue Accentize have built up a solid reputation with their audio-restoration tools, and their latest plug-in is...