Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

29/04/2026

Churchill Downs Racetrack Lifts Curtain on New Big Board Ahead of Kentucky Derby Week

It was a delicate job in a 150-year-old venue laden with traditions. Begun at th...

29/04/2026

How the MLS Innovation Lab Enhances Everything From Athlete Performance to Production to Ticket Sales

In annual event, the league gives startup companies the opportunity to prove the...

29/04/2026

Save the Date: SVG Venues & Teams Summit Travels South to Miamis Kaseya Center on Aug. 12

Panel discussions, networking, and a facility tour will take place in the renova...

29/04/2026

The Cast and Crew of Conbody VS Everybody Have Each Other's Backs for Life

(L-R) Derek Drescher, Coss Marte, and Syretta Wright have each other's backs. (Micheal Hurcomb/Shutterstock for Sundance Film Festival) By Veronika Lee Cla...

29/04/2026

Free Tilt EQ plug-in from Techivation

Combines EQ and harmonic distortion Techivation's latest release is a simple EQ designed to offer quick control over a source's overall tonal balanc...

29/04/2026

Expressive E launch the Osmose CE

Two new MPE controllers announced Expressive E caused quite a stir when they released the Osmose, making the sort of expression that was once reserved for p...

29/04/2026

iZotope RX 12 is here

New modules & enhanced machine-learning The latest version of iZotope's flagship restoration suite is now available, and now offers over 50 tools design...

29/04/2026

Surgeon Dr Jasmina Kevric wins 2026 Les Murray Award

Surgeon Dr Jasmina Kevric wins 2026 Les Murray Award 29 April, 2026 Media releases Australia for UNHCR and SBS are proud to announce that Dr Jasmina Kevric...

29/04/2026

YEP Spotlight: Julissa Padilla

Some people stumble into their passion. Julissa Padilla walked straight into a film vault. For her, entertainment was never just about the movies themselves. It...

29/04/2026

Clear-Com Promotes Brian Grahn, Ben Turnwell to Expanded Roles

Share Copy link Facebook X Linkedin Bluesky Email...

29/04/2026

The CW Unveils Major Streaming Deals with ESPN and Roku

Share Copy link Facebook X Linkedin Bluesky Email...

29/04/2026

Clear-Com Announces New Roles for Brian Grahn and Ben Tur...

Clear-Com has appointed Brian Grahn as Market Outreach Manager of the Americas and Ben Turnwell as Business Development Manager for EMEA live, expanding their ...

29/04/2026

Reduce Workflow Complexity with nxtedition at MPTS 2026

nxtedition is bringing its range of consolidated production tools to MPTS 2026, with new developments spanning transcription, editing, graphics and AI-assisted ...

29/04/2026

Telxius taps Synamedia to unlock seamless global multi-CD...

Quortex Switch to boost the streaming experience for Telxius customers, reaching millions of viewers worldwide Synamedia and Telxius, the leading global connec...

29/04/2026

freispace and Projective Announce Joint Showcase of Integ...

freispace, the leading ERP-as-a-Service platform for media and entertainment production, and Projective, a leading provider of post-production collaboration tec...

29/04/2026

DHD Celebrates 30th Anniversary at 2026 NAB Show

DHD reports strong interest in its broadcast audio product range, exhibited at the April 19th-22nd NAB Show in Las Vegas. The event attracted a claimed 58,000 a...

29/04/2026

Student Spotlight: Alan Catz

Student Spotlight: Alan Catz The Argentine film and game composer talks about working on League of Legends, receiving Berklee's BMI Award, and the lifelon...

29/04/2026

Jay Jennings Builds the Worlds You Hear on Screen

Jay Jennings Builds the Worlds You Hear on Screen The supervising sound designer behind A Minecraft Movie, The Meg, Letters from Iwo Jima, and dozens of other...

29/04/2026

Paramount Will be 49.5% Foreign Owned After WBD Merger

Share Copy link Facebook X Linkedin Bluesky Email...

29/04/2026

NAB Show 2026: AI, Vertical and BPS Dominate Broadcasters' Discussions

Share Copy link Facebook X Linkedin Bluesky Email...

29/04/2026

IAB Tech Lab Announces New OpenRTB Attributes

Share Copy link Facebook X Linkedin Bluesky Email...

29/04/2026

Katie Price: Nothing to Hide, a Sky Original documentary series from BAFTA-winning Mindhouse, coming this summer

Wednesday 29 April 2026 Katie Price: Nothing to Hide, a Sky Original documentar...

29/04/2026

Sky announces upcoming documentary series The Lie That Exposed The Truth

Re-examining the case of Ellie Williams and the wider story of grooming in the town of BarrowWednesday 29 April 2026 Sky announces upcoming documentary series ...

29/04/2026

Jennifer Garner to lead an all-star cast in new Sky Exclusive summer escape The Five Star Weekend, coming to screens this July

Wednesday 29 April 2026 Jennifer Garner to lead an all-star cast in new Sky Exc...

29/04/2026

'SUPERNOVA: GENESIS' Reached a Peak Audience of More Than 6.5 Million Viewers on Netflix

Back to All News SUPERNOVA: GENESIS Reached a Peak Audience of More Than 6.5 Mi...

29/04/2026

dB Sponsors College Sustainability Week

Students and staff from Hills Road Sixth Form College in Cambridge ran a 4.5km course around the roads of Cambridge as part of their annual programme of sustain...

29/04/2026

Listen to the birds sing! Experience mother nature in a seven-hour radio marathon

The Dawn Chorus airs Sunday 3 May from midnight to 7am on RT Radio 1 and RT ly...

29/04/2026

April 28, 2026

Jin-Quan Yu elected to the National Academy of Sciences Yu is recognized for his pioneering work in synthetic organic chemistry. April 28, 2026 LA JOLLA, CA S...

28/04/2026

Sound for the NFL Draft Show Balances Often Conflicting Goals

The audio team for the entertainment event must blend speech intelligibility with full-range music reproduction while considering the broadcast Last week's...

28/04/2026

Pac-12 Releases New Primary Mark Ahead of 2026-27 Season

The Pac-12 Conference has released an updated primary mark and logo as the starting point of the new league's brand identity. The mark was soft-launched acr...

28/04/2026

DP World Tour to Become First Professional Sports Organization to Use Amazon Leo Satellite Connectivity

The DP World Tour and Amazon Leo have signed an agreement making Amazon's lo...

28/04/2026

Pixellot and HELIOS Announce Automated Hockey Shift Video Integration

Pixellot and HELIOS have announced an integration that automatically converts full-game hockey video into individualized shift videos for each athlete, without ...

28/04/2026

Daktronics Installs New LED Video Display at Asheville Tourists Ballpark

Daktronics has partnered with the Asheville Tourists to manufacture and install a new LED video display. The installation was completed in late 2025 and is now ...

28/04/2026

Eutelsat and PCTV Renew Long-Term Video Distribution Partnership in Mexico

Eutelsat has announced the renewal of its partnership with PCTV, a content aggregation and distribution company in Mexico and part of Megacable Holdings, for co...

28/04/2026

Gary SouthShore RailCats Install New Daktronics LED Display at U.S. Steel Yard

Daktronics has partnered with the Gary SouthShore RailCats to install a new LED video display at U.S. Steel Yard, replacing the previous Daktronics display inst...

28/04/2026

Telos Alliance and College Radio Foundation Award Omnia.11 Processor to Wright State Universitys WWSU-FM

Telos Alliance and the College Radio Foundation have announced that WWSU-FM of W...

28/04/2026

Inside the Mix: A1s Florian Brown and James Deason on Golfs Biggest Broadcasts

Golf viewership is growing. The 2025 Ryder Cup drew five million viewers in the UK, a 45% increase over the 2023 event. The US Open was the most streamed golf e...

28/04/2026

The CW Network Acquires Exclusive Broadcast Rights to WWE NXT Premium Live Events

The CW Network and WWE, part of TKO Group Holdings (NYSE: TKO), have announced t...

28/04/2026

NAB 2026: AIMS Wins NAB Show 2026 Product of the Year Award for IPMX

The Alliance for IP Media Solutions (AIMS) has announced that the Internet Protocol Media Experience (IPMX) suite of standards and specifications has been named...

28/04/2026

NAB 2026 SportsTechBuzz in Review: A Look Back at the Big News From 150+ Companies in Vegas

The 2026 NAB Show is in the books and the show once again served up a cavalcade ...

28/04/2026

Gray Media, RAJ Sports Launch New Womens Sports RSN in Portland - Rose City SportsNet

Gray Media and RAJ Sports have announced Rose City SportsNet (RCSN), a new netwo...

28/04/2026

Spotify Reports First Quarter 2026 Earnings

Today, we announced our First Quarter 2026 earnings, starting the Year of Raising Ambition with strong momentum across the business and continued innovation acr...

28/04/2026

Spotify rapporterar resultat fr frsta kvartalet 2026

I dag presenterade vi v rt resultat f r det f rsta kvartalet 2026. Vi inleder ret med starkt momentum i hela verksamheten och fortsatt innovation p plattforme...

28/04/2026

Mojave introduce the MA-C vocal mic

New handheld promises studio performance for the stage Mojave have just introduced a new live-focused handheld vocal mic created by award-winning designer D...