Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

24/06/2026

NoiseWorks Audio add Mouth De-Click to VoiceAssist

Plus: VoiceAssist Basic now available to UA LUNA users NoiseWorks Audio have just released an update that adds a new Mouth De-Click module to the Advanced t...

24/06/2026

Gator introduce the Frameworks Studio Mic Boom 2000

New heavy-duty mic stand joins range The latest arrival to Gator's Frameworks family introduces a new heavy-duty boom stand that's been designed for...

24/06/2026

Waves V17 now available

Latest major plug-in update goes live Waves have just announced that the latest major update for their hugely popular plug-in range is now officially availa...

24/06/2026

Why Four Bars of Signal Doesn't Always Mean Good Performance

When assessing cellular coverage, many people look at the signal bars displayed on a smartphone, router or modem. More bars are often assumed to mean better per...

24/06/2026

Rohde & Schwarz THORIS sets new standard for counterUAS defense

Rohde & Schwarz THORIS sets new standard for counter UAS defense At Eurosatory 2026, Rohde & Schwarz is unveiling THORIS, a German engineered, sovereign count...

24/06/2026

Rohde & Schwarz expands voice communications modernization program for Egyptian air traffic control

Rohde & Schwarz expands voice communications modernization program for Egyptian ...

24/06/2026

Clear-Com FreeSpeak Cell Successfully Tested by RTL Deutschland in 5G Network at...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

24/06/2026

Nielsen's Q1 2026 Ad Supported Gauge

Streaming sets record high of 46.6% of ad supported TV viewing, driven by Super Bowl and Winter Olympics; overall share of ad supported TV remains steady NEW Y...

24/06/2026

FCC Flooded with Nearly 28K Comments Regarding Its Probe of 'The View'

Share Copy link Facebook X Linkedin Bluesky Email...

24/06/2026

Hearst Television Brings Ad Addressability to Local Broadcast TV

Share Copy link Facebook X Linkedin Bluesky Email...

24/06/2026

FCC Raises $3.5 Billion in AWS-3 Wireless Auction

Share Copy link Facebook X Linkedin Bluesky Email...

24/06/2026

RE:Vision Effects Announces Twixtor Standalone v 8.1 and a Sale!

RE:Vision Effects Announces Twixtor Standalone v 8.1 and a Sale! Brie Clayton June 24, 2026 0 Comments Twixtor v8.1 Standalone adds support for variab...

24/06/2026

Dreamtek Uses Full Blackmagic Workflow for Vercel Next JS Event

Dreamtek Uses Full Blackmagic Workflow for Vercel Next JS Event Brie Clayton June 24, 2026 0 Comments Blackmagic cameras, switchers, routers, recorder...

24/06/2026

Chyron LIVE Unveils New Features: Haivision StreamHub Integration, SCTE-35 Ad Insertion, and Refined Switching Tools

Chyron LIVE Unveils New Features: Haivision StreamHub Integration, SCTE-35 Ad In...

24/06/2026

Mapping an Education

Mapping an Education How composer Chloe Clarke Smith navigated her Boston Conservatory experience and brought new meaning to her work June 24, 2026 By Sara...

24/06/2026

The Next Act

The Next Act Dean Krisha Marcano's vision for a connected Theater Division, and the fund making it possible June 24, 2026 Photo by Eric Antoniou The Or...

24/06/2026

Announcing STAGES Magazine 2026

Announcing STAGES Magazine 2026 Marking a decade since Boston Conservatory and Berklee College of Music joined forces, this issue spotlights some of the groun...

24/06/2026

Rede Legislativa Chooses Appear to Support Brazil TV Ver...

In Brazil's TV 3.0 Trials, Appear's X5 is transporting live signals from Bras lia to S o Paulo over the public internet using secure, reliable next-gene...

24/06/2026

Mediaproxy partners with HVS for US broadcast market

Melbourne, Australia - 24 June 2026: Mediaproxy, the global standard for software-based IP compliance monitoring and multiviewing solutions, has named Heartland...

24/06/2026

Gray Media Launches Political 360 Digital Advertising Solution

Share Copy link Facebook X Linkedin Bluesky Email...

24/06/2026

Walmart to Pay $1.4 Billion to Acquire Ad Tech Firm Vibe.co

Share Copy link Facebook X Linkedin Bluesky Email...

24/06/2026

FCC Flooded with Nearly 28K Comments on 'The View'

Share Copy link Facebook X Linkedin Bluesky Email...

24/06/2026

First Rush Brings SDI Multicam ProRes Recording to Apple Silicon Macs

First Rush Brings SDI Multicam ProRes Recording to Apple Silicon Macs Brie Clayton June 23, 2026 0 Comments First Rush is a native macOS application d...

24/06/2026

Vertical Drama Beneath Crimson Sails Created with Blackmagic Design

Vertical Drama Beneath Crimson Sails Created with Blackmagic Design Brie Clayton June 23, 2026 0 Comments Thunder Child Productions relies on cameras&...

24/06/2026

X-Rite Pantone Adds MSI PRO MAX Displays to Pantone Validated Program for Proven Color Fidelity for Real World Colors

X-Rite Pantone Adds MSI PRO MAX Displays to Pantone Validated Program for Proven...

24/06/2026

Dara Briain forms Dara's Dull Appreciation Society for U

24th June 2026, London: Dara Briain will host brand new comedy entertainment series Dara's Dull Appreciation Society (4x40') celebrating members of th...

24/06/2026

Sky reveals wild new trailer and images for Shaun the Sheep: The Beast of Mossy Bottom

Wednesday 24 June 2026 Sky reveals wild new trailer and images for Shaun the Sh...

24/06/2026

Seven paradoxes shaping the next era of media production - Episode 1

Why Dynamic Media Facilities Matter In this series, we explore the technologies, architectures and operational realities shaping modern media operations. Along ...

24/06/2026

Comscore Announces Partnership with Amazon DSP to Expand Content Addressability to Drive Campaign Performance

Comscore Announces Partnership with Amazon DSP to Expand Content Addressability ...

24/06/2026

RT is supporting 21 Arts and Cultural Events all over Ireland this July

From Cork to Limerick to Earagail: RT is supporting 21 Arts and Cultural Events all over Ireland this July RT Supporting the Arts is delighted to spotlight...

23/06/2026

Case Study: YES Networks IP Transition Expands Production Possibilities and Redefines Workflows

When we began planning our transition from an SDI-based infrastructure to a new ...

23/06/2026

Imagine Communications Appoints Greg Garmon as SVP, Americas Video Sales

Imagine Communications has announced the appointment of Greg Garmon as Senior Vice President, Americas Video Sales. Garmon will oversee account growth and busin...

23/06/2026

Snap Promotes Emma Wakely to Head of Sports and Media Partnerships, Americas

Snap has promoted Emma Wakely to Head of Sports and Media Partnerships, Americas, succeeding Anmol Malhotra, who has been elevated to Global Head of Content and...

23/06/2026

YES Network and Gotham Sports App to Air MI New York Major League Cricket Matches

YES Network and The Gotham Sports App will air MI New York's Major League Cr...

23/06/2026

HAND Issues Persistent Digital IDs to 2026 NBA Draft Class

The Universal Talent Identifier (HAND) has issued HAND IDs to 34 top projected prospects in the 2026 NBA Draft class, including AJ Dybantsa, Cameron Boozer, and...

23/06/2026

World Boxing Launches World Boxing TV Streaming Platform

World Boxing has announced the launch of World Boxing TV, a subscription-based streaming platform built on the Joymo platform, offering live events, on-demand c...

23/06/2026

FloRacing to Stream 32 Off-Road Motorcycle Racing Events Including AMA Amateur National Motocross Championship

FloSports will stream 32 off-road motorcycle racing events on FloRacing, includi...

23/06/2026

SES Adds 14 Regional Channels and New Set-Top Boxes to ASTRA TV in Spain

SES has announced the expansion of its ASTRA TV platform in Spain with the addition of 14 regional channels in HD and UHD quality and the launch of new hybrid s...

23/06/2026

Appear Supports Rede Legislativas Contribution Workflow for Brazils TV 3.0 Trials

Appear ASA has announced its role in Rede Legislativa de R dio e TV's contri...

23/06/2026

PBS Selects LTN for Nationwide IP Video Network Across 330 Member Stations

LTN has announced that PBS has selected it as its IP video partner to modernize content distribution and contribution across more than 330 public television sta...

23/06/2026

Ease Live Powers Interactive Experience on Rally.TV for WRC

Ease Live has announced that its graphics overlay platform is powering an interactive fan experience on Rally.TV, the official streaming platform of the FIA Wor...

23/06/2026

Chyron LIVE Adds Haivision StreamHub Integration, SCTE-35 Ad Insertion, and Switcher Updates

Chyron has announced updates to Chyron LIVE, its cloud-native live production pl...

23/06/2026

ESPN Announces ESPN Fan House, Fan Engagement Hub Powered by Flowcode

ESPN has announced ESPN Fan House, a fan engagement hub powered by Flowcode, launching in August ahead of the 2026 college football season. Publicis Sports will...

23/06/2026

Sennheiser Relocates Americas Regional Hub to Nashville

The city's solid position in broadcast, entertainment, and sports attracted the major microphone manufacturer Sennheiser Group is moving its Americas Regio...

23/06/2026

Violet Audio's dMix 128 now shipping

128 channels of signal routing & DSP Announced just before the NAMM Show 2026, Violet Audio's latest digital audio matrix offers 128 channels of signal ...

23/06/2026

Minimal Audio launch Memory Rites

Latest Current expansion created by EPROM Minimal Audio have just launched the latest Current Expansion, Memory Rites. Designed in collaboration with renown...