Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

North America Stories

19/03/2026

The Rise of Streaming, Particularly for Sports, Revives Loudness Issues

Live sports production increases complexity, with dynamic audio levels and an overall philosophy that encourages transient volume spikes Fourteen years ago, Am...

19/03/2026

Advanced Systems Group Names Peter Thordarson as Technical Account Executive

Advanced Systems Group, a technology and services provider for media creatives and content owners, announced the appointment of Peter Thordarson to the newly cr...

19/03/2026

SVG Students To Watch: Arya Taymuree, University of Washington

For this senior from the Bay Area, the speed and pressure of live sports production play right into her strengths In the live-sports-video industry, the future...

19/03/2026

Grass Valley Expands Partnership with University of Pittsburgh Athletics, Upgrading Production Infrastructure to SMPTE ST 2110 IP

Grass Valley has expanded its long-term partnership with University of Pittsburg...

19/03/2026

Audio-Technica Debuts ATV-SG1 and ATV-SG1LE On-Camera Shotgun Microphones

Audio-Technica has released the ATV-SG1 and ATV-SG1LE On-Camera Shotgun Microphones, designed for use with DSLR, mirrorless SLR, and other cameras. The ATV-SG1...

19/03/2026

NAB 2026: Harmonic Enhances XOS Advanced Media Processor to Streamline Next-Generation Broadcast Distribution

Harmonic (booth W2831) announces updates to its XOS Advanced Media Processor aim...

19/03/2026

DAZN and Top Rank Sign Multi-Year Rights Deal to Bring Marquee Events and Historic Archive to the Global Home of Boxing

DAZN and Top Rank have announced a multi-year partnership that will bring Top Ra...

19/03/2026

IHSE and Cyviz Announce Strategic Partnership

IHSE, a provider of KVM systems, has announced a partnership with Cyviz AS, a provider of technology solutions for collaboration and mission-critical operations...

19/03/2026

Net Insight appoints Larissa Grner-Meeus as Chief Product Officer (CPO)

Net Insight has appointed Larissa G rner-Meeus as Chief Product Officer. She joins the company's executive management team. G rner-Meeus holds a Dipl-Ing. ...

19/03/2026

Leader Appoints Rob Stanley as Regional Sales Manager UK & Northern Europe

Leader Electronics of Europe has appointed Rob Stanley as Regional Sales Manager for the UK and Northern Europe. In the role, he will manage key accounts and ha...

19/03/2026

FIFA and YouTube Team Up in FIFA World Cup 2026 Preferred Platform Agreement

FIFA has announced that YouTube will be a Preferred Platform for the FIFA World Cup 2026. Under the agreement, FIFA's Media Partners will be able to publis...

19/03/2026

Upgrade to NCAA March Madness Live App Expands Multi-Game Viewing, Enhances Second-Screen Experience

New features across mobile, connected devices, and automotive platforms undersco...

19/03/2026

PSSI Global Services Welcomes Ben Bradshaw as Director of Product and Network Development

PSSI Global Services has appointed Ben Bradshaw as Director of Product and Netwo...

19/03/2026

NAB 2026: Cobalt Digital to Unveil Additions to End-to-End IPMX and ST 2110 Ecosystem

Cobalt Digital has announced its NAB 2026 product lineup, which includes additio...

19/03/2026

Sportradar Releases Industry Outlook on the Future of U.S. Sports Viewing

Sportradar has released a new report, Innovation in Sports Media: The Next Era of Sports Viewing, examining how the sports viewing experience in the U.S. is evo...

19/03/2026

Matrox Video's ConvertIP Awarded in Rai Framework Agreement Supporting IP Modernization Strategy

Matrox Video has been awarded a three-year framework agreement to supply its Con...

19/03/2026

Controlled Chaos: Inside the Mighty Production Engine Behind the NCAA Men's Basketball Tournament's First Week

CBS Sports' Jason Cohen and TNT Sports' Chris Brown lead the charge on n...

19/03/2026

Loud and Fun Is the Goal for NCAA Tourney Audio

A1 Dave Grundtvig and his team deploy plenty of mics to capture the sounds and energy from the stands as well the court March Madness is a tournament in which ...

19/03/2026

Leader appoints Rob Stanley as Regional Sales Manager UK...

Test & measurement innovator, Leader Electronics of Europe, is pleased to announce the appointment of Rob Stanley as Regional Sales Manager - UK & Northern Euro...

19/03/2026

Accedo One and Magine Pro Officially Launch Leyra Deliver...

The recently announced joint venture between Accedo One and Magine Pro has been officially launched as Leyra. The new company will combine the two complementary...

19/03/2026

Lightware matrices are the go-to choice for signal manage...

Budapest, Hungary, March 2026 - Demand for traditional matrix switching remains strong across live events, rental and staging markets. With a reputation for rel...

19/03/2026

DPA Elevates 4097 Micro Shotgun With CORE Technology

DPA Microphones adds to its CORE microphone selection with the 4097 CORE Micro Shotgun, which delivers a new level of clarity, headroom and sonic transparency...

19/03/2026

Starfish highlights flexible TS Splicer releases and new...

Starfish Technologies will present the latest releases of its TS Splicer (Win) and TS Splicer (K8) at NAB Show 2026, together with a new Monitoring Dashboard de...

19/03/2026

TrueVisions Selects Bitmovin Observability

Bitmovin, a leading provider of video streaming solutions, has announced that TrueVisions NOW, a leading streaming platform in Thailand, and part of the TrueVis...

19/03/2026

Harmonic Enhances XOS Advanced Media Processor to Streaml...

Harmonic (NASDAQ: HLIT) today announced significant enhancements to its XOS Advanced Media Processor that lower the cost of broadcast distribution while enablin...

19/03/2026

Cobalt Digital to Unveil Additions to End to End IPMX and...

Cobalt Digital, the leading designer and manufacturer of award-winning signal processing products, and a founding partner in the openGear initiative has announ...

19/03/2026

Magewell Connecting Any Source Anywhere in Any Form Facto...

Magewell a developer of innovative, high-performance video I/O and IP workflow solutions will be at the 2026 NAB Show on booth C6113. In addition to several...

19/03/2026

Triveni Digital Expands NextGen TV Innovations and Suppor...

Triveni Digital, a trusted leader in ATSC 1.0 and ATSC 3.0 service delivery, data broadcasting and quality assurance solutions, today announced it will showcase...

19/03/2026

Imagine Communications to Showcase Purpose Led Innovation...

2026 NAB Show Exhibitor Preview April 19 22 Las Vegas Booth N.1328 Summary: At the 2026 NAB Show in Las Vegas, Imagine Communications will showcase the lat...

19/03/2026

Pebble demonstrates partnerships performance and future-r...

Broadcast playout leader highlights innovation and industry collaboration Pebble, the leading automation, content management and integrated channel specialist...

19/03/2026

Tuxera showcases stunning performance with Fusion SMB and...

Tuxera, a leading provider of quality-assured file systems and networking technologies, is highlighting remarkable advances in performance at NAB Show (booth N1...

19/03/2026

Intinor introduces enhanced SRT monitoring, HDR transport...

Intinor will showcase several new developments to the Direkt platform at NAB 2026, including enhanced SRT monitoring, expanded HDR transport capabilities and su...

19/03/2026

Caretta Research Finds Broadcasters Rebuild Live Operatio...

Broadcasters are rebuilding live operations workflows around IP delivery as satellite and dedicated fibre distribution decline, according to new research from C...

19/03/2026

Berklee Popular Music Institute's 24th Showcase Channels '80s Prom Nostalgia

Berklee Popular Music Institute's 24th Showcase Channels '80s Prom Nosta...

19/03/2026

Study: Creator Content Plays Growing Role in Streaming Habits

Share Copy link Facebook X Linkedin Bluesky Email...

19/03/2026

NAB Show: Studio Technologies to Debut New StudioComm System

Share Copy link Facebook X Linkedin Bluesky Email...

19/03/2026

Ateme Verified for YouTube Live

Share Copy link Facebook X Linkedin Bluesky Email...

19/03/2026

Roku Launches NCAA March Madness Zone

Share Copy link Facebook X Linkedin Bluesky Email...

19/03/2026

Harmonic Makes NextGen TV Upgrades to XOS Media Processor

Share Copy link Facebook X Linkedin Bluesky Email...

19/03/2026

FCC Removes More Drones from Covered List of Banned Products

Share Copy link Facebook X Linkedin Bluesky Email...

19/03/2026

How Chris Bolte Builds the Sound of PlayStation Games

How Chris Bolte Builds the Sound of PlayStation Games Chris Bolte '16 is a technical sound designer at Sucker Punch Productions, where he helps create the...

19/03/2026

The Highest Performing ISPs of 2025

Back to All News The Highest Performing ISPs of 2025 Product 19 March 2026 Global Link copied to clipboard Canada, South Korea, the United Kingdom, and th...

19/03/2026

The 'Alpha Males' Are Back: Season 5 Premieres on April 17 on Netflix

Back to All News The Alpha Males Are Back: Season 5 Premieres on April 17 on Netflix Entertainment 19 March 2026 GlobalSpain Link copied to clipboard Watc...

19/03/2026

NAB 2026: Software-Defined, AI-Powered Workflow Tells the Story of the New FOR-A America

Real-time 9:16 AI-Generated Autocropping; Software-Defined Station in a Box; and...

19/03/2026

Smooth Moves: 90 Frames-Per-Second Virtual Reality Arrives on GeForce NOW

It's a double feature on GFN Thursday. This week, GeForce NOW offers smoother sights in virtual reality (VR) and a sprawling new land to conquer. Streaming...

18/03/2026

Net Insight Names Larissa GrnerMeeus CPO

Newly named chief product officer (CPO), Larissa G rner Meeus will return to Net Insight on May 4. Larissa G rner Meeus will become CPO of Net Insight on May 4...

18/03/2026

SVG Europe's The Football Summit 2026: Select Sessions Now Available to Watch on SVG PLAY

SVG Europe's The Football Summit 2026 explored how the sports broadcasting i...

18/03/2026

SVG's SportsTech@NABShow Blog Goes Live as Countdown to Vegas Heats Up

The 2026 NAB Show kicks off one month from today and SVG is once again set to cover the show from every angle. SVG's SportsTech@NAB Show Blog is now live - ...

18/03/2026

The Premiere of Dead Lover Showcases Grave Robbing and Sex With a Giant Finger

(L-R) The cast and crew of Dead Lover at The Ray Theater for its premiere at the 2025 Sundance Film Festival. (Photo by Robin Marshall/Shutterstock for Sundan...

18/03/2026

SMPTE Unveils 2026 NAB Show Educational Presentations

SMPTE Unveils 2026 NAB Show Educational Presentations Brie Clayton March 18, 2026 0 Comments SMPTE , the home of media professionals, technologists, a...