Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

17/06/2026

EVS Achieves EcoVadis Gold Medal, Ranking in Top 5% of Companies Globally

EVS has announced it has received the EcoVadis Gold Medal for sustainability performance, ranking among the top 5% of companies globally in the Technology/Mid-S...

17/06/2026

Chyron Releases Weather 2.4 with Updated DataFlow Module

Chyron has released Weather 2.4, an update to its weather suite for broadcasters and meteorologists. The release focuses on enhancements to the DataFlow module,...

17/06/2026

VSiN Launches Best Bets TV, a 24/7 FAST Channel

VSiN, The Sports Betting Network, has announced the launch of Best Bets TV, a free ad-supported streaming TV (FAST) channel. The 24/7 channel is currently avail...

17/06/2026

Snapchat and Team Whistle Launch World Cup Creator Program Across Miami, New York, and Los Angeles

DAZN's Team Whistle and Snap Inc. have announced a creator program centered ...

17/06/2026

LiveU Supporting Broadcast and Public Safety Operations for Summer of Soccer

LiveU is providing video transmission technology for broadcasters, production companies, and public safety agencies across North America's busy Summer of So...

17/06/2026

NATAS Announces Two New Board Members and COO Promotion

The National Academy of Television Arts and Sciences (NATAS) has announced that Laurens Grant and Jacob Ullman have joined its Board of Directors. Chief of Staf...

17/06/2026

Akta Brings AI-First Cloud Video Workflows to Oracle Cloud Infrastructure

Akta, the AI-First SaaS video platform for modern broadcast and streaming operations, today announced that its video platform is now generally available on Orac...

17/06/2026

SVG Students to Watch: Nicholas Stafford, Texas Southern University

This recent graduate from Houston found inspiration in technical directing and now eyes a future career in sports production...

17/06/2026

InfoComm 2026: Audio-Technica Brings New Wireless, Networked Audio, and Certified Conferencing Solutions

Audio-Technica (booth C7959) arrives at InfoComm 2026 in Las Vegas with a slate ...

17/06/2026

SNS Positions AI Suite as On-Premise Answer to Video Indexing and Search Demands

SNS has published a guide addressing growing demand for AI-powered video indexing, transcription, facial recognition, and searchable metadata across media libra...

17/06/2026

Providius Announces Providius Direct for Network Troubleshooting on NETGEAR Pro AV Switches

Providius has announced Providius Direct, a workflow for investigating network i...

17/06/2026

NEP Launches NEP Platform Software Orchestration System, Selects Bridge Technologies VB440

NEP Group has announced the commercial availability of NEP Platform, a software ...

17/06/2026

BBright White Paper: SRT vs. RIST for Professional Video Contribution and Distribution

A new white paper examining Secure Reliable Transport (SRT) and Reliable Interne...

17/06/2026

Bango Research: 51% of Gen Z Say Highlights Are Replacing Live Games

New research from subscription bundling platform Bango finds that younger sports fans are increasingly consuming sport through highlights, clips, and social med...

17/06/2026

SMPTE Opens Entire Standards Library to Public at No Cost

SMPTE has announced that its complete Standards catalog is now freely available to the global media technology community, including all published SMPTE Standard...

17/06/2026

MediaKind Completes Merger with Harmonic's Video Business, Creating Independent Video Infrastructure Heavyweight

Harmonic has completed the sale of its Video Business to MediaKind for $145 mill...

17/06/2026

Omaha Productions to Produce 2026 World Series of Poker Main Event Coverage for ESPN

Omaha Productions will produce the 2026 World Series of Poker (WSOP) in Las Vega...

17/06/2026

SoundBridge 3.1.0 now available

New features, changes & bug fixes SoundBridge have just released another update for their remote collaboration-focused DAW - reviewed here in SOS March 2026...

17/06/2026

Fryette launch the Valvulator Mini

Valve-based front end for digital & modelling rigs The latest addition to Fryette's product range delivers a packed-down, pedalboard-friendly version of...

17/06/2026

The Biggest UK Pro Audio Show In 20 Years!

GearExpo UK - 27 June 2026 Sound On Sound are proud to announce GearExpo UK, a major new recording and music technology exhibition in London! This is the bi...

17/06/2026

Genelec introduce the 9402A System Management Device

SAM monitoring line-up gains Dante and AES67 support The latest expansion of Genelec's UNIO monitoring ecosystem introduces a new device that provides D...

17/06/2026

The R&SPR300 portable receiver from Rohde & Schwarz sets new standards in spectrum monitoring

The R&S PR300 portable receiver from Rohde & Schwarz sets new standards in spect...

17/06/2026

Elt Group and Rohde & Schwarz sign a cooperation agreement to explore commercial opportunities in electronic warfare and defense

Elt Group and Rohde & Schwarz sign a cooperation agreement to explore commercial...

17/06/2026

NABLF Graduates Its 2026 Broadcasting Leadership Training Class

Share Copy link Facebook X Linkedin Bluesky Email...

17/06/2026

ABC and ESPN Score Most-Watched NBA Finals Since 1998

Share Copy link Facebook X Linkedin Bluesky Email...

17/06/2026

Smartly, Roku Bring Social Performance Tools to CTV

Share Copy link Facebook X Linkedin Bluesky Email...

17/06/2026

Pliant Technologies Debuts Crewcom Flex at InfoComm 2026

Share Copy link Facebook X Linkedin Bluesky Email...

17/06/2026

The Immersive Supervisor Emerges as Hollywood's Next Production Role

The Immersive Supervisor Emerges as Hollywood's Next Production Role Brie Clayton June 17, 2026 0 Comments Above image: On set live immersive revi...

17/06/2026

Vertical Musical Playback Shot with Blackmagic PYXIS 6K

Vertical Musical Playback Shot with Blackmagic PYXIS 6K Brie Clayton June 17, 2026 0 Comments Large format sensor and DaVinci Resolve workflow used fo...

17/06/2026

DAZ 3D Launches New Game-Ready Character Assets Built for Modern Engines and Production Workflows

DAZ 3D Launches New Game-Ready Character Assets Built for Modern Engines and Pro...

17/06/2026

Spectrum Awards $1.1 Million in Digital Education Grants

Share Copy link Facebook X Linkedin Bluesky Email...

17/06/2026

XR Sports Alliance Adds New Members

Share Copy link Facebook X Linkedin Bluesky Email...

17/06/2026

AIMS Launches Free Online IPMX Training Series

Share Copy link Facebook X Linkedin Bluesky Email...

17/06/2026

Kiloview Partners with SFM to Expand AV-over-IP Solutions...

Montr al, Quebec, June 11, 2026 Kiloview, a leading provider of AV-over-IP and NDI -based video transmission solutions, today announced a distribution partner...

17/06/2026

Kiloview Launches U4 IP Video Dock Bringing Professional...

Changsha, China, June 15, 2026 Kiloview officially announced the launch of U4 IP Video Dock, a compact IP video decoder and output dock designed to bring prof...

17/06/2026

Half Year, Half Off! Ivory II Summer Sale is Here

Save 50% on All Ivory II Pianos and Collections Were halfway through the year, and we're cutting prices in half for the Ivory II Summer Sale! For a limite...

17/06/2026

Two in three fans will connect to venue WiFi this World Cup, Sky Business research reveals

Wednesday 17 June 2026 Two in three fans will connect to venue WiFi this World ...

17/06/2026

Visibility builds credibility - the tools you use every day...

Visibility builds credibility - the tools you use every day, now visible on your LinkedIn profile Published on Jun 17, 2026 Categories: Company News, Product ...

17/06/2026

Harmonic Completes Divestiture of Video Business to MediaKind

Transaction Positions Harmonic as a Pure-Play Broadband Company SAN JOSE, Calif. - June 17, 2026 - Harmonic Inc. (NASDAQ: HLIT), the worldwide leader in virtual...

17/06/2026

FOX Advertising To Launch Industry's First End-to-End Agentic Advertising Platform, Powered by FOX AdStudio

FOX Advertising To Launch Industry's First End-to-End Agentic Advertising Pl...

17/06/2026

Building resilience in an era of compounding threats

How SGN is future-proofing critical national infrastructure with Arqiva Managed Connectivity. When disruption becomes the norm As Storm Eunice tore across the ...

17/06/2026

Good Vibrations hit Dublin and Limerick as RT Concert Orchestra plays the music of the Beach Boys

The RT Concert Orchestra will bring the timeless music of The Beach Boys to aud...

17/06/2026

June 16, 2026

Calibr-Skaggs awarded $5.1M by NIH to develop long-acting hepatitis B virus therapy A new program aims to replace a daily HBV drug with once-monthly or even qua...

16/06/2026

Thomson launches new learning App

Thomson's highly regarded expert-led online learning courses are now easier to access on the go via our new App. Available now on Google Play Store, the J...

16/06/2026

Neumann MT 48 Receives Major Firmware 2.0 Update

Neumann.Berlin has released firmware version 2.0 for the MT 48 audio interface, adding plugin compatibility, expanded Dante networking options, broadcast encode...

16/06/2026

TVNewsCheck Opens Nominations for 2027 Women in Technology Awards

TVNewsCheck has announced that nominations are now open for its 2027 Women in Technology Awards, to be presented at NAB Show 2027 on Tuesday, April 6 in the Med...