Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

Most recent headlines

20/11/2025

Rise Awards 2025 Celebrate the Industry's Best

LONDON The winners of the Rise Awards 2025, which recognize women and companies whose achievements have stood out in the media technology industry, have been an...

20/11/2025

Lionsgate, Debmar-Mercury Launch MovieSphere Gold Diginet

SANTA MONICA & NEW YORK Lionsgate's Worldwide Television Distribution Group and Debmar-Mercury have launched MovieSphere Gold in more than 30 million homes....

20/11/2025

Clear-Com Unveils New 4-Channel HelixNet Beltpack

ALAMEDA, Calif. Clear-Com has introduced its four-channel HelixNet beltpack, a next-generation advancement of its widely used two-channel model, and anticipates...

20/11/2025

Kiswe Core Aims to Simplify Cloud-Based Streaming Distribution

NEW PROVIDENCE, N.J. Streaming technology and services provider Kiswe has launched Kiswe Core, a next-generation cloud-based platform designed to simplify the s...

20/11/2025

Dolby Partners Up With Bay Area Super Bowl Host Committee

MOUNTAIN VIEW, Calif. Dolby Laboratories has signed on as an official signature partner of the Bay Area Host Committee (BAHC) for the 2026 Super Bowl and the we...

20/11/2025

Telus TV+ Expands Distribution to Samsung and LG Smart TVs

STUTTGART, Germany 3 Screen Solutions (3SS) has announced that the Canadian multiservice operator Telus has launched its Telus TV+ entertainment platform on Sam...

20/11/2025

MLB Strikes Rights Deals With ESPN, NBCUniversal, Netflix

Major League Baseball has announced deals with ESPN, NBCUniversal and Netflix covering 2026-2028 that make ESPN the exclusive rightsholder of MLB.TV, see regula...

20/11/2025

Berklee Presents Holiday Extravaganza: Duke Ellingtons The Nutcracker Suite and GenNext All-Stars' Noel

Berklee Presents Holiday Extravaganza: Duke Ellingtons The Nutcracker Suite and ...

19/11/2025

Sphere Sound Kicks Up Its Heels at Radio City Music Hall

Sphere Sound Kicks Up Its Heels at Radio City Music HallUltra-immersive system from the singular Las Vegas venue is also ready for sportsBy Dan Daley, Audio Edi...

19/11/2025

The Future of Stadium and Arena Video Control Rooms: Tech Leaders Talk 4K, IP, and More

The Future of Stadium and Arena Video Control Rooms: Tech Leaders Talk 4K, IP, a...

19/11/2025

One Year at Intuit Dome: Walking Through the Stunning Arena's Advanced Video Production Layout with the LA Clippers

One Year at Intuit Dome: Walking Through the Stunning Arena's Advanced Video...

19/11/2025

SVG Sit-Down: IMG's Francois Westcombe Goes Inside IMG's Annual Digital Trends Report

SVG Sit-Down: IMG's Francois Westcombe Goes Inside IMG's Annual Digital ...

19/11/2025

Inside Brighton & Hove Albion's Fan-First Media Machine

Inside Brighton & Hove Albion's fan-first media machine By George Bevir Tuesday, November 18, 2025 - 10:10 Print This Story Brighton & Hove Albion'...

19/11/2025

Rock Chalk Rebuild, Part 1: Kansas Athletics Brings New Production Power to Rebuilt David Booth Kansas Memorial Stadium

Rock Chalk Rebuild, Part 1: Kansas Athletics Brings New Production Power to Rebu...

19/11/2025

Rock Chalk Rebuild, Part 2: A Pro's Guide to Kansas Athletics' New Video-Production Infrastructure

Rock Chalk Rebuild, Part 2: A Pro's Guide to Kansas Athletics' New Video...

19/11/2025

MLB Media Rights Shakeup: NBC Inks Three-Year Deal for Sunday Night Baseball, Peacock Exclusive Game, and More

MLB Media Rights Shakeup: NBC Inks Three-Year Deal for Sunday Night Baseball, Pe...

19/11/2025

Sabar Bonda (Cactus Pears) Takes a Tender View on Queer Relationships

Rohan Parashuram Kanawade attends the premiere of Sabar Bonda (Cactus Pears) at the 2025 Sundance Film Festival at Egyptian Theatre on January 26, 2025, in Pa...

19/11/2025

Sundance Institute-Supported Seeds, Apocalypse in the Tropics, Selena y Los Dinos, and More Earn IDA Documentary Awards Nominations

Awards season is heating up, and the International Documentary Association just ...

19/11/2025

L3Harris Breaks Ground on Arkansas Advanced Propulsion Facilities

Aerojet Rocketdyne President Ken Bedingfield and Arkansas Gov. Sarah Huckabee Sanders were joined by state and local officials to celebrate the groundbreaking o...

19/11/2025

L3Harris and PentenAmio Team to Advance Sovereign Cryptographic Capability and Innovation in the UK, Australia and Canada

L3Harris and PentenAmio formalise their teaming agreement at MilCIS 2025, streng...

19/11/2025

Multi-year partnership for Calrec and Phoenix Broadcast Solutions

Calrec gives Phoenix Broadcast Solutions its full support in strategic multi-year enterprise partnership New Singapore OB company invests in Calrec technology f...

19/11/2025

The Gauge: Poland | October 2025

October brings a larger audience in front of TV screens. The cooler autumn weather and the continuation of new programming schedules brought increases in both t...

19/11/2025

Nexstar Urges FCC to Waive Ownership Rules, Quickly Approve Tegna Acquisition

IRVING, Texas Nexstar Media Group and Tegna filed applications on Nov. 18 with the Federal Communications Commission (FCC) seeking its consent to transfer broad...

19/11/2025

Vitec Buys Datapath, Expanding Product Portfolio, Engineering, Support

Vitec has acquired Datapath, a developer of real-time video processing for large-scale video walls, AVoIP content distribution and KVM control in mission-critic...

19/11/2025

Telestream Unveils ARGUS V2.3 With Live Look Stream Validation

NEVADA CITY, Calif. Telestream has introduced ARGUS Version 2.3, which introduces Live Look, a feature that lets operators inspect live and on-demand streams vi...

19/11/2025

Charter Taps AWS for Generative AI Solutions

STAMFORD, Conn. and NEW YORK Charter Communications, Inc. has announced a major deal with Amazon Web Services (AWS) that establishes AWS as one of Charters stra...

19/11/2025

Atomos Adds New Camera Control Features to Ninja TX

TOKYO Atomos has announced a major firmware update that brings integrated camera control to the Ninja TX GO and Ninja TX its new CFexpress-based monitor-recor...

19/11/2025

Berklee's Signature Series Reimagines the Musical and Visual Artistry of Coldplay

Berklee's Signature Series Reimagines the Musical and Visual Artistry of Col...

19/11/2025

PlayBox Neo Wraps NAB Show New York 2025 with Big Energy...

PlayBox Neo departed the NAB Show New York 2025 on a high note. The company's all-new PlayBox Neo Suite made a splash on the show floor, drawing strong inte...

19/11/2025

AAVBR Boosts Event Production Efficiency With Pliant Tech...

AAVBR (American Audio Visual Baton Rouge), a leading full-service event production company serving Louisiana and the Gulf Coast region, has enhanced its product...

19/11/2025

Calrec gives Phoenix Broadcast Solutions its full support...

In its mission to deliver live event services combining advanced engineering with a creative approach to captivating live sports and entertainment experiences, ...

19/11/2025

Popularity of Online Short-Form Content Moving Beyond Social Media

NEW YORK Short-form vertical video has exploded across platforms like TikTok, Instagram and YouTube, but a new survey commissioned by Media.net, a provider of c...

19/11/2025

YES Network, CAMB.AI Strike AI Translation Partnership

NEW YORK YES Network, the regional sports network home of the New York Yankees and Brooklyn Nets, and CAMB.AI have struck a partnership they said will leverage ...

19/11/2025

FCC Releases New Filing Deadlines

WASHINGTON The Federal Communications Commission has issued detailed guidance on filings that were disrupted by the government shutdown. While many of those fil...

19/11/2025

NFL's Popularity Advances TV Seasonal Viewership Growth

NEW YORK The popularity of NFL games is largely responsible for continued seasonal momentum in TV viewership into October (measured Sept. 29-Oct. 26), according...

19/11/2025

MyFree DirecTV Adds Seven New Channels

DirecTV has announced that its MyFree DirecTV streaming service has added seven new channels. Those include four sports services, NBA FAST, Red Bull TV, DAZN Ri...

19/11/2025

MRMC's Flair Bridge Simplifies Robot Control Across Any Platform

SURREY, U.K. Mark Roberts Motion Control (MRMC) has launched Flair Bridge, a compact device that transforms how operators control the company's motion-contr...

19/11/2025

FCC Sets Deadlines for 2022 Quadrennial Review

WASHINGTON The Federal Communications Commission, which is continuing to rapidly ramp up its operations after the end of the federal government shutdown, has se...

19/11/2025

Nexstar Urges FCC to Waive Ownership Rules, Quickly Approve of Tegna Acquisition

IRVING, Texas Nexstar Media Group and Tegna filed applications on Nov. 18 with the Federal Communications Commission (FCC) seeking its consent to transfer broad...

19/11/2025

Rohde & Schwarz collaborates with Broadcom to enable testing and validation of next-gen Wi-Fi 8 chipsets

Rohde & Schwarz collaborates with Broadcom to enable testing and validation of n...

19/11/2025

Innato, starring Imanol Arias and Elena Anaya, arrives on Netflix in Spain on December 12

Back to All News Innato, starring Imanol Arias and Elena Anaya, arrives on Netf...

19/11/2025

Guillermo del Toro Sits Down With 'Troll 2' Director Roar Uthaug to Discuss Creatures and Folklore

Back to All News Guillermo del Toro Sits Down With Troll 2 Director Roar Uthaug...

19/11/2025

A Look Behind Luxembourg's Most Ambitious Broadcast

Some projects feel monumental from the moment the first phone call comes in. When BCE, the host broadcaster appointed to coordinate the national coverage, asked...

19/11/2025

Bay Area Host Committee And Dolby Partner To Deliver Immersive Fan Experiences

November 19 2025, 08:00 (PST) BAY AREA HOST COMMITTEE AND DOLBY PARTNER TO DELIVER IMMERSIVE FAN EXPERIENCES During the Week of Football's Biggest Game...

19/11/2025

New RT documentary on the life of former President Michael D. Higgins

Michael D. Higgins: Ireland's Ninth President features RT Archives footage and interviews across seven decades Watch Wednesday 19 November at 9:35pm on RT...

19/11/2025

November 18, 2025

Scripps Research scientists receive $1.1 million to advance AI modeling for HIV vaccine development New AI system helps scientists rapidly pinpoint the most pro...

18/11/2025

AGILE: Securing the Future of Independent Journalism

Independent media across Central America are operating under intensifying financial pressure, yet there is a clear appetite for models that can sustain both ind...