Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

16/10/2025

SVG Sit-Down: FUJIFILM Execs on GFX ETERNA 55 Camera, Importance of Shallow-Depth-of-Field Production

SVG Sit-Down: FUJIFILM Execs on GFX ETERNA 55 Camera, Importance of Shallow-Dept...

16/10/2025

Squash's Most Ambitious Broadcast Production To Be Deployed at Comcast Business U.S. Open

Squash's Most Ambitious Broadcast Production To Be Deployed at Comcast Busin...

16/10/2025

Main Street Sports Group Inks Deal With Omaha Productions, Launches Original-Content Division

Main Street Sports Group Inks Deal With Omaha Productions, Launches Original-Con...

16/10/2025

A Historic Precursor? FIFA, HBS, DAZN Offer an Inside Look at Production of FIFA Club World Cup 2025

A Historic Precursor? FIFA, HBS, DAZN Offer an Inside Look at Production of FIFA...

16/10/2025

Prime Video Offers Sneak Peak at New NBA on Prime Studio

Prime Video Offers Sneak Peak at New NBA on Prime StudioThe massive 13,000-sq-ft, two-story studio features a LED regulation half court and hoopBy Jason Dachman...

16/10/2025

SVG Remote Production Forum Draws Record Crowd for Visit to PGA TOUR Studios, Deep Dive Into REMI Workflows

SVG Remote Production Forum Draws Record Crowd for Visit to PGA TOUR Studios, De...

16/10/2025

BitFire's Ben Grafchik on How Growing Cloud Workflows Are Impacting the Live-Sports World

BitFire's Ben Grafchik on How Growing Cloud Workflows Are Impacting the Live...

16/10/2025

CultureCon Uncut' Video Podcast Returns for Season 2 With Host Imani Ellis

In 2017, Imani Ellis launched CultureCon, a conference that's become a must-attend event for more than 10,000 diverse creatives and Black professionals to c...

16/10/2025

Fresh Spins on Holiday Standards: The 2025 Spotify Singles Have Arrived

It might still be a little early to break out the tinsel and mistletoe, but Spotify's already queuing up some holiday magic. This year's Spotify Singles...

16/10/2025

Spotify to Publish First Independent Author Releases Through Audiobook Selects, With More Planned Ahead

Earlier this year, our in-house publishing imprint, Spotify Audiobooks, put out ...

16/10/2025

L3Harris Integrates VAMPIRE Aboard GM Defense's Infantry Squad Vehicle

VAMPIRE has been integrated onto GM Defenses Infantry Squad Vehicle (ISV), providing a mobile solution to effectively and affordably counter small drone threat...

16/10/2025

Unseen and Unmatched: L3Harris Marks a First in Infrared Tracking Technology

The AgilePod mounted on the host aircraft....

16/10/2025

Consumer attitudes toward in-car entertainment and media preferences highlighted in new Gracenote automotive report

60% say infotainment systems are a critical purchasing or leasing consideration,...

16/10/2025

Broadcasters Foundation Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign, which seeks to raise donations from tax-deductible personal and ...

16/10/2025

Roku Adds Live Sports Scores, AI-Powered Voice Discovery, New Hardware

Roku has added several new features to its user interface and operating system meant to make it easier to discover and personalize content, the company said....

16/10/2025

CNN to Launch New All Access Subscription Tier Oct. 28

NEW YORK CNN has announced that its All Access subscription tier will launch in the U.S. on Oct. 28, providing audiences with a centralized destination for CNN&...

16/10/2025

Student Spotlight: Alan Villanueva

Student Spotlight: Alan Villanueva The graduate student and saxophonist, who performed on Natalia Lafourcades Latin Grammy-nominated Live at Carnegie Hall alb...

16/10/2025

XR Sports Alliance Announces New Members

The XR Sports Alliance (XRSA) has announced the third cohort of members. The new members include Maple Leafs Sports & Entertainment (MLSE), the Vegas Golden Kni...

16/10/2025

Broadcasters Foundation of America Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign which seeks to raise donations from tax-deductible personal and c...

16/10/2025

Australia's Nine to Broadcast Live NHL Games

NEW YORK Australia's Nine Network and the NHL today announced a media partnership that will bring the world's premier professional ice hockey league to ...

16/10/2025

Study: 45% of U.S. Internet Households Now Watch FAST Services

Parks Associates has released new data showing that nearly half (45%) of U.S. internet homes watch free ad-supported streaming TV (FAST) services and 89% of U.S...

16/10/2025

J.D. Power: Wireless Internet Signups Soar Over Last 6 Months

TROY, Mich. -New data from J.D. Power's 2025 U.S. Residential Internet Service Provider Study shows that residential wireless internet providers are growing...

16/10/2025

Shakespeare & Hathaway: Private Investigators recommissioned for sixth series, as filming gets underway in Stratford-Upon-Avon

TV's most charming detective drama * Shakespeare & Hathaway: Private Investi...

16/10/2025

Thailand's Legendary Outlaw Returns: Tee Yai: Born to be Bad' Premieres November 13

Back to All News Thailand's Legendary Outlaw Returns: Tee Yai: Born to be ...

16/10/2025

Christmas Is Just Around The Corner: 'Home For Christmas' Season 3 is Coming to Netflix on December 12

Back to All News Christmas Is Just Around The Corner: Home For Christmas Season...

16/10/2025

Tristn Ulloa Stars in 'El crimen de Pazos', the New Netflix Series Inspired by a True Story

Back to All News Trist n Ulloa Stars in El crimen de Pazos, the New Netflix Ser...

16/10/2025

ABS Completes Redomiciliation to Dubai Development Authority as Part of Strategic Transformation

ABS Completes Redomiciliation to Dubai Development Authority as Part of Strategi...

16/10/2025

KATJA MIA ANNOUNCED AS NEW 2FM WEEKEND PRESENTER

This Saturday October 18 Katja Mia will burst onto the radio airwaves for the first time as she joins 2FM. Katja will be standing in for Bl thnaid Treacy on Sat...

16/10/2025

RT is Supporting 39 Arts and Cultural Events across Ireland this October

This October, RT is delighted to support Wexford Festival Opera, Babor International Arts Festival for Children, Open House Dublin and 36 other arts and cultu...

16/10/2025

Ready, Set, Reward - GeForce NOW Membership Rewards Await

GeForce NOW is more than just a platform to stream fresh games every week - it offers celebrations for the gamers who make it epic, with member rewards to sweet...

15/10/2025

Reporting that changes lives: Announcing the Young Journalist finalists 2025

Across the world, early-career reporters are interrogating systems that shape daily life, from mortuaries and classrooms to the corridors of legal education and...

15/10/2025

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open Video

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open VideoThe NHL franchise worked with production firms 2WEI and 4th Floor CreativeBy Mark J Burns,...

15/10/2025

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsorships

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsors...

15/10/2025

The Remaining Native Team on the Sundance Institute Labs, Community and More

By Paige Bethmann Before my grandmother passed away in 2019, I went to visit her in the hospital where she'd been for a few weeks. When I arrived, the nurs...

15/10/2025

Spotify Celebrates Two Years of Audiobooks in Premium, Fueling Growth and Discovery Across the Publishing World

Two years ago, Spotify set out to grow the entire publishing industry by making ...

15/10/2025

DJ Levels Up With Spanish-Language Requests, Text Requests, and Personalized Prompts

People turn to DJ for a listening experience that feels personal, dynamic, and j...

15/10/2025

DJ evoluciona con solicitudes en espaol, peticiones por texto y recomendaciones personalizadas

Las personas recurren a DJ para vivir una experiencia de escucha personal, din m...

15/10/2025

Bruce Springsteen and Jeremy Allen White Unite in London for an Exclusive Spotify Conversation and Film Preview

Rock legend Bruce Springsteen and luminary actor Jeremy Allen White came togethe...

15/10/2025

Meet Spotify's RADAR Creators Global Class of 2025, the Next Wave of Podcast Talent

At Spotify, we're all about supporting rising talent and helping them connec...

15/10/2025

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS On Demand

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS ...

15/10/2025

SBS celebrates the Festivals of Lights with bold, illuminating stories across the network

SBS celebrates the Festivals of Lights with bold, illuminating stories across th...

15/10/2025

Seeking Astrobiological Potential Millions of Miles from Earth

One of humanity's most profound questions continues: Is there any place in our galaxy suitable for life beyond Earth? NASA intends to find out, with the hel...

15/10/2025

Austin PBS Expands Facility-Wide Production Communications with Clear-Com

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

15/10/2025

Scality debuts industry-first AI certifications with more...

Scality, a global leader in cyber-resilient storage software for the AI era, today announced the advancement of its comprehensive AI ecosystem certification pro...

15/10/2025

2026 HPA Tech Retreat to Deliver Insight Innovation and I...

The Hollywood Professional Association (HPA) today unveiled key highlights of the 2026 HPA Tech Retreat, scheduled for Feb. 15 19 at the Westin Rancho Mirage Go...

15/10/2025

Interra Systems Drives Quality Compliance and Monetizatio...

At NAB Show New York 2025 (Stand 244), Interra Systems will showcase the future of media QC, monitoring, and captioning, highlighting its award-winning, AI- and...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transitio...

Grass Valley today announced that RMC BFM, part of the CMA-CGM Group and France's third-largest private media group, has chosen Grass Valley's productio...