Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

04/03/2026

Lega Basket Serie A Modernizes Media Operations Across Italian Basketball with ScorePlay

Lega Basket Serie A (LBA), the governing body for Italy's premier basketball...

04/03/2026

To Mark Five Years at Wrexham AFC, Co-Chairmen Rob Mac and Ryan Reynolds Will Host Broadcast During Wrexham-Swansea City on March 13

Wrexham AFC co-chairmen Rob Mac and Ryan Reynolds will host a first-of-its-kind ...

04/03/2026

FOX Sports Marks 100 Days to FIFA World Cup 2026 with Company-Wide Celebration

The countdown is underway and with just 100 days to go until the world's greatest sporting event begins on Thurs., June 11, FOX Sports, America's Englis...

04/03/2026

Exchange, NBCUniversal Team Up to Provide Service Members with Free Streaming of Paralympic Winter Games

No matter where they are in the world, service members and veterans can stream N...

04/03/2026

Telemundo Releases Somos Ms, the Official Anthem of its FIFA World Cup 2026 Coverage

Telemundo officially releases Somos M s, the anthem for the network's cove...

04/03/2026

Hollywood Professional Association Concludes 2026 HPA Tech Retreat

The Hollywood Professional Association (HPA) concluded the 2026 HPA Tech Retreat, convening more than 800 industry leaders, technologists, creatives, and execut...

04/03/2026

Case Study: How SEG+ Unified Utah's Biggest Sports Teams into a 40%+ Subscriber Growth Streaming Platform

Smith Entertainment Group transformed how local sports are consumed by creating ...

04/03/2026

SVG in Indy: Pacers Sports & Entertainment Remotely Produces Broadcasts of G League's Noblesville Boom

The production method, which spans a distance of 36.2 miles, was designed and im...

04/03/2026

Haivision Releases Seventh Annual Broadcast Transformation Report, Highlights Key Trends Shaping Live Production in 2026

Haivision, a global provider of mission-critical, real-time video networking and...

04/03/2026

SVG Sit-Down: Quantum CEO Hugues Meyrath on Reshaping the Company, the Impact of AI, Evolving Media Storage

When Hugues Meyrath came out of retirement to take the helm as CEO of Quantum, i...

04/03/2026

As Banana Ball Expands Exponentially, So Too Do Its Production Capabilities

Last week's launch of Banana Ball Championship League has spurred a significant upgrade of production facilities The Savannah Bananas, arguably the hottest...

04/03/2026

Press Release TEST

sldkfjsdlfkjsldkfjsldkjfslkdjfslkdjfsl Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus...

04/03/2026

Spotify A/Presenta Brings Fans Closer to Artists' Creative Process in Latin America, Starting With ROSALA

For many fans, a song's backstory can be just as compelling as the final pro...

04/03/2026

Spotify Kicks Off Our 20th Anniversary at SXSW With a Celebration of Artists, Creators, and Fans

In 2006, Spotify was founded on the belief that technology could bring artists a...

04/03/2026

Spotify and Coca-Cola Saddle Up for a Rhinestone Cowboy Experience at the Houston Rodeo

Spotify is back on the ground for the Houston Livestock Show and Rodeo, and we&#...

04/03/2026

Spotify Doubles Down on Investments in Australian Fan Discovery of Homegrown Aussie Talent

Spotify had an energizing week in Sydney, Australia, filled with powerful conver...

04/03/2026

FKA twigs and Jordan Hemingway Explore the Making of HARD' in Episode Two of Directed By'

Earlier this year, we launched Directed By, a documentary-style series that pull...

04/03/2026

100 Days to Go: SBS Unveils World Class Team for The Greatest Show on Earth -The FIFA World Cup 2026

100 Days to Go: SBS Unveils World Class Team for The Greatest Show on Earth -The...

04/03/2026

KT and Rohde & Schwarz to showcase AI-enhanced radio transmission performance

KT and Rohde & Schwarz to showcase AI-enhanced radio transmission performance In a joint 6G AI proof-of-concept demonstration, the CMX500 one-box tester from ...

04/03/2026

APTS Announces Public Broadcast Leadership, Advocacy Awards

Share Copy link Facebook X Linkedin Bluesky Email...

04/03/2026

SES publishes 2025 Annual Report

Luxembourg, 3 March 2026 - SES S.A. has today published its 2025 Annual Report, following the announcement of the company's full year financial results for ...

04/03/2026

NBC Sports, USA Sports Extend Rights Deal with PGA

Share Copy link Facebook X Linkedin Bluesky Email...

04/03/2026

Broadcasters Gather in DC for NAB State Leadership Conference

Share Copy link Facebook X Linkedin Bluesky Email...

04/03/2026

Transforming Africa's Future Farmers: Satellite-Enabled IoT Powers Data-Driven Agribusinesses

Luxembourg, March 3, 2026 - SES, a leading space solutions company, along with I...

04/03/2026

VEON Partners with GSMA Innovation Fund to Accelerate Digital Innovation in Pakistan and Bangladesh

04 Mar 2026 VEON Partners with GSMA Innovation Fund to Accelerate Digital Innov...

04/03/2026

VEON's Beeline Uzbekistan and Rakuten Symphony Partner for Open RAN, AI Collaboration

04 Mar 2026 VEON's Beeline Uzbekistan and Rakuten Symphony Partner for Open...

04/03/2026

Sky Sports unveils plans for 2026 Formula 1 coverage

Wednesday 4 March 2026 Sky Sports unveils plans for 2026 Formula 1 coverage Sky Sports is preparing for one of the most highly anticipated F1 seasons in recen...

04/03/2026

Bloodhounds' Season 2 Gears Up for April 3 Premiere with Hard-Hitting New Teaser and Poster

Back to All News Bloodhounds' Season 2 Gears Up for April 3 Premiere with ...

04/03/2026

Netflix Ads Suite Expands Capabilities

Back to All News Netflix Ads Suite Expands Capabilities Business 04 March 2026 GlobalUnited States Link copied to clipboard After launching the Netflix Ad...

04/03/2026

March 02, 2026

Scripps Research welcomes healthcare innovator Joe Kiani to the Board of Directors Kiani brings decades of experience in patient safety and public service. Mar...

04/03/2026

March 03, 2026

Nanoparticle vaccine approach takes on a new target: Hepatitis C virus Scripps Research scientists reengineer critical proteins on the surface of HCV, paving th...

03/03/2026

LIV Golf, Beyond Sports Elevate Online Gaming Ecosystem with Launch of LIV Golf Fantasy and LIV X

Beyond Sports, a Sony group company, and LIV Golf, the world's golf league, ...

03/03/2026

Ilitch Sports + Entertainment Announces Launch of Detroit SportsNet

Ilitch Sports + Entertainment announces the launch of Detroit SportsNet (DSN), a year-round broadcast home for two of Detroit's franchises. With flexible op...

03/03/2026

Advanced Systems Group Promotes Gretchen Taipale to Vice President, Managed Services

Advanced Systems Group, LLC (ASG), a technology and services provider for media ...

03/03/2026

PGA of America, NBC Sports, and USA Sports Extend Media Rights Agreement Through 2033

The PGA of America, NBC Sports and USA Sports extend their media rights agreemen...

03/03/2026

HONOR, ARRI Announce Technical Collaboration to Bring ARRI Image Science into Next-Gen Consumer Devices

AI device ecosystem company HONOR enters into a strategic technical collaboratio...

03/03/2026

Telos Alliance Partners with College Radio Foundation to Support College Broadcasters

Cleveland's Telos Alliance, pioneers in broadcast technology for 30 years, l...

03/03/2026

Sennheiser Relaunches MD 9235 Wireless Mic Head

The MD 9235 microphone head for wireless handhelds has been a firm favorite with many engineers and artists for its ability to cut through high on-stage levels ...

03/03/2026

Haivision to Showcase Private 5G and Live Video Contribution Innovations at MWC 2026

Haivision Systems Inc. (Haivision), a global provider of mission-critical, real-...

03/03/2026

BMG Expands Washington Broadcast Center with 3 New TV Studios and Podcast Studio for Media Clients

Broadcast Management Group (BMG) announces the expansion of its 62,000-square-fo...

03/03/2026

Closing the Loop: Maroon 5 and the End of the Analog Era

Maroon 5's musical tour in 2025 marked a leap forward in live audio as Monitor Engineer Dave Rupsch utilized Sennheiser's all-digital Spectera wireless ...

03/03/2026

SVG in Indy: Pacers Sports & Entertainment Finds Production Sweet Spot in ST 2110-Based Control Center

Designed specifically for pro basketball, the renovated space at Gainbridge Fiel...

03/03/2026

Lawo Appoints Jamie Dunn CEO

As part of the move, former CEO Phillipp Lawo joins the broadcast-tech provider's Supervisory Board Lawo has announced appointment of Jamie Dunn as chief e...

03/03/2026

NBC Turns Back the Clock to 1990s for NBA Coast 2 Coast' Tuesday

A team of legendary announcers and analysts and a classic graphics look will bring the past to life NBC Sports and Peacock will return to yesteryear for tonigh...