Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

07/08/2026

Diversified Appoints Pete Emminger as Global Chief Technology Officer

Diversified has appointed industry veteran Pete Emminger as global chief technology officer. Emminger will lead the company's global go-to-market technology...

07/08/2026

Release Rundown: What to Watch in August, From American Doctor to Idiots

O'Shea Jackson Jr., Dave Franco, and Mason Thames appear in Idiots by Macon Blair, an official selection of the 2026 Sundance Film Festival. (Courtesy of ...

07/08/2026

Sonuscore release The Sculpture

An instrument made for the adventurous composer Described as an instrument made for the adventurous composer , Sonuscore's latest sample library has b...

07/08/2026

Synchron Solo Violin 2 & Viola (sordino) join VSL line-up

Latest solo Synchron libraries arrive VSL have just released the final two instalments in their range of muted solo string libraries. Recorded in the large ...

07/08/2026

GC Audio's new Producer Channel

Channel strip offers plug-in control & recall Along with some new additions to their Inherit modular preamp system, GC Audio's announcements for NAMM 20...

07/08/2026

Opening Statement: Public hearing of the Inquiry into Racism, Hate and Violence Directed at Aboriginal and Torres Strait Islander People

Opening Statement: Public hearing of the Inquiry into Racism, Hate and Violence ...

07/08/2026

Nielsen to Acquire DoubleVerify, Creating a Leading, Independent Media Intelligence Platform

DoubleVerify Shareholders to Receive $13.60 Per Share in Cash, Representing a 30...

07/08/2026

Lawo To Highlight Dynamic Media Facility Support At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

MediaKind To Feature Unified Product Portfolio At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

ACT Entertainment Honored with Neutrik Group Americas Par...

The Award Recognizes ACT's Outstanding Sales Performance, Marketing Collaboration and Long-standing Commitment to the NEUTRIK Brand ACT Entertainment, one ...

07/08/2026

Beamr Brings NVIDIA Video Super Resolution to Live Sports...

Beamr Imaging Ltd. (Nasdaq: BMR), a leader in video optimization technology and solutions, today announced it is bringing AI upscaling to live sports, broadcast...

07/08/2026

Berklee City Music Presents Nine Scholarships and Awards at Annual Concert

Berklee City Music Presents Nine Scholarships and Awards at Annual Concert Student recipients from seven states and Canada received scholarships, housing awar...

07/08/2026

Lawo To Highlights Dynamic Media Facility Support At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

Kevin Trueblood to Return as SBE President

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

Riedel To Demo 'Live Production Experience At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

LTN Enhances Live Event Master Control Capabilities

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

AI-Native Film Studio Launches in Toronto

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

Judge Orders Removal of Nexstar Employees from Tegna Board

Share Copy link Facebook X Linkedin Bluesky Email...

07/08/2026

Riedel Communications at IBC2026 Live Production Experien...

Riedel Communications at IBC2026: Live Production Experience Showcasing Integrated IP Production Workflows At IBC2026, Riedel Communications will bring modern ...

07/08/2026

Shotoku Showcases Expanding Aura PTZ Ecosystem and Award-...

Shotoku Showcases Expanding Aura PTZ Ecosystem and Award-Winning Swoop Robotic Crane at IBC2026 Shotoku Broadcast Systems will officially introduce its Aura fa...

07/08/2026

Cobalt Digital to Bring New and Enhanced Practical Soluti...

Highlights will include new Dante fiber connectivity, expanded IPMX capabilities and award-winning signal processing solutions Cobalt Digital, the leading des...

07/08/2026

Bob Moses Concert at Red Rocks Captured with URSA Cine 12K LF

Bob Moses Concert at Red Rocks Captured with URSA Cine 12K LF Brie Clayton August 6, 2026 0 Comments PYXIS 12K and URSA Cine 12K LF enable cinematic c...

07/08/2026

Use It or Else Is Not an AI Implementation Strategy

Use It or Else Is Not an AI Implementation Strategy Andy Marken August 6, 2026 0 Comments Source - Hitchhikers Guide to the Universe, Touchstone Pi...

07/08/2026

Heated Rivalry will return to Sky and NOW in Spring 2027 exclusively in the UK and Ireland, with new additions to its lead cast

Friday 7 August 2026 Heated Rivalry will return to Sky and NOW in Spring 2027 e...

07/08/2026

Major transformation of UK digital radio platform

Migration of more than 1,000 radio services delivers improved resilience, efficiency and sustainability 07 August 2026, Winchester, UK Arqiva, the UK's l...

07/08/2026

Commission accelerates IRIS deployment with enhanced security and expanded satellites network

On 6 August, the European Commission and the SpaceRISE consortium concluded nego...

07/08/2026

A date worth betraying your plans for The Traitors Ireland returns to screens Sunday, 30 August

The Traitors Ireland Uncloaked is also back with all the behind the scenes drama...

06/08/2026

USA Sports Rolls Into 2026 NASCAR Season With First Pace-Car Analyst on Selected Races

The broadcaster's 14-race schedule begins in Iowa and ends in November with ...

06/08/2026

SVG GameDay, Ep. 25: Chicago Bears Katlin Strange - Serving the Masses in the Windy City

In-venue and creative video staffers at the professional and collegiate level ha...

06/08/2026

Warner Bros Discovery's Anne Graham Details the Organization's Media-Ops and Metadata Consolidation Across Sports and Entertainment

As media organizations consolidate teams, technology platforms, and content libr...

06/08/2026

Dolby Vision 2 Begins Rollout on Selected 2026 Hisense TVs

Firmware updates introduce Dolby's next-generation picture engine, content-aware optimization, and new motion and ambient-light tools...

06/08/2026

TNT Sports Preps Wall-to-Wall Coverage of FIBA Women's Basketball World Cup 2026 from Sept. 4-13

TNT Sports will have wall-to-wall coverage of the upcoming FIBA Women's Bask...

06/08/2026

IBC 2026: swXtch.io Introduces groundSwXtch Software-Defined Multicast Overlay

swXtch.io (Stand 5.MR13) has unveiled groundSwXtch for Audio over IP (AoIP), a software application that lets broadcasters and media organizations move audio in...

06/08/2026

IBC 2026: Riedel Communications Showcases Integrated IP Production Workflows

At IBC2026, Riedel Communications (Stands: 10.A24, 10.A31, 10.A38) will bring modern media production to life with the Live Production Experience - a connected ...

06/08/2026

Sandy Grossman's Legacy as a Pioneering Director Earns Pro Football Hall of Fame's Pete Rozelle Award

The first live-sports director to receive the prestigious honor, eight-time Emmy...

06/08/2026

NBC Sports, Maryland Jockey Club Continue Partnership To Present Preakness Stakes Through 2032

NBC Sports will continue to present the Preakness Stakes on NBC and Peacock thro...

06/08/2026

IBC 2026: Cobalt Digital Brings New Practical Solutions to Evolving Broadcast Workflows

Cobalt Digital (Stand 8.F90) continues to reinforce its commitment to delivering...

06/08/2026

Wave Central Elevates Jeff Daubert to Director of Sales, Americas

Wave Central has promoted promotion Jeff Daubert to Director of Sales, Americas. In his expanded role, Daubert will lead Wave Central's sales strategy and ...

06/08/2026

KMH Integration Adds Architect Keith Hanadel to Expanding Full-Services Team

KMH Integration is expanding its ability to serve media, broadcast, and IT organizations by adding Keith Hanadel, an accomplished architect with decades of indu...

06/08/2026

Advanced Systems Group Promotes Michele Ferreira to Chief Business Officer

Advanced Systems Group (ASG) has promoted Michele Ferreira from Vice President of its Systems Integration team to the newly created position of Chief Business O...

06/08/2026

IBC2026: Appear Expands X, VX Platforms for Hybrid Live-Production Workflows

Demonstrations will include new JPEG XS, Dolby audio, cloud-gateway, stream-processing, and distribution capabilities...

06/08/2026

Live Media Group Acquires Gravity Media's U.S. Mobile-Production Assets, Adds Eight Units to Fleet

The deal includes three premium mobile units, engineering personnel, existing br...

06/08/2026

Broadcast Management Group, LiveU Power Vertical REMI Production for Amazon Prime's Obsessed Fest on TikTok

Broadcast Management Group produced Amazon Prime's inaugural Obsessed Fest a...

06/08/2026

IBC2026: Ikegami to Showcase Expanded UNICAM Camera and Monitoring Lineup

Exhibit will feature new variable-ND functionality, OLED viewfinders, remote-camera tools, and UHD production monitors...

06/08/2026

Sony Introduces FE 100-400mm Super-Telephoto Zoom Lens

Compact full-frame E-mount lens targets sports, wildlife, and other long-range shooting applications...

06/08/2026

Tennis Channel Lands Exclusive U.S. Coverage of 2026 International Tennis Hall of Fame Induction Ceremony

Live broadcast will honor Roger Federer and Mary Carillo on Aug. 29, with onsite...

06/08/2026

UTEP Upgrades Sun Bowl Stadium Video Display With Daktronics

End-zone board receives higher-resolution LED technology and an updated Show Control system ahead of the 2026 football season...