Sony Pixel Power calrec Sony

Decoding How NVIDIA RTX AI PCs and Workstations Tap the Cloud to Supercharge Generative AI

29/05/2024

Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, software, tools and accelerations for GeForce RTX PC and RTX workstation users.

Generative AI is enabling new capabilities for Windows applications and games. It's powering unscripted, dynamic NPCs, it's enabling creators to generate novel works of art, and it's helping gamers boost frame rates by up to 4x. But this is just the beginning.

As the capabilities and use cases for generative AI continue to grow, so does the demand for compute to support it.

Hybrid AI combines the onboard AI acceleration of NVIDIA RTX with scalable, cloud-based GPUs to effectively and efficiently meet the demands of AI workloads.

Hybrid AI, a Love Story With growing AI adoption, app developers are looking for deployment options: AI running locally on RTX GPUs delivers high performance and low latency, and is always available - even when not connected to the internet. On the other hand, AI running in the cloud can run larger models and scale across many GPUs, serving multiple clients simultaneously. In many cases, a single application will use both.

Hybrid AI is a kind of matchmaker that harmonizes local PC and workstation compute with cloud scalability. It provides the flexibility to optimize AI workloads based on specific use cases, cost and performance. It helps developers ensure that AI tasks run where it makes the most sense for their specific applications.

Whether the AI is running locally or in the cloud it gets accelerated by NVIDIA GPUs and NVIDIA's AI stack, including TensorRT and TensorRT-LLM. That means less time staring at pinwheels of death and more opportunity to deliver cutting-edge, AI powered features to users.

A range of NVIDIA tools and technologies support hybrid AI workflows for creators, gamers, and developers.

Dream in the Cloud, Bring to Life on RTX Generative AI has demonstrated its ability to help artists ideate, prototype and brainstorm new creations. One such solution, the cloud-based Generative AI by iStock - powered by NVIDIA Edify - is a generative photography service that was built for and with artists, training only on licensed content and with compensation for artist contributors.

Generative AI by iStock goes beyond image generation, providing artists with extensive tools to explore styles, variations, modify parts of an image or expand the canvas. With all these tools, artists can ideate numerous times and still bring ideas to life quickly.

Once the creative concept is ready, artists can bring it back to their local systems. RTX-powered PCs and workstations offer artists AI acceleration in more than 125 of the top creative apps to realize the full vision - whether it's creating an amazing piece of artwork in Photoshop with local AI tools, animating the image with a parallax effect in DaVinci Resolve, or building a 3D scene with the reference image in Blender with ray tracing acceleration, and AI denoising in Optix.

Hybrid ACE Brings NPCs to Life Hybrid AI is also enabling a new realm of interactive PC gaming with NVIDIA ACE, allowing game developers and digital creators to integrate state-of-the-art generative AI models into digital avatars on RTX AI PCs.

Powered by AI neural networks, NVIDIA ACE lets developers and designers create non-playable characters (NPCs) that can understand and respond to human player text and speech. It leverages AI models, including speech-to-text models to handle natural language spoken aloud, to generate NPCs' responses in real time.

A Hybrid Developer Tool That Runs Anywhere Hybrid also helps developers build and tune new AI models. NVIDIA AI Workbench helps developers quickly create, test and customize pretrained generative AI models and LLMs on RTX GPUs. It offers streamlined access to popular repositories like Hugging Face, GitHub and NVIDIA NGC, along with a simplified user interface that enables data scientists and developers to easily reproduce, collaborate on and migrate projects.

Projects can be easily scaled up when additional performance is needed - whether to the data center, a public cloud or NVIDIA DGX Cloud - and then brought back to local RTX systems on a PC or workstation for inference and light customization. Data scientists and developers can leverage pre-built Workbench projects to chat with documents using retrieval-augmented generation (RAG), customize LLMs using fine-tuning, accelerate data science workloads with seamless CPU-to-GPU transitions and more.

The Hybrid RAG Workbench project provides a customizable RAG application that developers can run and adapt themselves. They can embed their documents locally and run inference either on a local RTX system, a cloud endpoint hosted on NVIDIA's API catalog or using NVIDIA NIM microservices. The project can be adapted to use various models, endpoints and containers, and provides the ability for developers to quantize models to run on their GPU of choice.

NVIDIA GPUs power remarkable AI solutions locally on NVIDIA GeForce RTX PCs and RTX workstations and in the cloud. Creators, gamers and developers can get the best of both worlds with growing hybrid AI workflows.

Generative AI is transforming gaming, videoconferencing and interactive experiences of all kinds. Make sense of what's new and what's next by subscribing to the AI Decoded newsletter.
LINK: https://blogs.nvidia.com/blog/ai-decoded-rtx-pc-hybrid/...
See more stories from nvidia

North America Stories

25/06/2024

Bulls Return to Durham for Yellowstone Night, Marvel's Defenders of the Diamond, Two Fireworks Shows and One Dollar Hot Dogs

Tacos & Tallboys Tuesday with Tune Tuesday, Winning Wednesday, Kids Run The Base...

25/06/2024

Survey: Consumers Want Better Bundles to Simplify Streaming

PORTSMOUTH, N.H. As streamers wrestle with high churn rates, a new study from Hub Entertainment Research provides some insights into how companies can use bette...

25/06/2024

Allen Media Group To Air Special Pre-, Post-Presidential Debate Coverage

LOS ANGELES, Calif. The Allen Media Group's (AMG's) theGrio TV and digital media platform will provide comprehensive coverage of the CNN Presidential De...

25/06/2024

CommScope Updates E6000 Converged Edge Router

CLAREMONT, N.C. CommScope has launched Software Release 13 for the E6000 Converged Edge Router (CER). Software Release 13 allows operators a flexible path forwa...

25/06/2024

Paramount Global, DCMP Ink Agreement to Provide Captions for Nickelodeon Shows

NEW YORK Paramount Global and The Described and Captioned Media Program (DCMP) have announced a partnership that ensures hundreds of hours of Nickelodeons hit a...

25/06/2024

Hiltron Reports Growing Demand for Ground Antenna Refurbishment

BACKNANG, Germany Hiltron Communications is reporting that it is seeing increasing demand for its refurbishment capabilities across the entire satellite communi...

25/06/2024

ABP Network Expands Global Presence With Amagis Cloud-Bas...

Amagi, a global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), today announced its collaboration with ABP Network, one of India s l...

25/06/2024

Miller Tripods Provides LA-based Rental House With Variet...

DeHaven Camera is a boutique rental house in Los Angeles that offers a broad range of equipment to upcoming filmmakers. Eric DeHaven, co-owner of DeHaven Camera...

25/06/2024

BCNEXXT Unveils the Playout Playbook

BCNEXXT has developed a new playbook highlighting their benchmark model for content playout and distribution. To maximize operational efficiency and return on i...

25/06/2024

New Tiffen Magnetic Control System MCS

The Tiffen Company's newest filter design is here. The Magnetic Control System (MCS) is an elegantly simple new way to harness magnetic power to swiftly and...

25/06/2024

Sonnet Announces High-Performance USB-C 20Gbps PCIe Card...

Allegro Max USB-C 20Gbps 1-Port PCIe Card Adds USB 3.2 Gen 2x2 Support to Mac , Windows , and Linux Computers With an Available x4 PCIe Card Slot What s Ne...

25/06/2024

MediorNet Artist and Bolero Aboard New UHD5 OB Van Power...

Riedel Communications today announced that View Master Events, a premier production company based in Athens, Greece, has used Riedel s state-of-the-art technolo...

25/06/2024

Pliant Technologies Steps Into The Spotlight for Sound As...

With over 75 years of experience renting production gear to On and Off Broadway shows, houses of worship, concerts and outdoor events, Sound Associates, Inc. ha...

25/06/2024

Wooden Camera Introduces Cine Mag Ties

Wooden Camera, a leading innovator in professional camera accessories, announces the launch of Cine Mag Ties, an essential new addition to their universal acces...

25/06/2024

Hiltron Experiences Growing Demand for Ground Antenna Ref...

Hiltron Communications reports increasing demand for its refurbishment capabilities across the entire satellite communications sector, from high accuracy telepo...

25/06/2024

Podcaster and On-air Personality Humberto El Gato Rodrigu...

Podcaster Humberto El Gato Rodriguez's El Poder de la M sica podcast focuses on all the intricacies of music, from the science behind production to new ...

25/06/2024

ZTransform Hires Senior Program Manager with Big Brand Cr...

Jim Butler latest talent to join systems and solutions provider in key project management role serving fast-growing client base ZTransform, a leading technolog...

25/06/2024

Videosys Broadcast Expands and Rebrands Its Antenna Divis...

Two and a half years after its acquisition of Masthead Antennas, Videosys Broadcast has increased its office and manufacturing capacity in West Sussex. The comp...

25/06/2024

Adapt Selects OOONA to Enable Cutting-Edge Media Solution...

OOONA, a leading provider of professional management and production tools for the media localization industry, announced today that its flagship platform, OOONA...

25/06/2024

Blackmagic Design Announces Blackmagic Camera for Android!

Blackmagic Design Announces Blackmagic Camera for Android! Brie Clayton June 24, 2024 0 Comments Now a new generation of creators can add digital film...

25/06/2024

Story Television Grabs Forged in Fire'

Story Television Network has acquired 214 episodes of Forged in Fire, a competition series featuring bladesmiths creating complex weaponry. The show starts on S...

25/06/2024

EvolutionaryScale Debuts With ESM3 Generative AI Model for Protein Design

Generative AI has revolutionized software development with prompt-based code generation - protein design is next. EvolutionaryScale today announced the release...

24/06/2024

X2O Media to Show Collaboration Tech at Enterprise Connect 2023

X2O Media to showcase immersive collaboration technology at Enterprise Connect 2023 New OneRoom features offer enhanced human connection and presence for hybrid...

24/06/2024

X2O Media Releases X2O Platform 6.7

The Release is the First as Part of the STRATACACHE Family of Companies MONTREAL, June 13, 2018 - X2O Media announced the release of version 6.7 of its X2O Pla...

24/06/2024

STRATACACHE to Debut Shopper Marketing Tech at NRF 2019

DAYTON, OH, US-January 9, 2019-STRATACACHE will feature new marketing technology that drives retail transformation in booth #3921 at NRF 2019: Retail's Big ...

24/06/2024

X2O Media Adds Media Player to Communications Solutions

X2O Media's Business Intelligence Solutions Will Be on Display at ISE 2019. Montreal, 4 February 2019-X2O Media today unveiled the addition of X2O Media-br...

24/06/2024

X2O Media to Show Virtual Classroom Solutions at Enterprise Connect

Montreal, QC - March 14, 2019 - X2O Media will demonstrate solutions for a next generation team collaboration room and virtual classroom, as well as fully integ...

24/06/2024

X2O Media to Show Data Visualization at UC Expo 2019

Montreal, QC -May 10, 2019 -X2O Media will demonstrate fully integrated enterprise visual communications and real-time performance data visualization solutions,...

24/06/2024

STRATACACHE to Show Audience Engagement Tech at InfoComm 2019

DAYTON, OH, US - June 11, 2019 - STRATACACHE will showcase our full scope of end-to-end advanced audience engagement technology solutions at InfoComm 2019. In b...

24/06/2024

X2O Media Adds New Media Player Hardware

MONTREAL, QC., July 10, 2019 - X2O Media today unveiled the addition of Windows-based X2O Media Player-S hardware to their growing product offering. The additio...

24/06/2024

X2O Media Launches Interactive Virtual Classroom

Montreal, QC - January 17, 2020 - X2O Media today announced the enterprise-grade Virtual Classroom experience, an innovative solution that has changed how remot...

24/06/2024

X2O Media to Unveil Room Scheduling Solution at ISE 2020

MONTREAL - 7 February 2020 - X2O Media, part of the STRATACACHE family of marketing technology companies, announced today that they will unveil a robust meeting...

24/06/2024

X2O Media Partners with FutureDJs for Remote Learning

Montr al-April 7, 2020 - X2O Media today announced a global partnership with pioneering music education company FutureDJs to deliver an immersive remote learnin...

24/06/2024

X2O Media Gains SOC 2 Type II Certification

Montreal- July 8, 2020 X2O Media, part of the STRATACACHE family of marketing technology companies, announced today that it has successfully completed Service...

24/06/2024

X2O Media Introduces Two New Media Players

MONTREAL-August 5, 2020 - X2O Media today launched two new media players, X2O Media Player-R and X2O Media Player-DX, engineered to work seamlessly with the X2O...

24/06/2024

X2O Media and HEC Launch Immersive Virtual Classroom

MONTR AL- October 8, 2020 X2O Media, global provider of virtual collaboration technology for education and enterprise, today announced the launch of its first...

24/06/2024

STRATACACHE Launches LINQ Intelligent Tablets

DAYTON, OH, US-October 27, 2020 STRATACACHE today announced the launch of commercial grade LINQ all-in-one intelligent tablets, designed and built by STRATACACH...

24/06/2024

STRATACACHE Hires Sales Expert Scott Oranen

DAYTON, OH, US-January 14, 2021 -STRATACACHE announced Scott Oranen has joined the technology company as Director of Business Development, LINQ Platform. Oranen...

24/06/2024

STRATACACHE Opens New Facility in Chicago

100,000 square foot facility to focus on digital menu, mobile device and application development DAYTON, OH, US-February 22, 2021-STRATACACHE today announced t...

24/06/2024

X2O Media and TransMedics Deploy X2O Collaboration Room

The Immersive Environment Supports Remote Clinical Training and Development of the TransMedics Organ Care System MONTR AL March 10, 2021 X2O Media, a global...

24/06/2024

X2O Media Launches New Website

MONTR AL - March 31, 2021 X2O Media today proudly announced the launch of its newly redesigned website and key elements of the corporate brand, highlighting t...

24/06/2024

X2O Media and William & Mary Install Virtual Classrooms

X2O Media and William & Mary Announce Installation of Three Immersive Virtual Classrooms MONTR AL April 27, 2021 X2O Media, a global provider of virtual col...

24/06/2024

X2O Media Installs OneRoom Classrooms at Goizueta School

Goizueta Business School Launches Immersive OneRoom Technology to Elevate Student Experience and Expand Their Global Reach MONTR AL-July 20, 2021 X2O Media...

24/06/2024

X2O Media Updates Immersive Solution X2O OneRoom

The New Software Release Allows for Greater Integration with Leading Learning Management Systems, Improved UI and Virtual Rooms MONTR AL-September 22, 2021 ...

24/06/2024

How Employers Lure Employees Back to Office

Reprint of an article published by the Montr al Gazette on Apr. 11, 2022 Office Space Renovations Imagine you were building an office tower when the pandemic h...

24/06/2024

X2O Media to Show Collaboration Tech at ISE 2022

Huddle Room and Virtual Room adds new features to X2O OneRoom technology MONTR AL - May 3, 2022 X2O Media, global provider of leading hybrid workplace soluti...

24/06/2024

X2O Media to Exhibit OneRoom Solution at InfoComm 2022

MONTR AL-May 25, 2022-X2O Media, global provider of leading hybrid workplace solutions including X2O OneRoom hybrid technology, today announced that it will unv...

24/06/2024

X2O OneRoom Gains Learning Technologies Accreditation

MONTR AL - July 20, 2022 - X2O Media, an international provider of hybrid collaboration technology, today announces it has been awarded the status of Accredited...

24/06/2024

X2O Media to Show Collaboration Tech at ISE 2023

X2O Media to showcase immersive collaboration technology at ISE 2023 Experience the latest features of X2O OneRoom technology that support an engaged hybrid wor...

24/06/2024

X2O Media Updates Hybrid Solution X2O OneRoom

MONTR AL-November 30, 2023-X2O Media, a global provider of hybrid learning and collaboration solutions including X2O OneRoom, today announced it will unveil the...