Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

07/01/2026

SVG Summit 2025: All General Sessions Now Available to Watch on SVG PLAY

SVG Summit 2025: All General Sessions Now Available to Watch on SVG PLAYThe SVG Summit celebrated its 20th edition with a loaded agendaBy Brandon Costa, Directo...

07/01/2026

NBCU's Brings Rinkside Live' and Courtside Live' Features to Peacock for Legendary February'

NBCU's Brings Rinkside Live' and Courtside Live' Features to Peaco...

07/01/2026

A Defining Moment for Podcasts: Spotify Kicks Off Week of Festivities After Contributing More Than $10 Billion to the Industry

Spotify is launching a week-long celebration spotlighting creators at the center...

07/01/2026

Introducing Listening Activity and Request to Jam in Messages on Spotify

We know people use Spotify not just to listen, but to share the songs, podcasts, and audiobooks they love with their friends and family. When we launched Messag...

07/01/2026

Go Inside Spotify Sycamore Studios, Our New State-of-the-Art Podcast Studio in Hollywood

This week, all eyes are on the podcast industry as the Golden Globes recognizes ...

07/01/2026

Making It Easier for Video Podcasters to Earn on Spotify

Podcasts are stepping onto a new stage this week as the Golden Globes recognize the medium for the first time. To mark this milestone moment, we're hosting ...

07/01/2026

Invitation to Submit Proposals for Micro-Budget Film Projects 2026

The National Film and Video Foundation (NFVF), in collaboration with a distributor, is commissioning new micro-budget fiction feature films and invites eligible...

07/01/2026

For L3Harris, the Action Starts Six Seconds Before Artemis II Lifts Off

NASA's Space Launch System rocket carrying the Orion spacecraft launches on the Artemis I flight test, Wednesday, Nov. 16, 2022, from Launch Complex 39B at ...

07/01/2026

L3Harris ROVER and TNR Products Receive NSA Approval for International Sales

For the first time ever, new C' variants allow international users to interoperate with U.S. personnel via NSA-certified cryptography....

07/01/2026

ATSC 3.0 Home Gateways To Appear At CES 2026

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

SDVI Names Simon Eldridge Chief Operating Officer

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

Globecast Promotes Chris Pulis to Group Chief Technology Officer

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

English Football League Secures Match Streams With Nagravision

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

Kristy Santiago Named GM of Gray Stations in Missouri, Kentucky

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

Proton to Feature New Zoom Capability for 4K Minicam at Hamburg Open

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

Warner Bros. Discovery Rejects Latest Paramount Offer

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

NBCUniversal Sells Out Ad Inventory for Olympic Winter Games

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

New AES Technical Document Focuses on Dialogue Intelligibility

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

CTA: U.S. Consumer Tech Revenue to Hit $565 Billion in 2026

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

NBCUniversal Upgrades AI-Powered Guide for 2026 Winter Olympics

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

Parks: Smart TVs Are Primary Streaming Device in U.S. Homes

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

Clear-Com to Feature 4-Channel HelixNet Beltpack at ISE 2026

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

Cable Center to Sell Its Building to University of Denver

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

CES: Aktas AI-First Video Platform Adds New Capabilities

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

07/01/2026

The Trailer of 'Paparazzi King': The 5-Episode Docuseries Coming Only on Netflix January 9

Back to All News The Trailer of Paparazzi King: The 5-Episode Docuseries Coming...

07/01/2026

Netflix Supports Warner Bros. Discovery Board's Commitment to Merger Agreement

Back to All News Netflix Supports Warner Bros. Discovery Board's Commitment...

07/01/2026

What Next? Netflix Reveals Series, Films and Games Coming in 2026

Back to All News What Next? Netflix Reveals Series, Films and Games Coming in 2026 Entertainment 07 January 2026 Global Link copied to clipboard Download ...

07/01/2026

From Warehouse to Wallet: New State of AI in Retail and CPG Survey Uncovers How AI Is Rewiring Supply Chains and Customer Experiences

AI has transformed retail and consumer packaged goods (CPG) operations, enhancin...

06/01/2026

Peacock Bringing Dolby Vision and Dolby Atmos to Live Sports Content

Peacock Bringing Dolby Vision and Dolby Atmos to Live Sports ContentPeacock is the first streamer to embrace Dolbys full suite of advanced picture/sound innovat...

06/01/2026

Milano Cortina 2026: Listening to the Sounds of Powder and Ice With a Behind the Scenes Tour of OBS and NBC's Audio Set Ups

SVG Europe Audio: Listening to the sounds of powder and ice at Milano Cortina wi...

06/01/2026

Quintar Meta Spatial SDK Integration Promises Next-Level XR Experiences

Quintar Meta Spatial SDK Integration Promises Next-Level XR ExperiencesBy Ken Kerschbaumer, Editorial Director Tuesday, January 6, 2026 - 9:41 am Print This...

06/01/2026

Milano Cortina 2026: BBC Sport Previews Broadcast Ops, Studio Setup, Social Media Plans, and More

Milano Cortina 2026: BBC Sport Previews Broadcast Ops, Studio Setup, Social Medi...

06/01/2026

Dolby's Jason Power on Elevating Live Sports Through Immersive Audio and HDR Imagery

Dolby's Jason Power on Elevating Live Sports Through Immersive Audio and HDR...

06/01/2026

DAZN's Global CRO Walker Jacobs on the Streamer's Breakout Year in the U.S.

DAZN's Global CRO Walker Jacobs on the Streamer's Breakout Year in the U...

06/01/2026

California Dreamin': LA28's SVP of Media Jim Bell Previews the Olympic and Paralympic Games' Return to the U.S.

California Dreamin': LA28's SVP of Media Jim Bell Previews the Olympic a...

06/01/2026

One Month Out From Winter Olympics Opening Ceremony, NBC Sports in Final Prep for a Legendary February'

One Month Out From Winter Olympics Opening Ceremony, NBC Sports in Final Prep fo...

06/01/2026

Advanced HDR by Technicolor and Zinwell Integrated onto ATSC 3.0 Conversion Boxes

Advanced HDR by Technicolor and Zinwell Integrated onto ATSC 3.0 Conversion Boxe...

06/01/2026

Fox Sports President and COO Mark Silverman Shifts to Consulting Role

Fox Sports President and COO Mark Silverman Shifts to Consulting RoleBy Ken Kerschbaumer, Editorial Director Tuesday, January 6, 2026 - 2:37 pm Print This S...

06/01/2026

Spotify Celebrates Podcasting's Big Moment Ahead of First-Ever Golden Globes Category

Spotify is launching a week-long celebration spotlighting creators at the center...

06/01/2026

Spotify's New Gov Ball Experience Turns the 2026 Lineup Into a Personalized Data Story for Every Fan

Lorde. A$AP Rocky. JENNIE. Baby Keem. KATSEYE. That's just a taste of who...

06/01/2026

L3Harris CFO and Missile Solutions President Appears on CNBC

In a live broadcast, L3Harris CFO and Missile Solutions President Ken Bedingfield joined Morgan Brennan on CNBCs Closing Bell: Overtime. Bedingfield discussed...

06/01/2026

Index Exchange Launches Gracenote-Powered Show-Level Reporting with Spectrum Reach

First-of-its-kind SSP capability delivers program-level insight and brand suitab...

06/01/2026

iWedia, Skyworth Partner on Turnkey Solutions for NextGen TV

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

06/01/2026

Hub: Younger Viewers More Receptive to Ads on Streaming Services

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...