Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/07/2026

FCC Plans to Auction 160 MHZ of Midband Spectrum

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

CBS Miami Launches Hope 4 Venezuela' Relief Effort

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

Riedel, SKAARHOJ Expand Collaboration With SimplyLive Integration

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

Gray Media to Buy American Spirit Media's TV Stations

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

Cascade PBS Launches App Solution Provider 'Local Public

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

Manfrotto Introduces UNCOVER, the new premium camerabag collection for modern hybrid creators

Manfrotto Introduces UNCOVER, the new premium camera bag collection for modern h...

01/07/2026

Blackmagic Design Powers Houston Tamil Sangam Literacy Competition

Blackmagic Design Powers Houston Tamil Sangam Literacy Competition Brie Clayton July 1, 2026 0 Comments Volunteers use ATEM Mini Pro, Blackmagic Desig...

01/07/2026

Riedel, SKAARHOJ Expand Collaboration WithSimplyLive Integration

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

PlayBox Technology Publishes State of Broadcast Infrastru...

PlayBox Technology has published State of Broadcast Infrastructure 2026, an in-depth industry research report examining the technologies, operational challenges...

01/07/2026

Jigsaw24 Appoints Alan Henry as Head of Sales for Media a...

LONDON, UK, 1 JULY Jigsaw24 has appointed Alan Henry as Head of Sales for Media and Entertainment, reinforcing its continued investment in helping broadcaster...

01/07/2026

Content Vault Partner with XMA to Distribute Universal Fi...

Content Vault, the patent-pending secure content distribution platform protecting high-value media from disclosures, theft and unauthorised access, today announ...

01/07/2026

Bitcentral Announces Strategic Evolution to Create Two F...

Bitcentral, Inc. a leading provider of enterprise software and digital media solutions for news, sports and entertainment broadcasters, as well as streaming pla...

01/07/2026

Adder Technology Names Neil Hillier as CEO

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

IBCAP Opens New Anti-Piracy Lab in Denver

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

FCC Plans to Auction 160 MHZ of Mid-Band Spectrum

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

CBS Miami Launches 'Hope 4 Venezuela' Relief Effort

Share Copy link Facebook X Linkedin Bluesky Email...

01/07/2026

Groundbreaking First Nations Screen Business Accelerator launched through national partnership

Groundbreaking First Nations Screen Business Accelerator launched through nation...

01/07/2026

Chyron Launches the All-New Chyron Academy: A Reimagined, Hands-On Learning Experience for Live Broadcast Production

Chyron Launches the All-New Chyron Academy: A Reimagined, Hands-On Learning Expe...

01/07/2026

Amplium Captures Kawasaki Brave Thunders Game with Blackmagic URSA Cine Immersive

Amplium Captures Kawasaki Brave Thunders Game with Blackmagic URSA Cine Immersiv...

01/07/2026

Boris FX Optics Expands Plugin Support to Apple Photos, Capture One, and Affinity Photo

Boris FX Optics Expands Plugin Support to Apple Photos, Capture One, and Affinit...

01/07/2026

Apple Creator Studio gets smarter, faster, and more connected - UPDATE - Posted on 30 June 2026

Apple today introduced power-packed updates to Apple Creator Studio, a groundbre...

01/07/2026

Nectar360 becomes first UK Retail Media Network to achieve IAB Europe Certification following independent ABC audit

Nectar360, the Retail Media, Loyalty and Insights business of the Sainsburys Gro...

01/07/2026

FIFA World Cup delivers strong audiences across all RT platforms

9.2 million streams on RT Player between 11 and 28 June Reach of 2.9 million viewers during Group stages of FIFA World Cup on RT 2 23 million video views acr...

30/06/2026

Entries open for Thomson's Young Journalist Award 2026

Could your journalism reach an international stage? Entries are now open for the Thomson Foundation's Young Journalist Award 2026, one of the most prestigi...

30/06/2026

CazTVs 12 ENG Teams Across North America Keep Brazilian Fans on Top of World Cup

As Brazil's only way for fans to see all 104 matches, YouTube channel proves the power of digital...

30/06/2026

UJAM release Retrocraft multi-effects

Brings together saturation & lo-fi effects Following on from the release of their Voxcraft vocal-processing plug-in, UJAM have announced the launch of Retro...

30/06/2026

Zensphere v2 from Rapid Flow

New IR reverb engine, Juno-inspired chorus & more The latest version of Rapid Flow's hardware-emulation synth plug-in expands on its predecessor with a ...

30/06/2026

Shy Audio release Shy 90s Smack

Excels at heavy-handed VCA compression For their latest release, Shy Audio have recreated the crunchy' sound of a rackmount compressor that found its w...

30/06/2026

Apple raise Mac & iPad prices

Component scarcity drives cost increases Shortly after Apple's CEO Tim Cook acknowledged that cost increases would soon be inevitable , the company hav...

30/06/2026

Statement regarding GetUp Save Our SBS' campaign

Statement regarding GetUp Save Our SBS' campaign 30 June, 2026 Media releases The GetUp Save Our SBS' campaign is an independent initiative. SBS ...

30/06/2026

The First Hitachi Cash Recycling Devices in the EU Were Deployed at Bank Pekao S.A.

Hitachi and Bank Pekao S.A. have completed the installation of the first Hitachi...

30/06/2026

Clear-Com Upgrades Communication Systems for Jeopardy! and Wheel of Fortune

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

30/06/2026

Telemundo, Peacock See More Record Setting World Cup Audiences

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

FOR-A America Adds Two Execs to U.S. Sales Team

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

A3SA Disputes Weigel Assertions that NextGen TV Threatens EAS

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

MainStreaming Selected by ITV to Support Delivery of ITVX...

MainStreaming, the award-winning and innovative Edge Video Delivery Network, today announced that it has been selected by ITV to support the delivery of ITVX, I...

30/06/2026

Chyron Launches New Chyron Academy

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Clear-Com Upgrades Communication Systems for Jeopardy and...

When Wheel of Fortune and Jeopardy! needed to upgrade their wireless communications system, they turned to Clear-Com FreeSpeak wireless for their iconic televi...

30/06/2026

Supreme Court Gives Trump Tight Control over Independent Regulators

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Rocket Lab to Acquire Iridium in $8 Billion Deal

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Kyocera AVX Releases New Web-Based Antenna Integration Tool

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

YouTube Shorts Get a Makeover

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Rise Announces 2026 Worldwide Mentoring Cohorts

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Other World Computing Launches New Atlas Core Line with 256GB CFExpress 4.0 Type B Memory Card

Other World Computing Launches New Atlas Core Line with 256GB CFExpress 4.0 Type...

30/06/2026

DaVinci Resolve Studio Used for Taketoshi Sado's Perfume Cold Sleep -25 years Document-

DaVinci Resolve Studio Used for Taketoshi Sado's Perfume Cold Sleep -25 year...