Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

31/07/2026

How Valuable Is TV to Smaller, Independent Cable Operators?

Share Copy link Facebook X Linkedin Bluesky Email...

31/07/2026

Early Registration Opens for the 2026 SMPTE Media Techno...

SMPTE, the home for media professionals, technologists and engineers, today opened early registration for the 2026 Media Technology Summit (MTS) and announced i...

31/07/2026

Central Christian Church Connects Remote Production Teams...

Clear-Com announced that Central Christian Church has transformed communication across its live production operations by implementing Clear-Com's LQ Seri...

31/07/2026

Haivision To Feature Makito ONE, Falkon X4 At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

31/07/2026

ABC Stations Tout Community Support for License Renewals

Share Copy link Facebook X Linkedin Bluesky Email...

31/07/2026

Finalists Announced for IBC2026 Innovation Awards

Share Copy link Facebook X Linkedin Bluesky Email...

31/07/2026

IBC2026 Innovation Awards finalists unveiled honouring co...

IBC has unveiled the finalists for the IBC2026 Innovation Awards, recognising collaborative projects from around the world that solve real-world challenges and ...

31/07/2026

From focus puller to colourist

From focus puller to colourist Caroline Shawley July 30, 2026 0 Comments Ana Mar a Ormaza shares her story of instinct, storytelling and finding a cre...

31/07/2026

Amazon Prime Documentary Andata e Ritorno Relies on Blackmagic Design

Amazon Prime Documentary Andata e Ritorno Relies on Blackmagic Design Brie Clayton July 30, 2026 0 Comments DaVinci Resolve Studio and Blackmagic Clou...

31/07/2026

Krotos Launches Video to Sound Plugin for DaVinci Resolve

Krotos Launches Video to Sound Plugin for DaVinci Resolve Brie Clayton July 30, 2026 0 Comments AI-assisted workflow helps editors add synchronized, p...

31/07/2026

Half-Year Report on SES's Liquidity Contract

Luxembourg, July 31, 2026 - Pursuant to the liquidity contract entered into by SES with BNP Paribas as of 7 April 2026, please see the below update on the progr...

31/07/2026

SES Publishes FY2025 EU Taxonomy Restatement

Luxembourg, July 31, 2026 - SES today published a restatement of its FY2025 EU Taxonomy (Article 8) disclosure. The restatement updates the FY2025 EU Taxonomy d...

31/07/2026

Mercedes-Benz Ireland returning as the official car partner of The Traitors Ireland

RT Commercial has today announced Mercedes-Benz Ireland will return as the offi...

31/07/2026

RT Supporting the Arts is supporting 15 cultural events nationwide this August

RT Supporting the Arts is delighted to spotlight a diverse range of arts, culture and heritage events taking place across Ireland this August. From major festi...

30/07/2026

CP Communications Provides Broadcast Support for 2026 MLB All-Star Week in Philadelphia

CP Communications provided RF audio, RF video, communications, RF coordination, ...

30/07/2026

OpenDrives Named to 2026 CRN Storage 100 List

OpenDrives has been included in CRN's 2026 Storage 100 list in the Software-Defined Storage category. The annual list, selected by the CRN editorial team, r...

30/07/2026

SES Selected by LATAM Airlines for Multi-Orbit Satellite Connectivity

LATAM Airlines has selected SES to provide multi-orbit inflight connectivity to its fleet of Airbus and Embraer aircraft. More than 60 aircraft - including Airb...

30/07/2026

Tagboard Launches Producer API with Elgato Stream Deck Integration

Tagboard has launched the Producer API, an open interface that allows key commands in Tagboard's live production environment to be triggered from external d...

30/07/2026

FOX Sports Adds Del Mar to Horse Racing Coverage in Multi-Year Deal

FOX Sports and the New York Racing Association (NYRA) have announced a multi-year agreement with Del Mar Thoroughbred Club that will make FOX Sports the exclusi...

30/07/2026

ABC Commercial Launches Four FAST Channels on LG Smart TVs

ABC Commercial has launched four free ad-supported streaming television (FAST) channels on LG Smart TVs across North America, Great Britain, and select countrie...

30/07/2026

Six Kings Slam Returns to Netflix in October with Sinner, Alcaraz, Djokovic

The Six Kings Slam exhibition tennis tournament will return to Riyadh on October 21, 22, and 24, streaming live on Netflix at no additional cost to subscribers....

30/07/2026

Central Christian Church Uses Clear-Coms Gen-IC to Connect Remote Production Teams

Central Christian Church in Mt. Vernon, Illinois has deployed Clear-Com's LQ...

30/07/2026

Blackmagic Design Releases UltraStudio Express 3G Capture and Playback Devices

Blackmagic Design has released the UltraStudio Express 3G family, a pair of USB4 capture and playback devices compatible with Mac, Windows, and Linux computers ...

30/07/2026

ESPN Secures Media Rights to Womens Pro Baseball League

ESPN has reached a media rights agreement with the Women's Pro Baseball League (WPBL), making ESPN the national streaming home of the league's 2026 seas...

30/07/2026

Most Valuable Promotions and Professional Fighters League Merge

Most Valuable Promotions (MVP) and the Professional Fighters League (PFL) have announced a merger that will operate under the MVP banner. PFL CEO John Martin wi...

30/07/2026

Columbus Blue Jackets To Simulcast TV and Radio Broadcasts Beginning 2026-27

The Columbus Blue Jackets will simulcast all game broadcasts across television and radio beginning with the 2026-27 NHL season. Under the new format, the televi...

30/07/2026

TMRW Sports Selects Populous To Design Professional Flag Football Stadium

TMRW Sports has selected Populous as architect for a purpose-built stadium for its professional flag football league, being developed in partnership with the NF...

30/07/2026

SiriusXM Launches Sports Pass Subscription at $5 per Month

SiriusXM has announced SiriusXM Sports Pass, a new subscription plan launching September 1 that bundles the company's sports audio programming into a single...

30/07/2026

SVG Cloud & Content Workflows Summit Focuses on Live Production, Content Management, AI

Leagues, broadcasters, and technologists gather to tackle cloud economics, distr...

30/07/2026

AWSs Jason Dvorkin on the Power of AWS Elemental Inference, Agentic AI in Live Sports Production

A major player in the cloud-based solutions, Amazon Web Services (AWS) has conti...

30/07/2026

Minnesota Timberwolves Ink Local-Media-Rights Deal With DAZN

The NBA will provide production for all local game broadcasts, including pregame and postgame coverage...

30/07/2026

Cosm Detroit To Open September 10

Cosm will open its fourth immersive sports and entertainment venue in downtown Detroit on September 10. Located at 25 Cadillac Square, adjacent to Campus Martiu...

30/07/2026

NFL Network Added to ESPN App Beginning July 30

NFL Network will be available on the ESPN App beginning July 30 for Unlimited plan subscribers. The addition brings NFL Network's live games, studio program...

30/07/2026

NEP Platform Adds Riedels SimplyLive Production Suite

NEP Group has added Riedel's SimplyLive Production Suite to NEP Platform, giving customers access to the live production software through NEP's orchestr...

30/07/2026

SUNDANCE INSTITUTE NAMES TRISTA SCHROEDER GENERAL COUNSEL & CHIEF OPERATING OFFICER

LOS ANGELES, CA, July 30, 2026 - The nonprofit Sundance Institute today announce...

30/07/2026

Waves release Atlas Reverb

A new take on classic algorithmic reverbs Waves have just introduced a new flagship algorithmic reverb plug-in that offers the company's take on the ico...

30/07/2026

Arturia's Summer Sale now live

Save up to 30% on virtual instruments & plug-ins Arturia have recently launched their annual Summer Sale, which sees discounts of up to 30% applied across a...

30/07/2026

SSL unveil the Odyssey console

ActiveAnalogue technology powers new flagship modular console A year on from the launch of the Oracle, SSL have revealed a new flagship console which they s...

30/07/2026

DT 275 Pro from beyerdynamic

Up to 22dBA of passive attenuation The latest arrival to the beyerdynamic range introduces a new compact monitoring headphone that's been designed to ta...

30/07/2026

Apprenticeship success at SGL Carbon in Meitingen

As part of its traditional graduation ceremony, SGL Carbon honored the achievements of a total of twelve young professionals who successfully completed their ap...

30/07/2026

Premiere date revealed for SBS Original drama The Airport Chaplain, starring Hugo Weaving and Shabana Azeez

Premiere date revealed for SBS Original drama The Airport Chaplain, starring Hug...

30/07/2026

TVNZ Works with Evergent to Successfully Debut New Stream...

TVNZ and Evergent are celebrating a major TVNZ milestone - the evolution from a free-to-view, ad-supported business into a hybrid model, offering premium sport...

30/07/2026

WebMiere Adds Native VP9/AV1 WebM/MKV Import to Adobe Premiere Pro

WebMiere Adds Native VP9/AV1 WebM/MKV Import to Adobe Premiere Pro Brie Clayton July 29, 2026 0 Comments Brought to you by KawaiiEngine, WebMiere is a...

30/07/2026

Comments on FCC License Renewals for ABC Stations Top 150,000

Share Copy link Facebook X Linkedin Bluesky Email...

30/07/2026

CW Sports Live Streaming to Launch Aug. 4 on the ESPN App

Share Copy link Facebook X Linkedin Bluesky Email...

30/07/2026

Fox Advertising, iSpot Expand Measurement Deal

Share Copy link Facebook X Linkedin Bluesky Email...