Cloud or on premises? That's the question many organizations ask when building AI infrastructure.
Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.
As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.
This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.
Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.
Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.
One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.
As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.
At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.
The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.
It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.
Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.
For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.
This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.
Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.
Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.
Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.
With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.
Learn more about Google Cloud's Anthos.
Learn more about NVIDIA DGX A100.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Technology collaboration to validate AMPP and Lawo HOME orchestration integration, showcasing Dynamic Media Facility principles in practice.
Grass Valley and ...
09/06/2026
Bitmovin, a leading provider of video streaming solutions, today announced that Axel Springer SE, international media and technology company, has deployed Playe...
09/06/2026
LiveU, the global leader in live IP-video solutions, today announced a landmark deployment with the Oceania Football Confederation (OFC) that has brought Video ...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Two Alumni Win Tony Awards Mike Morris and Cedric Leiba Jr. won awards for Best Orchestrations and Best Play, respectively.
June 8, 2026
By
Tori Donahue
...
08/06/2026
The two execs discuss the goals and the challenges of building a huge multi-cult...
08/06/2026
This industry legend has been a road warrior since the early '90s and is, today, a lynchpin on College GameDay
The sports-production industry continues to ...
08/06/2026
DAZN has agreed a multi-year rights partnership with Extreme Fighting Championship (EFC), expanding its global combat sports portfolio.
DAZN will broadcast EFC...
08/06/2026
As fans move across broadcast, streaming, social, mobile and creator-led platforms, and they expect every angle, in real time, TVU Networks has released a new e...
08/06/2026
Infront has further strengthened the 2026 Diamond League's international bro...
08/06/2026
Grass Valley has announced the appointment of Sam Craig as Vice President, Global Pre-Sales. Based in the United States, Craig will lead Grass Valley's glob...
08/06/2026
SMPTE has announced its summer 2026 education lineup covering IP networking and SMPTE ST 2110, including two standalone courses, a 13-week boot camp, and a hand...
08/06/2026
Sportradar Group AG has announced a multi-year global agreement with Kalshi, a p...
08/06/2026
FIFA and Gamefam have announced the launch of a FIFA World Cup 2026 event on Roblox, running June 5 through July 31, 2026. The event centers on FIFA Super Socce...
08/06/2026
A collaboration of NHL Productions, Monumental Sports, and Michael Levitt Produc...
08/06/2026
CBS Sports production staffer Bryce Adair has died at the age of 31 after sustaining injuries during a car accident on Wednesday while in Ohio working the the P...
08/06/2026
Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...
08/06/2026
WMT Digital today announced the launch of WMT Fan Intelligence, designed to unif...
08/06/2026
The Heat are the seventh NBA team to air their games over-the-air next season...
08/06/2026
Paramount and UFC have announced an expansion of their media rights partnership making Paramount the exclusive home of UFC Numbered Event main cards in Canada ...
08/06/2026
The Qatar Football Association (QFA), in cooperation with Sponix and broadcaster...
08/06/2026
Project B has announced the appointment of Host Broadcast Services (HBS) as Offi...
08/06/2026
The Buckeyes now produce and stream upwards of 200 sports events annually with a...
08/06/2026
At Spotify, our commitment to the LGBTQIA community is year-round. Through GLOW, our global music program, we celebrate and amplify the contributions of queer ...
08/06/2026
Get Hands-on With Keyboard & Synth Brands
GearExpo UK wouldn't be complete without some synth action, and we've got some of the industry's most ...
08/06/2026
50 popular in-ear monitoring system profiles added
The latest update for IK Multimedia's headphone-correction system has just arrived, and introduces ca...
08/06/2026
Manny Marroquin signature cans upgraded with SLAM Technology
The flagship model in Audeze's Manny Marroquin Signature Series has just been treated to an...
08/06/2026
Air domain supremacy redefined - New counter UAS, space solutions and directiona...
08/06/2026
he BBC and BritBox have announced that Edward Bluemel (We Might Regret This, My ...
08/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/06/2026
Dante interfaces, intercom and control systems for modern AV environments
Glensound will showcase a focused range of networked audio and intercom solutions fo...
08/06/2026
Bminty is proud to celebrate the first anniversary of T18, the new free national French DTT channel launched on June 6, 2025. This symbolic milestone also marks...
08/06/2026
DaVinci Resolve Used For Global Collaboration on Tony Foster Documentary
Brie Clayton June 8, 2026
0 Comments
DaVinci Resolve Studio and Blackmagic Cl...
08/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/06/2026
Plus, 20% off TVs ahead of kick-offMonday 8 June 2026
Sky introduces Real Time...
08/06/2026
FOX Secures Live NFL Game Package in Mexico Starting in Fall 2026 Agreement Features Thursday Night Football, Sunday Games Package, Thanksgiving Day Games, al...
08/06/2026
FOX One, FOX Sports and Indeed Name Austin Franklin and Kevin Akoto as FOX One C...
08/06/2026
Meet us on the show floor
Stand #286310 Discover Nara, the media management tool used by major facilities including Harbor and Molinare.
Nara v2 introduces re...
Cloud or on premises? That's the question many organizations ask when building AI infrastructure.
