Cloud or on premises? That's the question many organizations ask when building AI infrastructure.
Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.
As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.
This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.
Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.
Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.
One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.
As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.
At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.
The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.
It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.
Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.
For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.
This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.
Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.
Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.
Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.
With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.
Learn more about Google Cloud's Anthos.
Learn more about NVIDIA DGX A100.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Bitmovin, a leading provider of video streaming infrastructure, and Akamai, the cybersecurity and cloud computing company that powers and protects business onli...
04/06/2026
American Underground (AU), the Startup Hub of the South and a community of mor...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
04/06/2026
NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI
Brie Clayton June 3, 2026
0 Comments
RTX Spark - a 1-Petaflop Superchip, the Full...
04/06/2026
Inside the Peaky Blinders: The Immortal Man Grade
Brie Clayton June 3, 2026
0 Comments
Simone Grattarola discusses shaping the look in DaVinci Resolve...
04/06/2026
Cine Gear Expo Announces 2026 Awards of Excellence Recipients
Brie Clayton June 3, 2026
0 Comments
Ed Lachman ASC, Caleb Deschanel ASC, and M. David M...
04/06/2026
St. Vincents Live with Orchestra Tour to Feature Berklee Alum Ruby Plume Berklee alumni St. Vincent and Ruby Plume will appear on the same bill across seven d...
04/06/2026
BackStory follows four Irish young people as they travel back to their parents' homelands
Modern Irish identity is enriched by cultures and influences from...
04/06/2026
June's forecast with GeForce NOW: 100% chance of gaming.
GeForce NOW is lining up new adventures for the month, from big-name blockbusters to quirky indies...
03/06/2026
SES and Viva, Mexico's ultra low-cost airline, have launched multi-orbit satellite inflight connectivity on Viva's Airbus aircraft. A total of 60 A320s ...
03/06/2026
The College Football Playoff, ESPN, and TNT Sports have announced kick times and...
03/06/2026
RED Digital Cinema will exhibit at Cine Gear Expo 2026 (Booth 33, June 5-6, Universal Studios Lot), hosting three panels and hands-on product demonstrations.
P...
03/06/2026
Roku has announced the Soccer Zone, a dedicated hub for FIFA World Cup 2026 content available across the United States, Canada, Mexico, Brazil, Colombia, Argent...
03/06/2026
Liverpool FC and Wasabi Technologies have announced a multi-year extension of their partnership, with Wasabi continuing as the club's official cloud storage...
03/06/2026
Grass Valley has announced that Australian News Channel (ANC), operator of Sky News Australia, has deployed Grass Valley AMPP as part of the relocation of its n...
03/06/2026
The Riedel Group has announced the appointment of Gudrun Scharler as CEO of Riedel Networks. She succeeds Michael Martens, who has led Riedel Networks since 201...
03/06/2026
Clear-Com has announced the deployment of its intercom solutions at Itaka Arena ...
03/06/2026
Scott Coker has announced six senior executive appointments for his new global MMA promotion, which launched earlier this year with $60 million in financing. Ad...
03/06/2026
Telemundo, the exclusive Spanish-language home of the FIFA World Cup 2026, has announced its digital and social media programming for the tournament, running Ju...
03/06/2026
The Bundesliga has announced the launch of Captain, an AI assistant built into t...
03/06/2026
Anthony James Partners (AJP) is serving as technology consultant for a moderniza...
03/06/2026
Audio-Technica has announced the recipients of its annual sales rep firm awards for the 2025-26 fiscal year. The awards were presented by Jim Schanz, Executive ...
03/06/2026
iodyne will exhibit at Cine Gear Expo 2026 alongside RED Digital Cinema and Adob...
03/06/2026
The broadcaster will deploy 39 cameras for game coverage, six cameras for studio...
03/06/2026
The 2026 FIFA World Cup is providing a great opportunity for not only Fox Sports...
03/06/2026
Sony Electronics is introducing the SRG-AS10, a 4K 60p compatible PTZ Auto Framing camera that uses Sony's proprietary AI to automatically recognize and tra...
03/06/2026
Game Creek Video's Flagship A, B, C, and D unit will wind up its first year ...
03/06/2026
According to Caretta Research, the sports-rights market may be hitting the brake...
03/06/2026
Retrieval still courtesy of Tribeca.
By Jessica Herndon
This year, the Tribeca...
03/06/2026
Step sequencer-style panning tool revealed
Alongside their flagship self-titled sound-design platform, Sound Particles offer an array of creative effects an...
03/06/2026
Now features full H90 algorithm library
Eventide have announced the upcoming launch of the H9 Harmonizer Gen 2, a new and improved version of their hugely p...
03/06/2026
Significant discount available until 1 October 2026
Aim Audio have just announced a promotion that sees a significant discount applied to their Essence micr...
03/06/2026
Clarification: SBS's position on definitions of antisemitism
3 June, 2026
Media releases
Statement by Mandi Wicks, SBS Director of News and Current Aff...
03/06/2026
Rohde & Schwarz to supply CERTIUM advanced communications system to Memmingen Ai...
03/06/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
03/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
03/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
03/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
Cloud or on premises? That's the question many organizations ask when building AI infrastructure.
