
Cloud or on premises? That's the question many organizations ask when building AI infrastructure.
Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.
As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.
This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.
Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.
Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.
One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.
As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.
At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.
The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.
It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.
Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.
For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.
This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.
Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.
Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.
Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.
With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.
Learn more about Google Cloud's Anthos.
Learn more about NVIDIA DGX A100.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
09/10/2026
September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026
New Sports Intelligence helps providers better unders...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
11/09/2026
Calrec will introduce two new products at IBC2026 (Stand 8.C47, RAI Amsterdam, September 11-14): the Type RT broadcast production console and the Apex M6 Modula...
11/09/2026
Grass Valley has announced AVORA, a standalone all-in-one live production solution launching at IBC2026 (Booth 9.A01 and IBC Future Tech Zone, Stand 14.C49, Sep...
11/09/2026
CAMB.AI is introducing its Streaming SDK and Streaming Dashboard at IBC2026, wit...
11/09/2026
EVS has announced XT-S, a software-defined server platform that runs multiple live production applications on a common hardware foundation. The platform debuts ...
11/09/2026
EKT is demonstrating a new Linux-based ATSC 3.0 set-top box at IBC2026. The second-generation product moves away from Android to reduce memory costs, with Linux...
11/09/2026
The Sennheiser Group will exhibit at IBC2026 (Hall 8, Booth D50, September 11-14...
11/09/2026
ESPN's Monday Night Football will open its 2026-27 season with a new renditi...
11/09/2026
Dalet has announced an integration of NVIDIA's Synthetic Video Detector AI model into Dalet Flex, enabling media organizations to identify potentially AI-ge...
11/09/2026
The Media Coding Industry Forum (MC-IF) will demonstrate Versatile Video Coding (VVC) capabilities at IBC2026 (Hall 2, Stand 2.B13), as the codec moves toward c...
11/09/2026
Sony will exhibit at IBC2026 (Hall 13, September 11-14), demonstrating products across live production, news, cinema, and immersive and spatial content workflow...
11/09/2026
Wave Central, a Domo Broadcast Company, has been named a recipient of a 2026 Tec...
11/09/2026
Studio Network Solutions (SNS) is bringing a pair of workflow updates to IBC2026...
11/09/2026
iodyne will co-exhibit with Hedge at IBC2026 (Booth 7.A36, September 11-14) and appear across three additional partner booths, marking the first public demonstr...
11/09/2026
In-venue and creative video staffers at the professional and collegiate level ha...
11/09/2026
The network will phase in HDR crew by crew while expanding Next Gen Stats integration, SkyDry availability, and onsite studio shows...
11/09/2026
CAMB.AI is introducing its new Streaming SDK and Streaming Dashboard at IBC2026,...
11/09/2026
Massive host operation at Melbourne Cricket Ground featured 54 cameras, 25,000 ST 2110 flows, REMI studio production in Stamford, and global distribution to mor...
11/09/2026
Production Anywhere Remote Kit (PARK) & AR-fueled Stage B are two key pieces to ...
11/09/2026
By Ramona Flume and Lucy Spicer
There's a particular kind of magic that hap...
11/09/2026
By Jessica Herndon
The fall film season is kicking off, and Sundance Institute-...
11/09/2026
Spark series gains compact modelling stompbox
Positive Grid's Spark amps have become a popular part of the company's line-up, offering a convenient ...
11/09/2026
New flagship sequencing plug-in revealed
Rapid Flow have just launched a new 16-track sequencer plug-in which they say has been designed for total rhythmic...
11/09/2026
Rohde & Schwarz unveils the air-cooled R&S TM1 medium-power UHF transmitter at I...
11/09/2026
FIFA World Cup 2026 and Peacock's Love Island USA' Power NBCU-Versant ...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Lightware has announced the launch of LARA (Lightware Advanced Room Automation) 2.0, a major upgrade to its built-in room automation platform, introducing impro...
11/09/2026
10 September 2026 - MusiMap, the B2B music intelligence company that is transforming how companies can harness the emotional power of music to reach consumers a...
11/09/2026
Matrox Video today announced an integration between Matrox ORIGIN and NVIDIA Holoscan for Media, enabling Matrox ORIGIN media services to be provisioned, config...
11/09/2026
Net Insight today announced that its cloud-native live media orchestration is now available through Oracle Cloud Marketplace, providing broadcasters, production...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Version 1.8 will bring advanced routing control, new workflow tools, boosted control panel flexibility and ease of integration into IP networks...
11/09/2026
Ikegami announces four additions its UNICAM XE range of 4K-UHD cameras with the introduction of the UHK-X700VN, UHK-X750VN, UHK-X600VN and UHK-X650VN. Developed...
11/09/2026
DHD.audio has chosen IBC2026 as the launch venue for a major new addition to its broadcast sound production platform: the MX3 console range. MX3 retains the mod...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/09/2026
New standalone solution gives production teams everything they need to create, produce and deliver live content from one flexible system.
Grass Valley today an...
11/09/2026
Recognition honors the development of FPV drone camera systems for live sports broadcast coverage
Wave Central, a Domo Broadcast Company that develops advanced...
11/09/2026
Teradek, the industry leader in zero-delay wireless video solutions, announced the launch of Bolt 7, which now includes a unified wireless video and data system...
11/09/2026
The ACT Entertainment tvONE and Green Hippo Pixel Academy has released its autumn course schedule, with hands-on training dates in September, October and Novemb...
11/09/2026
LA JOLLA, CA-Transthyretin amyloid disease (ATTR) is a progressive, life-threatening condition caused when the protein transthyretin (TTR) breaks apart and aggr...