Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

08/04/2026

SVG College Sports Media Awards 2026: Entry Deadline is Monday, April 13

The deadline to enter the 18th Annual SVG College Sports Media Awards in association with NACDA is rapidly approaching! Submit your entries to this year's c...

08/04/2026

SVG Campus Shot Callers: Trever Sheets, Senior Director, ACC Network, Virginia Tech

The Pittsburgh product helps lead more than 100 annual ESPN broadcasts as part o...

08/04/2026

SVG Sit-Down: Harmonic's Jean Macher on Turning Live Sports Content Into a Smarter Monetization Engine

Dynamic ad insertion, AI-based technologies, programmatic advertising are some o...

08/04/2026

Announcing the 2026 Fellows for the Sundance Institute Cultural Impact Residency on Sundance Collab

Seven Fellows Selected for Second Year of Residency in Honor of Social Justice L...

08/04/2026

From Tokyo to the World: Watch Bad Bunny's Billions Club Live Concert on Spotify

On March 7, Bad Bunny made history with his first-ever performance in Asia, taki...

08/04/2026

De Tokio para el mundo: Mira el concierto Billions Club Live de Bad Bunny en Spotify

El 7 de marzo, Bad Bunny hizo historia con su primera presentaci n en Asia, subi...

08/04/2026

Tube Lab from Fuse Audio Labs

New channel strip plug-in revealed The latest plug-in to be added to the Fuse Audio Labs line-up emulates a selection of vintage hardware units, combining c...

08/04/2026

Blue Cat Audio release Axiom 2.3

Guitar & bass multi-effects software overhauled Blue Cat Audio's flagship guitar and bass multi-effects software has recently received a significant upd...

08/04/2026

Merging Technologies launch Pyramix 16

PanNoir mixer integration, Dolby Atmos Renderer & more Merging Technologies have just launched Pyramix 16, the latest major update to their renowned DAW sof...

08/04/2026

Updating QUARTZ Router Module Firmware Over-The-Air

Applicable Products Part number Description QUARTZ-22-LTE (EU) Dual Port Dual SIM LTE Router (EU) QUARTZ-COMPACT-11-LTE (EU) Single Port Compact LTE ...

08/04/2026

YEP September 2025 Newsletter (2)

The September 19, 2025 YEP Newsletter highlights a group visit to the Academy Museum of Motion Pictures, where participants explored exhibits showcasing the art...

08/04/2026

Proven On Orbit: L3Harris Congratulates Missile Defense Agency for Receiving Top Defense Honor for HBTSS

The L3Harris HBTSS satellite is proven on orbit, successfully demonstrating trac...

08/04/2026

From Earth to Mars: Resilient Communications Powering the Space Economy

Image Credit: NASA. Artist rendering of a space communications satellite in orbit, representative of the resilient, multiband infrastructure supporting mission ...

08/04/2026

Precision in Practice: Flight Test Confirms Key Air-to-Air Capabilities

Latest evaluation validates image quality, Inertial Navigation System performance and long-range tracking in operational flight conditions....

08/04/2026

Gen Alpha Leads Shift to AI-Powered Entertainment Search, Discovery and Recommendations

New Gracenote study finds behavioral change well underway, but trust in AI-gener...

08/04/2026

Media Links to Focus on IP Transport Solutions at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Telestream and Mimir Integration Facilitates Real-Time Pr...

Integration eliminates ingest bottlenecks by ensuring content is immediately usable across cloud and hybrid editorial workflows. See it at NAB 2026. Nevada Cit...

08/04/2026

Dalet Announces Commercial Availability of Dalia Bringing...

Dalet, a leading technology and service provider for media-rich organizations, today announced the commercial availability of Dalia, its media-aware, agentic AI...

08/04/2026

Synamedia unveils Senza Ignite to transform deployed devi...

Leading video software provider Synamedia today announced Senza Ignite, a cloud-based platform that transforms existing connected devices through a single firmw...

08/04/2026

Appear works with Corus to transform national news contri...

Modernised architecture increases operational control and agility, while reducing cost and simplifying nationwide media transport across affiliates and news bur...

08/04/2026

LynTec to Showcase High Density Power Control Solutions f...

Company to Feature DMX Dual Relay, High-Density 48-Channel Relay Panels, and New Private Label Power Program LynTec, a leading manufacturer of innovative ele...

08/04/2026

BCE integrates BCNEXXT Vipe to power cloud playout in Med...

Broadcasting Center Europe (BCE), a European media technology and services partner, today announces a technology partnership with BCNEXXT, a Netherlands-based c...

08/04/2026

Encompass Strengthens Global Media Operations with Expans...

Encompass Digital Media today announced the expansion of its Master Control Room (MCR) facility in Riga, Latvia, establishing it as one of the most advanced and...

08/04/2026

Synamedia lights up Las Vegas with innovations that will...

Leading video solutions provider Synamedia is back at The 2026 NAB Show with innovations that connect tomorrows audiences today. On display will be a range of t...

08/04/2026

COW Jobs: Director Needed for WWII Indie Docudrama

COW Jobs: Director Needed for WWII Indie Docudrama Brie Clayton April 8, 2026 0 Comments Director Needed for WWII Indie Docudrama March 17, 2026COW ...

08/04/2026

ESPN Expands Global Reach on Disney+

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Broadcast Industry Initiatives Promise To Speed Adoption of ST 2110

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Remembering Television's Role in the U.S. Bicentennial

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Synamedia Unveils AI by Quortex

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Carrie Healey Joins NAB as Vice President of Communications

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Amagi Launches Newspulse

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Marshall Electronics Unveils CV376 NDI HX3 HDMI POV Camer...

Marshall Electronics introduces its latest POV camera with the new CV376 Compact NDI |HX3 HDMI POV Camera at NAB 2026 (Booth C8339). Designed for versatile 4K c...

08/04/2026

Zixi Showcases Interoperable Live Video Workflows and Sat...

Zixi, a leader in live video delivery and workflow orchestration, enables interoperable live video workflows across multi-vendor environments, helping broadcast...

08/04/2026

Official trailer released for Sky Original action thriller Prisoner, starring Tahar Rahim and Izuka Hoyle

All episodes available on Thursday 30 April on Sky Atlantic and NOWWednesday 8 A...

08/04/2026

Agent from Above' Celebrates Divine Ascent to Global Ranking With Exclusive Cast and Behind-The-Scenes Photos

Back to All News Agent from Above' Celebrates Divine Ascent to Global Rank...

08/04/2026

Official Poster Revealed for 'My Two Cents,' the New Animated Series Created, Written and Directed by Zerocalcare

Back to All News Official Poster Revealed for My Two Cents, the New Animated Se...

08/04/2026

Champions Awards 2026 Finalists & Northern Marketing Festival

ICG is gearing up for a busy day on 14th May in Manchester. First up, we'll be joining the Northern Marketing Festival as one of the event's marketing ...

08/04/2026

How DPA solutions keep the Teatro Coln sounding like itself

The Teatro Col n in Buenos Aires is not a venue that tolerates compromise. Built in 1908 and routinely ranked among the worlds finest concert halls, it has an a...

08/04/2026

Kathryn Thomas questions if we can be Young Forever in new RT documentary

Young Forever: The Death of Ageing? airs Monday 13 April and 20 April on RT One and RT Player Around the world, the race to beat ageing is on. From cutting ...

08/04/2026

April 07, 2026

Scripps Research scientists uncover new mechanism cancer cells use to survive DNA damage Discovery reshapes understanding of how tumor cells repair broken DNA, ...

07/04/2026

NAB 2026: Ikegami USA To Launch Two New Viewfinders, Refine UHD Cameras

Ikegami USA will launch a refinement to the UHK-X700 and UHK-X750 3-CMOS -in. UHD cameras in the UNICAM XE series plus two new 7-in. viewfinders at NAB 2026 in...

07/04/2026

NAB 2026: NAB Leadership Foundation to Host Technology Students Career Mixer

The NAB Leadership Foundation and NAB PILOT will host a career mixer for technology students at NAB Show 2026 on April 18, 5-6:30 p.m., North Hall, Room N225/22...

07/04/2026

Survey: AVoIP Adoption Accelerating, With Interoperability and Security as Key Drivers

Audinate Group Limited and Futuresource Consulting have published results from a...

07/04/2026

NAB 2026: Eluvio Announces Commercial Availability of Content Fabric Bucharest Release

Eluvio has announced the commercial availability of its Content Fabric Bucharest...