Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

24/07/2026

iWedia announces the launch of Teatro Factory - A groundb...

iWedia, a global provider of software solutions for connected TV devices, today announces the launch of Teatro Factory, a new operator-facing software factory o...

24/07/2026

Record-breaking World Cup has advertisers cheering

Yospace, the trusted leader in Dynamic Ad Insertion (DAI), stitched 11.57 billion one-to-one addressable advertisements into live video streams during the 2026 ...

24/07/2026

Mediagenix To Feature 'Real-Time Media Enterprise Platform At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Peacock Posts First Profits, Adds 2 Million Subs in Q2 2026

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Edward F. OKeefe Named President and CEO of The WNET Group

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

TiVo Ads, OpenGlass Launch Programmatic Access to the TV Homescreen

Share Copy link Facebook X Linkedin Bluesky Email...

24/07/2026

Digital Alert Systems DASDEC Platform Supports FCCs New P...

Current DASDEC software enables customers to comply with the FCC's new 15-character password mandate without requiring updates LYNDONVILLE, N.Y. July 23,...

24/07/2026

SDVI to Showcase Next-Generation Rally Platform and New T...

At the IBC2026 Show, SDVI will give European media organizations their first hands-on look at the next-generation Rally media supply chain management platform f...

24/07/2026

Sonnet Technologies at IBC2026

Sonnet Technologies at IBC2026 Brie Clayton July 23, 2026 0 Comments Hero image: Sonnet Twin25G T5 Thunderbolt 5 Adapter At this year's IBC Sho...

24/07/2026

Musora Enhances Online Music Lessons with Blackmagic Design

Musora Enhances Online Music Lessons with Blackmagic Design Brie Clayton July 23, 2026 0 Comments Director of Production Josh Holliday details workflo...

24/07/2026

Kerry and Mayo fans Up For The Match as excitement builds in Croke Park on the eve of the football final

Kerry and Mayo fans Up For The Match as excitement builds in Croke Park on the e...

23/07/2026

Record-breaking World Cup has advertisers cheering

Staines-upon-Thames, UK, 23rd, JULY, 2026 - Yospace, the trusted leader in Dynamic Ad Insertion (DAI), stitched 11.57 billion one-to-one addressable advertisem...

23/07/2026

SVG Students To Watch: Shansley Glenn, University of Oklahoma

This Spring 2026 graduate from Honolulu found a home at SoonerVision as a live-production star and is ready to enter the industry as a replay op on Prime Video&...

23/07/2026

Miked Up Is an Everyday Deal for the Athletes Unlimited Softball League

As the AUSL postseason begins tonight, listening in to players during games enhances fan engagement for the young organization Ballplayers chatting with announ...

23/07/2026

Snap Announces AR and Creator Activations at Esports World Cup 2026 in Paris

Snap Inc. and the Esports Foundation have announced Snap's activations at the Esports World Cup 2026 in Paris, running July 6 through August 23. For the fir...

23/07/2026

Sony Introduces FX5 Full-Frame Cinema Line Camera

Sony has announced the FX5, a full-frame Cinema Line camera built around a newly developed fully stacked Exmor RS CMOS image sensor and BIONZ XR2 image processi...

23/07/2026

TNDV Powers Pickleball Slam 4 Broadcast for Ohlmeyer Kusserow Group

TNDV (a division of Live Media Group) provided technical production support for the Pickleball Slam 4 live broadcast from Seminole Hard Rock Live in Hollywood, ...

23/07/2026

LTN Surpasses 3,000 Satellite-to-IP Migrations as FCC Approves Upper C-Band Auction Rules

LTN has announced it has completed satellite-to-IP migrations for more than 3,00...

23/07/2026

Daktronics Announces 2026 DakClassroom Student Showcase Winners

Daktronics has announced the winners of the 2026 DakClassroom Student Showcase, a national competition recognizing student work in media production, storytellin...

23/07/2026

beIN Sports Extends Exclusive Roland-Garros Rights Across 10 Asian Markets Through 2031

The French Tennis Federation (FFT) and beIN Media Group have announced a five-ye...

23/07/2026

Clear-Com Provides Intercom System for Fryderyk Awards Gala at Tauron Arena Krakw

Clear-Com provided the communications infrastructure for the Fryderyk Awards Gal...

23/07/2026

How the FIFA World Cup's Record Revenue Masks a Structural Market Contraction

The 2026 FIFA World Cup is, on paper, an unparalleled financial success. Total t...

23/07/2026

From Green Screen to LED: How BBC Sport's World Cup Studio Became the Blueprint for Match of the Day

Standing inside HQ3 at MediaCity Studios during the FIFA World Cup 2026, it quic...

23/07/2026

How the 2026 FIFA World Cup Tightened the Bond Between the FOX Sports Digital, Linear Teams

Having attracted upwards of 17 billion views throughout the tourney, the broadca...

23/07/2026

Low End Candy release Preverb

Quickly creates reverse reverb effects Low End Candy have recently released a new plug-in that offers a quick and simple way to create reverse reverb effect...

23/07/2026

Expressive E Noisy 2.6 arrives

New engines, resonators, effects & more Expressive E's versatile soft synth has just been treated to an update that greatly expands its sonic range. Noi...

23/07/2026

SGL Carbon expands photovoltaic capacity at its Ort im Innkreis site

SGL Carbon has further expanded its photovoltaic capacity at its Ort im Innkreis site in Austria. With the commissioning of new PV carports, the sites solar sys...

23/07/2026

NITV launches new By Mob For Mob series in partnership with NRMA Insurance

NITV launches new By Mob For Mob series in partnership with NRMA Insurance 23 July, 2026 Media releases National Indigenous Television (NITV) has launched ...

23/07/2026

Rohde & Schwarz presents new software for three-phase power analysis on MXO series oscilloscopes

Rohde & Schwarz presents new software for three-phase power analysis on MXO seri...

23/07/2026

Why The Next Big Opportunity in Sports Lies Outside the Stadium

In our latest blog, Laura Rognoni explores how the launch of Play Snooker reflects a wider shift in sports economics - from monetising peak broadcast audiences ...

23/07/2026

Scaling Smart with Vivid Broadcast

Download Now! To receive a short case study showcasing Vivid Broadcast's audio setup, please enter the following details: -- First Name* First Name ...

23/07/2026

Sony Unveils FX5 Full-Frame Camera

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

Sachtler To Show Akti8T Fluid Head, Flowtech75 Tripod At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

NextGen TV Launches in Cleveland

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

Yospace Stitched 11.57 Billion Ads into Live Streams During World Cup

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

At IBC2026 Witbe Will Showcase Tests That Build Themselve...

Witbe brings its AI-native testing and monitoring infrastructure to Amsterdam: demonstrations on real devices, a peer-reviewed technical paper in the conference...

23/07/2026

Quickplay Caretta Research Evergent and Yospace Announce...

Quickplay, Caretta Research, Evergent, and Yospace have announced that the renowned IBC Pride Happy Hour will once again bring the vibe and fun back to IBC on F...

23/07/2026

IBC2026 Interra Systems Brings Trusted Media Intelligence...

At IBC2026, Interra Systems will present this year's focus: operational AI at scale for QC, monitoring, and captioning workflows. The industry has moved pas...

23/07/2026

Illusionfx is finally coming!

Illusionfx is finally coming! Alex Perea July 23, 2026 0 Comments The new website is now live to mark the occasion. Since the last update, feedback h...

23/07/2026

Evergent showcases AI agents for streaming retention at I...

Evergent (5.A86) will showcase its Agentic Revenue Orchestration Platform for streaming services, sports leagues, pay-TV operators at IBC2026 (RAI Amsterdam, 11...

23/07/2026

Brian Jones Named NCTCs New CFO

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

Scripps Unites TV Operations Under Dean Littleton's Leadership

Share Copy link Facebook X Linkedin Bluesky Email...

23/07/2026

2D House is First North American Rental Facility to Offer...

David Dvir, 2D founder (left), Sundeep Reddy (center), and Jean-Marc Bouchut (right), both of Zeiss...

23/07/2026

Screen Australia announces new national documentary accelerator program

Screen Australia announces new national documentary accelerator program 23 July 2026 Screen Australia has today announced the Above the Line Documentary Accel...

23/07/2026

At AI Summit, South Korea Outlines Its AI Future With NVIDIA and Partners

At this week's AI Summit in San Francisco, South Korean President Jae Myung Lee and some of the country's top business leaders and researchers are meeti...

23/07/2026

X-Rite Pantone and Fashion Institute of Technology (FIT) Partner to Advance Digital Color Education

X-Rite Pantone and Fashion Institute of Technology (FIT) Partner to Advance Digi...