Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

18/08/2026

Twin Cities PBS to Become Minnesota PBS

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

MPA, ByteDance Reach AI Copyright Protection Deal

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

DirecTV to Launch Curated Multiview for Live Sports

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Sinclair Taps Carol Kellum to Head Nebraska Stations

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Corridor Television Pays $27,000 for Violations of FCCs EAS Rules

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Triveni Digital Accelerates TV 3 0 Transition in Brazil W...

Triveni Digital Now Offers a Joint Solution With MediaKind and a Lab System Bundle Supporting ISDB-Tb and TV 3.0 Broadcast Services Triveni Digital, a trusted ...

18/08/2026

BeckTV Debuts BeckFlow at IBC and Showcases Expertise for...

At IBC2026, BeckTV, a premier systems integrator for the broadcast industry, will introduce BeckFlow to the European market. BeckFlow is the first web-based sch...

18/08/2026

PTZOptics Launches Rise 4K Bringing Ultra HD Quality and...

New flagship PTZ camera combines cinematic 4K imaging, professional broadcast connectivity and the complete Horizon intelligent video experience for productions...

18/08/2026

VisualOn IBC Show Preview - AI-Powered CAE Advanced Playb...

At IBC2026, VisualOn will demonstrate how video service providers can slash bandwidth costs, maximize ad revenue, and deploy premium interactive features withou...

18/08/2026

Paying It Forward: Greg Tabor on Giving Back to the Next Generation

The relationships built during graduate school often continue to shape careers long after a degree is earned, creating a community of scientists who learn from ...

17/08/2026

Thank You Mr. Brown: Documentary on Steadicam, Skycam Inventor Garrett Brown Is in the Works

Producer William Forbes and director Andrew Schwartz detail the decade-long effo...

17/08/2026

SHIK open S32 pre-orders

New MIDI processor & macro controller revealed SHIK have announced that they have opened pre-orders for the S32, a standalone MIDI processor and macro contr...

17/08/2026

Melbourne Instruments introduce 10-year motor warranty

Cover extended on innovative motorised pot system Melbourne Instruments have just revealed that the innovative motorised pot system used in their synths and...

17/08/2026

1010music update the Bluebox

Latest firmware version now available 1010music have just released a free firmware update that brings some nice new features to their renowned Bluebox digit...

17/08/2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry Days 2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry...

17/08/2026

Calrec Integrates ImPulseV with NEP Platform

Calrec's ImPulseV Virtualised Audio Mixing Engine joins NEP Platform, the industry's largest ecosystem of trusted production software, bringing scalable...

17/08/2026

PTZOptics To Unveil Rise 4K Broadcast PTZ Camera At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

17/08/2026

Calrec Integrates ImPulseV With NEP Platform

Share Copy link Facebook X Linkedin Bluesky Email...

17/08/2026

Calrec Integrates ImPulseV with NEP Platform Advancing Sc...

Continuing its virtualisation strategy, Calrec has integrated its ImPulseV virtualised DSP software with NEP Platform, bringing its scalable audio processing ca...

17/08/2026

Mediaproxy debuts AI-powered monitoring - browser based m...

Mediaproxy, the global standard for software-based IP compliance monitoring and multiviewing solutions, will highlight major innovations in compliance monitorin...

17/08/2026

FilmLight Showcases Workflow Automation, Advanced Media Collaboration, and Baselight v8 Preview at IBC 2026

Visitors to IBC 2026 will see how FilmLight is reshaping the modern post pipelin...

17/08/2026

Arqiva x IBC 2026 - Simplify Complexity and Unlock Greater Value

Visitors to Stand 1.C41 can explore innovations in areas such as addressable advertising, hybrid distribution, managed services and operational simplification. ...

16/08/2026

Gospel Musicians release Gospel Drums

Virtual drummer joins line-up The latest release from Gospel Musicians adds a virtual drummer to the company's line-up, combining a pair of meticulously...

15/08/2026

JH Audio expand Universal-Fit range

In-ear monitoring line-up gains new universal models In-ear monitoring experts JH Audio have just announced a significant expansion of their Universal-Fit r...

15/08/2026

Press Release: NFVF Releases PESP6 Project 1, Stream1: Group 2, Stream 2 and Stream 3 Funding Approvals

14 August 2026 | Johannesburg - The National Film and Video Foundation (NFVF), a...

15/08/2026

FCC Broadband Report Shows Rapid Expansion of High-Speed Internet

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

Adte and Haystack News Partner on CTV Ads in Runup to Midterms

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

IBC 2026: Dalet to Demo AI-Orchestrated Live Sports Workflows

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

Add rounded corners to mask in After Effects

Add rounded corners to mask in After Effects Graham Quince August 14, 2026 0 Comments Ever wished you could smoothly round the corners of a Mask Path ...

15/08/2026

Director Go Riju's Rhapsody Rhapsody Shot on Blackmagic PYXIS 6K

Director Go Riju's Rhapsody Rhapsody Shot on Blackmagic PYXIS 6K Brie Clayton August 14, 2026 0 Comments Anamorphic cinematography and color gradi...

14/08/2026

AT&T Returns as Sponsor of Fifth-Annual DirtFish Women in Motorsport Summit

AT&T returns as a sponsor of the DirtFish Women in Motorsport (WiM) Summit, which marks its fifth year Aug. 21-22 in Snoqualmie, WA. This year's event will ...

14/08/2026

Perfect Game Blends Broadcast Polish with Social Swagger as All-American Classic Makes Move to Citizens Bank Park

A six-camera flypack production will anchor Sunday's game while Perfect Game...

14/08/2026

UJAM introduce Virtual Drummer Neon

Latest instalment delivers disco-inspired grooves The latest addition to UJAM's virtual drum line-up has been designed with contemporary pop, disco, dan...

14/08/2026

Yorkville launch the EL24S

Elite range gains giant 24-inch powered sub The latest expansion of Yorkville's Elite range introduces what the company say is the world's first act...

14/08/2026

Call for the 20th South African Film & Television Awards (SAFTAs20) Overall Judging Chairpersons Nominations

The National Film and Video Foundation (NFVF), an agency of the Department of Ar...

14/08/2026

LiveU, Panasonic LUMIX Launch 'Live Anywhere' Production Workflow

Share Copy link Facebook X Linkedin Bluesky Email...

14/08/2026

PBS Station Takes Iron Mountain to Court Over Archives

Share Copy link Facebook X Linkedin Bluesky Email...

14/08/2026

TV Globo Chooses Triveni Digital to Support TV 3 0 Footba...

Leading Brazilian Broadcaster Will Use Triveni Digital's TV 3.0 Broadcast Chain and Service Quality Assurance Solutions to Support Next-Generation Televisio...

14/08/2026

Beam Dynamics Makes IBC Debut with Major Expansion into L...

Beam Dynamics will make its IBC debut this September, marking a major step in the company's growth. Beam helps broadcast, live production and professional A...

14/08/2026

Conservative Groups Urge FCC to Stay Out of Affiliate Deals

Share Copy link Facebook X Linkedin Bluesky Email...

14/08/2026

LiveU and Panasonic LUMIX Launch 'Live Anywhere' Production Workflow

Share Copy link Facebook X Linkedin Bluesky Email...

14/08/2026

Cineverse Launches New Tools to Repurpose Audio Ads for CTV

Share Copy link Facebook X Linkedin Bluesky Email...

14/08/2026

Hearst Television Ups Derek Schnell to VP, News

Share Copy link Facebook X Linkedin Bluesky Email...

14/08/2026

amaran Makes Its Global Debut in Audio With the Launch of...

amaran, pioneer of lighting tools for creators, today announced the amaran Mic, a 99 wireless desktop microphone that brings the brand into audio for creators ...

14/08/2026

Creative COW Roundtable: Introduction to the New After Effects Assistant - AEAI

Creative COW Roundtable: Introduction to the New After Effects Assistant - AEAI Brie Clayton August 13, 2026 0 Comments On August 23, 2026 at 9am PDT/...

14/08/2026

Life on Waves Posted with DaVinci Resolve Studio

Life on Waves Posted with DaVinci Resolve Studio Brie Clayton August 13, 2026 0 Comments Collaborative editing and color grading workflow supported by...

14/08/2026

Why Bulletproof Video Project Archiving Is Non-Negotiable

Why Bulletproof Video Project Archiving Is Non-Negotiable John Carboni August 13, 2026 0 Comments In video production, the work is far from over when ...