Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

24/09/2026

NABA To Convene Cyber University 2.0 To Address Cybersecurity Strategies

Share Copy link Facebook X Linkedin Bluesky Email...

24/09/2026

Big Blue Marble Makes the Origin of Austrian Parliament V...

Viewers watching videos from the Austrian Parliament online will soon find it easier to verify the authenticity of the content. Big Blue Marble, an internationa...

24/09/2026

nsign and Sony collaborate to simplify digital signage de...

nsign, the digital signage SaaS platform built around its Simplify Complexity principle, is now officially certified for BRAVIA Professional Displays from Son...

24/09/2026

Viaplay Selects Encompass Altitude Scheduling to Transfor...

Encompass Digital Media today announced the successful migration of multiple Viaplay free-to-air channels, including TV3, TV6, TV8 and TV10, to its Altitude Sch...

24/09/2026

Standalone Streaming Services Continue to Decline in the U.S.

Share Copy link Facebook X Linkedin Bluesky Email...

24/09/2026

Hollyland Unveils LARK M3 Wireless Audio System

Share Copy link Facebook X Linkedin Bluesky Email...

24/09/2026

Adobe Completes Purchase Of Topaz Labs

Share Copy link Facebook X Linkedin Bluesky Email...

24/09/2026

FCC to Vote on Satellite Spectrum, Unlicensed Ultra-Wideband Devices

Share Copy link Facebook X Linkedin Bluesky Email...

24/09/2026

LYNX Technik Launches New Series 5000 Card

Share Copy link Facebook X Linkedin Bluesky Email...

24/09/2026

KRK V SERIES MONITORS HELP INDUSTRY VETERAN SANTIAGO URI...

Music Supervisor, Composer, and Mixing Engineer Santiago Uribe has built a career around producing music for film and television, contributing to more than 40 p...

24/09/2026

NABA Cyber University to Convene Broadcast Industry Leade...

The North American Broadcasters Association (NABA) will hold a full-day cybersecurity summit focused on defending against growing cyber threats facing the broad...

24/09/2026

RT Radio 1 Folk Awards Tickets on Sale | Dolores Keane inducted into Hall of Fame

RT Radio 1 Folk Awards Tickets on Sale Dolores Keane to be inducted into the...

24/09/2026

Contain the Chaos: CONTROL Resonant' Launches on GeForce NOW

A warped Manhattan is waiting in the cloud this week. Remedy Entertainment's CONTROL Resonant brings Dylan Faden's extraordinary abilities and a paranat...

23/09/2026

University of Washington's New Sundodger Studios Leverages ST 2110 to Bring Broadcast, Videoboard, and Creative Under One Roof

Four control rooms support B1G+ streams, videoboard shows, creative content, and...

23/09/2026

Mountain West Conference Moves Replay Operations West, Cutting Late-Night Hours

By Andrew Cohen, SVG Coorespondant The Mountain West debuted its new Replay Operations Center at the start of this football season, bringing real-time collabor...

23/09/2026

SVG Students to Watch: Brian Short, Ball State University

The Taylorville, IL, native is pushing creative boundaries at Ball State, gaining reps across directing, technical directing, tape, and more than 100 ESPN+ broa...

23/09/2026

The Musical and the Power of Spiteful Thinking

Alexander Heller, Nevada Jose, Will Brill, and Giselle Bonilla pose with cast members at The Musical premiere during the 2026 Sundance Film Festival at Eccles...

23/09/2026

The Crow Hill Company release Children's Choir

Includes natural and processed patches The Crow Hill Company's latest sample library captures a children's choir comprising a troupe of boys perform...

23/09/2026

Kreuzberg Audio reveal Oberton

Plug-in offers six bands of saturation Kreuzberg Audio's product range includes a selection of plug-ins and virtual instruments aimed primarily at hard-...

23/09/2026

SoundBridge 3.2.0 arrives

Latest DAW update now live SoundBridge have announced that the latest update for the remote-collaboration-focused DAW is now available. The release of Sound...

23/09/2026

Koori Knockout returns home exclusively to NITV and SBS On Demand in 2026

Koori Knockout returns home exclusively to NITV and SBS On Demand in 2026 11 September, 2026 Media releases Fans can catch all the live action exclusively ...

23/09/2026

Rohde & Schwarz acquires NEOSAT and PHYTRONIC and strengthens its competencies in sovereign satellite communications

Rohde & Schwarz acquires NEOSAT and PHYTRONIC and strengthens its competencies i...

23/09/2026

NFVF SEDIBA CREATIVE ENTERPRISE PROGRAMME CALL FOR APPLICATIONS

1. ABOUT THE PROGRAMME The National Film and Video Foundation (NFVF) invites applications from experienced producers who own or manage a South African product...

23/09/2026

CALL FOR THE SEVENTH PRESIDENTIAL EMPLOYMENT STIMULUS PROGRAMME(PESP 7) FOCUSED ON THE AUDIO-VISUAL INDUSTRY IS OPEN

The National Film and Video Foundation (NFVF) is pleased to announce the opening...

23/09/2026

NHK Technologies Inc. Chooses Calrec for Sports Production

Download Now! To receive a short case study showcasing NHK Technologies, Inc. (NT) s audio setup, please enter the following details: -- First Name* Fir...

23/09/2026

McDonald's takes top spot as New Zealand's fast-food tastes evolve, according to Nielsen

Nielsen CMI data reveals a changing fast-food landscape, with value, convenience...

23/09/2026

AFP, Dalet To Collaborate On News Video Provenance, Authenticity

Share Copy link Facebook X Linkedin Bluesky Email...

23/09/2026

Spectrum News NECN Launches Across New England

Share Copy link Facebook X Linkedin Bluesky Email...

23/09/2026

COW Jobs: Blender on Windows - Generalist - Remote

COW Jobs: Blender on Windows - Generalist - Remote Brie Clayton September 23, 2026 0 Comments Application Users - Blender on Windows - Generalist Se...

23/09/2026

Bitfocus wins IBC2026 Best of Show Award for latest Butto...

Version 1.8 recognised for new workflow tools, boosted control panel flexibility and ease of integration into IP networks...

23/09/2026

Hiltron Reports a Successful IBC2026

Hiltron Communications reports a successful 2026 International Broadcasting Convention, held at the RAI Amsterdam. Exhibiting on stand A37 in Hall 1, Hiltron ex...

23/09/2026

LiveU Showcases AI Driven Production Alongside Resilient...

Reinforcing its long-term commitment to the Middle East and North Africa (MENA) broadcast market, LiveU is presenting the Q Era at CABSAT 2026, on Stand H1-D35 ...

23/09/2026

AFP and Dalet Partner to Strengthen the Provenance and Au...

Agence France-Presse (AFP), a global news agency, and Dalet, a leading technology and service provider for media-rich organizations, today announced a partnersh...

23/09/2026

Berklee Connect Unlocks the Power of a Global Network

Berklee Connect Unlocks the Power of a Global Network Katie Vitolins BM '04 knows firsthand what Berklee's alumni community can make possible. Now she...

23/09/2026

Study: Renewals for Streaming Shows Continue to Decline

Share Copy link Facebook X Linkedin Bluesky Email...

23/09/2026

Study: More Than 4 in 10 U.S. Adults Own or Are Interested in Smart Glasses

Share Copy link Facebook X Linkedin Bluesky Email...

23/09/2026

Television Critics Association Revises Bylaws to Address AI

Share Copy link Facebook X Linkedin Bluesky Email...

23/09/2026

eX Celebrates Completion of Holland Mich. FTTP Network

Share Copy link Facebook X Linkedin Bluesky Email...

23/09/2026

Gray Media Renews Ohio Valley Conference Deal

Share Copy link Facebook X Linkedin Bluesky Email...

23/09/2026

QuickLink StudioPro Powers Next Generation Student Media...

Westminster Schools, a K through 12 school in Atlanta, Georgia with approximately 2,000 students, has transformed its student broadcast and digital storytelling...

23/09/2026

UK Pavilion Brings Leading British Technology to CABSAT a...

The 2026 edition of CABSAT and SATExpo may have a new home and dates in the diary, but it still retains a strong presence from UK companies in the GREAT Britain...

23/09/2026

Glensound marks 60 years with new audio developments at C...

Glensound will return to CABSAT with new developments in professional monitoring and Dante interfacing, alongside its established commentary, esports and parlia...

23/09/2026

Dolby and Meta Expand Dolby Atmos and Dolby Vision Across Metas Ecosystem

September 23 2026, 17:00 (PDT) Dolby and Meta Expand Dolby Atmos and Dolby Vision Across Metas Ecosystem Across Meta AI glasses, Instagram, and VR devices, ...

23/09/2026

Guy Martin's Proper Jobs returns for third series

A great watch - Radio Times TV's most likeable proper bloke - Daily Telegraph 23rd September 2026, London: Guy Martin returns to free streaming service...

23/09/2026

Sky Sports to show England Mens tour of South Africa as part of Cricket South Africa rights deal

Wednesday 23 September 2026 Sky Sports to show England Men's tour of South ...

23/09/2026

Comscore Partners with datafuelX to Bring Seamless Currency Adoption Into a Comprehensive Planning and Stewardship Workflow

Comscore Partners with datafuelX to Bring Seamless Currency Adoption Into a Comp...

23/09/2026

SES Appoints Michel Scholer to Board of Directors

Luxembourg, 23 September 2026 - SES today announced the appointment of Mr. Michel Scholer, Secretary General of the Luxembourg Government and Chief of Staff to ...