Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

30/09/2026

SGO Unveils Workflows Slate To Enable Automated Burn-ins, Slates

Share Copy link Facebook X Linkedin Bluesky Email...

30/09/2026

Public Advocacy Group Urges Broadcasters to Stop Airing Trump Taxpayer Funded Ad

Share Copy link Facebook X Linkedin Bluesky Email...

30/09/2026

Qvest Promotes Katlyn Alexander to CEO, North America

Share Copy link Facebook X Linkedin Bluesky Email...

30/09/2026

Mavis Camera 8-2 adds iPhone 18 Pro Support with Variable...

Mavis has launched Mavis Camera 8.2, the latest release of its professional camera app for the iPhone and iPad. This update brings support for iPhone 18 Pro and...

29/09/2026

Oak View Group Names Cisco as Official Technology Partner

Oak View Group (OVG) has announced Cisco as an Official Technology Partner, with plans to standardize infrastructure across its venue network on Cisco solutions...

29/09/2026

SportsNet Pittsburgh Wins Three Mid-Atlantic Emmy Awards

SportsNet Pittsburgh (SNP) won three honors at the 2026 Mid-Atlantic Emmy Awards. Program awards went to Bucs BP in the Sports Program Live category (produced ...

29/09/2026

CBC, PWHL Revive Hockey Night in Canada' on Saturdays

The Professional Women's Hockey League has announced home openers for all 12 teams for the 2026-27 season, along with a broadcast partnership with CBC under...

29/09/2026

Manifold Technologies Recognized as MXL Contributor Following IBC Innovation Award

Manifold technologies has been recognized as a contributor to the Media eXchange...

29/09/2026

Fubo Launches My Local Sports RSN Add-On Package

FuboTV has announced My Local Sports, allowing subscribers in select markets to add their local regional sports network (RSN) as an add-on to a Fubo Sports subs...

29/09/2026

ANI Deploys Grass Valley AMPP and Framelight X for News Operations

Asian News International (ANI), a wire agency and video news provider based in India, has deployed Grass Valley's AMPP Media Operating System and Framelight...

29/09/2026

SABC Deploys Ikegami UHK-X600 Cameras for IP-Based Production

South African Broadcasting Corporation (SABC) has deployed Ikegami UHK-X600 cameras as part of an upgrade to IP-based production infrastructure. The deployment ...

29/09/2026

Busy in Bristol: ESPN Headquarters Come Alive With New Studio W, Remote-Production Workflows

REMI, REMCO models will drive the bulk of the broadcaster's NHL productions ...

29/09/2026

NASCAR Productions' Keith D'Alessandro on the Continued Evolution of Its Centralized Production Hub

Three years in, the facility is supporting more centralized race production, com...

29/09/2026

NBC Sports Brings Robust Sunday Night Baseball Production Playbook to MLB Wild Card Round

NBC, Peacock, and NBSN are carrying all four Wild Card series with a production ...

29/09/2026

Sundance Institute Announces 2026 Doc Fund Grantees

19 Nonfiction Projects Across All Stages of Production to Receive More Than $1 million in Support as Documentary Film Program Approaches 25th Anniversary LOS ...

29/09/2026

Zynaptiq introduce Loud & Wide

Two new plug-ins launch alongside updated bundles Zynaptiq have just announced the launch of two new plug-ins, alongside new and improved versions of two of...

29/09/2026

Wes Audio unveil the ngOmniBox

All-in-one bus processor revealed Wes Audio's ng product range has come a long way since it was first introduced, and now includes a tasty selection of ...

29/09/2026

First Baptist Nashville Drastically Upgrades Production Communications with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

29/09/2026

Fubo TV Launches My Local Sports'

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

ARRI Targets Content Creators with New HONOR Smartphone

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Asian News International Enhances Workflow with Grass Valley AMPP, FramelightX

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

SABC Chooses Ikegami UHK-X600 Cameras to Support IP Studio Transition

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

SABC Upgrades to IP-Based Production with Ikegami UHK-X60...

Ikegami announces that the South African Broadcasting Corporation, SABC, has chosen Ikegami UHK-X600 camera systems as part of an advance to IP-based operation ...

29/09/2026

Blendkit Offers 20% Discount to Celebrate Crossing 150K Asset Milestone

Blendkit Offers 20% Discount to Celebrate Crossing 150K Asset Milestone Brie Clayton September 29, 2026 0 Comments Blendkit, the largest 3D asset libr...

29/09/2026

Ease Live Reports over 75 Million Interactive Sessions Du...

Interactive streaming specialist Ease Live supported more than 76.5 million fan sessions across three major European media operators during this summers FIFA Wo...

29/09/2026

Ease Live to monetise key moments in live sports

Ease Live has added support for VAST (Video Ad Serving Template) to its graphical overlay technology, opening up new ways for broadcasters, streamers and rights...

29/09/2026

Rise AV launches awards celebrating the women advocates a...

Rise AV has announced the launch of the inaugural Rise AV Awards, a new global awards programme celebrating the women, advocates and organisations across the AV...

29/09/2026

Netflix Deploys Advanced Sony PTZ Cameras For Wonka's The Golden Ticket' Production

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Massachusetts Broadcasters Association Names Gene Lavanchy 2026 Broadcaster of the Year

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

ESPN Reports Its Most-Watched WNBA Regular Season

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Scripps Taps Digital News Veteran Sean McGarvy to Lead News Strategy

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Gray Raises Political Ad Revenue Estimates

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Edward Czarnecki Uses Game Theory to Assess ATSC 3.0 Transition Policies

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

First Baptist Nashville Drastically Upgrades Production C...

Clear-Com announced that First Baptist Nashville has upgraded its production communications with a Clear-Com intercom solution as part of a comprehensive sanct...

29/09/2026

Blackmagic Cinema Camera 6K Captured Action Shots for Sketch

Blackmagic Cinema Camera 6K Captured Action Shots for Sketch Brie Clayton September 28, 2026 0 Comments Camera's portable design and dynamic range...

29/09/2026

Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Color Across In-venue Displays at Live Events

Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Co...

29/09/2026

Berklee Alumni and Faculty Nominated for the 2026 Latin Grammy Awards

Berklee Alumni and Faculty Nominated for the 2026 Latin Grammy Awards A total of 28 Berklee alumni and faculty earned nominations across 20 categories this ye...

29/09/2026

Berklee's K-Pop & Beyond Explores Connections Between K-Pop and Hip-Hop

Berklee's K-Pop & Beyond Explores Connections Between K-Pop and Hip-Hop Now in its fifth year, the series brings together artists, industry leaders, and s...

29/09/2026

The energy transition will only succeed if it lasts

We tend to think we live in a digital world, with hopes and fears around artificial intelligence (AI), quantum computing, data centres and the next big technolo...

29/09/2026

Apple releases new guide to help families build healthy digital habits - UPDATE - Posted on 29 September 2026

Today, in partnership with the American Academy of Pediatrics (AAP), Apple relea...

29/09/2026

Final Cut Camera now supports variable aperture on iPhone\u00A018\u00A0Pro - UPDATE - Posted on 29 September 2026

Final Cut Camera, the professional filming app for iPhone, receives a major upda...

29/09/2026

RT lyric fm launch the hunt for Choirs for Christmas

RT lyric fm is proud to announce the annual Choirs for Christmas competition callout. Warm up those vocal chords and join us on RT lyric fm for a celebration ...

28/09/2026

NHL Names Adobe as an Official Creative, Marketing and AI Partner

The NHL has announced Adobe as an Official Creative, Marketing and AI Partner beginning with the 2026-27 season. The partnership will provide the league and its...

28/09/2026

MultiDyne to Showcase Expanded Portfolio Including MRMC Robotics at CABSAT 2026

MultiDyne will exhibit at CABSAT 2026 (October 5-7, Dubai Exhibition Centre), showcasing an expanded technology portfolio following its June 2026 acquisition of...

28/09/2026

ARRI and HONOR Launch Co-Branded HONOR Magic9 Pro Max

ARRI and HONOR have announced the HONOR Magic9 Pro Max, a flagship smartphone carrying ARRI branding on the device and packaging as the first product-level expr...