Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

13/01/2026

CES 2026 Attendance Hits 148,000

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

13/01/2026

Altafiber Asks FCC to Reconsider Nexstar Retrans Ruling

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

13/01/2026

Kiloview to Showcase Integrated AV-over-IP Ecosystem at ISE 2026

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

13/01/2026

Spectrum to Give $300,000 in College Scholarships

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

13/01/2026

SES Acknowledges Moody's Rating Action and Reiterates Deleveraging Commitments

Luxembourg, December 17, 2025 - SES S.A. ( SES or the Company ), a leading spa...

12/01/2026

Sports and Music Unite: A Look Back at the Operationally Ambitious FIFA Club World Cup Final Halftime Show

Sports and Music Unite: A Look Back at the Operationally Ambitious FIFA Club Wor...

12/01/2026

Nielsen Panel Discussion Highlights World Cup Impact for FOX, Telemundo, MetLife, and MLS

Nielsen Panel Discussion Highlights World Cup Impact for FOX, Telemundo, MetLife...

12/01/2026

FIFA President Infantino Highlights How AI Will Impact 2026 FIFA World Cup and Beyond

FIFA President Infantino Highlights How AI Will Impact 2026 FIFA World Cup and B...

12/01/2026

Baltimore Ravens' Jack Dana on Telling a Better Story With Media Management in the Cloud

Baltimore Ravens' Jack Dana on Telling a Better Story With Media Management ...

12/01/2026

FOX Sports' Brad Cheney on Spectrum Debate's Impact on the Sports-Production Industry

FOX Sports' Brad Cheney on Spectrum Debate's Impact on the Sports-Produc...

12/01/2026

New Year, New Jobs, Renewed Commitment

Spotify's new co-CEOs, Alex Norstr m and Gustav S derstr m, start off the new year with a message of renewed leadership, creative responsibility, and what&#...

12/01/2026

Spotify's Artists to Watch 2026 Are Ready for the Spotlight

At Spotify, we listen to a lot of music. And every year, our global editors and artist partnerships teams come together to spotlight the emerging voices we beli...

12/01/2026

Spotify's Music Team Reveals Its Songwriters to Watch 2026

Spotify's global editors and Songwriter & Publisher Partnerships team spend their days immersed in new music, tracking the writers behind the songs breaking...

12/01/2026

Nominations open for the fifth Australia for UNHCR - SBS Les Murray Award for Refugee Recognition

Nominations open for the fifth Australia for UNHCR - SBS Les Murray Award for Re...

12/01/2026

Accelerating Mission Readiness in the Indo-Pacific: L3Harris' Alan Clements on Australia's Naval Transformation

Australia and New Zealand VP Alan Clements shares L3Harris' leadership insig...

12/01/2026

Paramount Sues Warner Bros. Discovery, Launches Proxy Fight

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

12/01/2026

Berklee International Folk Festival Celebrates 40 Years

Berklee International Folk Festival Celebrates 40 Years Featuring Grammy-winning alumna Arooj Aftab, the milestone concert and weeklong festival marks four de...

12/01/2026

Global Investment in Media Content to Hit $255B in 2026

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

12/01/2026

Andreas Eriksson to Helm Net Insight as CEO

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

12/01/2026

X-Rite and Rhopoint Launch Rhopoint PANTORA Aesthetix to Streamline Creation of Digital Material Twins

X-Rite and Rhopoint Launch Rhopoint PANTORA Aesthetix to Streamline Creation of...

12/01/2026

VEON's Kyivstar Launches 5G Pilot in Lviv

12 Jan 2026 VEON's Kyivstar Launches 5G Pilot in Lviv Lviv, January 12, 2026 - VEON, a global digital operator (Nasdaq: VEON), today announces that Kyivsta...

12/01/2026

The ultimate betrayal: Harry and Jamie Redknapp, Paul Merson and Karel Prince team up to find the culprit ahead of Transfer Deadline Day

Monday 12 January 2026 The ultimate betrayal: Harry and Jamie Redknapp, Paul Me...

12/01/2026

Rohde & Schwarz opens larger office in Japan to increase its support for the Japanese automotive market

Rohde & Schwarz opens larger office in Japan to increase its support for the Jap...

12/01/2026

WWE By the Numbers: Celebrating One Year on Netflix

Back to All News WWE By the Numbers: Celebrating One Year on Netflix From left to right: Rey Mysterio, Intercontinental Champion John Cena and Sheamus celebr...

12/01/2026

Welcome to the AVECO team: introducing new members of management

Welcome to the AVECO team: introducing new members of management At AVECO, we are continuing to implement our #newAVECO strategy, which aims to build an even s...

12/01/2026

Comedian and actor Michael Fry becomes the first celebrity to exit Dancing with the Stars

For the first time in the nine-year history of Dancing with the Stars, the first...

10/01/2026

Give Me the Backstory: Get to Know Cherien Dabis, the Filmmaker Behind All That's Left of You ( )

By Bailey Pennick One of the most exciting things about the Sundance Film Festi...

10/01/2026

Golden Week Nominees Night Celebrates a Podcasting Milestone

This year, podcasts are making their Golden Globes debut with a new category honoring the medium's leading shows and creators. To mark the occasion, Spotify...

10/01/2026

ESPN Reports Near-Record Viewing for Start of NBA Season

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

10/01/2026

Connection and Youth Defined: 'The Ramparts of Ice' Brings a Heartwarming Story of Friendship to Netflix this April

Back to All News Connection and Youth Defined: The Ramparts of Ice Brings a Hea...

09/01/2026

Rock-It Sports' Deron Brown & Laura Rowlands on Launching a New Brand, Supplying Logistical Needs for Events in 2026

Rock-It Sports' Deron Brown & Laura Rowlands on Launching a New Brand, Suppl...

09/01/2026

Warner Bros. Discovery's Chris Brown on the Broadcaster's First French Open, Advancing Remote Workflows at Techwood Facility

Warner Bros. Discovery's Chris Brown on the Broadcaster's First French O...

09/01/2026

NFL Playoffs 2026: CBS Sports Travels to Jacksonville With Packed Arsenal of Production Capabilities

NFL Playoffs 2026: CBS Sports Travels to Jacksonville With Packed Arsenal of Pro...

09/01/2026

NFL Playoffs 2026: NBC Sports Is Set To Roll Out New Scorebar, Insert Graphics This Weekend

NFL Playoffs 2026: NBC Sports Is Set To Roll Out New Scorebar, Insert Graphics T...

09/01/2026

NFL Playoffs 2026: Prime Video Production Team Caps Historic Season With Iconic Bears-Packers Primetime Matchup in Chicago

NFL Playoffs 2026: Prime Video Production Team Caps Historic Season With Iconic ...

09/01/2026

NFL Playoffs 2026: FOX Sports Kicks Off Postseason Slate With Two-Game Wild Card Coverage

NFL Playoffs 2026: FOX Sports Kicks Off Postseason Slate With Two-Game Wild Card...

09/01/2026

NFL Playoffs 2026: ESPN's Run Brings Monday Night Football' Flagship Operation Into January

NFL Playoffs 2026: ESPN's Run Brings Monday Night Football' Flagship Op...

09/01/2026

Carr: FCC Looking for Ways to Empower' Local Broadcasters

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

09/01/2026

Panasonic to Introduce Projection, LED and Workflow Offerings at ISE 2026

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

09/01/2026

SMPTE Announces 2026 Leadership

SMPTE , the home of media professionals, technologists, and engineers, today introduced the board officers and regional governors who will serve terms beginning...

09/01/2026

Globecast Appoints Chris Pulis as Group Chief Technology...

Globecast, the leading provider of broadcast, media and entertainment managed services, today announced the appointment of Chris Pulis as Group Chief Technology...

09/01/2026

Hollywood Professional Association Announces Updates to B...

The Hollywood Professional Association (HPA) today announced several updates to its board of directors. As part of HPA s annual governance cycle, new leadership...

09/01/2026

SDVI APPOINTS SIMON ELDRIDGE AS CHIEF OPERATING OFFICER

SDVI, the leading platform provider for cloud-native media supply chains, today announced that Simon Eldridge has been appointed chief operating officer. In thi...

09/01/2026

Cobalt Digital Returns to ISE with Comprehensive Lineup o...

Cobalt Digital, the leading designer and manufacturer of award-winning ST 2110 and SDI signal processing products, and a founding partner in the openGear initi...

09/01/2026

iWedia Strengthens Leadership in ATSC 3-0 with Market-Pro...

iWedia, a global leader in connected TV software solutions, announces that its market-proven ATSC 3.0 software stack is powering the broadcast functionality of ...