Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

30/01/2026

Peacock Hits 44 Million Subs, Lost $552 Million in Q4

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

30/01/2026

ATSC Board Leadership Re-Elected For 2026

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

30/01/2026

MRC Issues Final Digital Advertising Auction Transparency Standards

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

30/01/2026

CBS Atlanta Launches New Weekday Morning News Show with AR/VR Set

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

30/01/2026

Boston Conservatory at Berklee Hosts the National Opera Association's 2026 Conference

Boston Conservatory at Berklee Hosts the National Opera Association's 2026 C...

30/01/2026

Student Spotlight: Sriram Narayanan

Student Spotlight: Sriram Narayanan The classical pianist shares his experience growing up with a language disability and finding his voice through music. Ja...

29/01/2026

Extension of Invitation to Submit Proposals for Micro-Budget Film Projects 2026 Deadline to 2 February 2026

The National Film and Video Foundation (NFVF), in collaboration with a distribut...

29/01/2026

Hitachi Europe Appoints Michele Fracchiolla as President

Michele Fracchiolla Succeeds Andrew Barr as President of EMEA region from April 1, 2026 London, January 29, 2026 Hitachi Europe Ltd. today announces the appoi...

29/01/2026

L3Harris Technologies Reports Strong Full Year and Fourth Quarter 2025 Results, Initiates 2026 Guidance

MELBOURNE, Fla., January 29, 2026 - L3Harris Technologies (NYSE: LHX) reports fu...

29/01/2026

Nielsen Announces 2025 ARTEY Award Winners Following Record-Breaking Year of Streaming

Bluey' Wins Second Consecutive Top Streaming Title of the Year with 45 Billi...

29/01/2026

Report: Performance TV Ties With Social Media in Driving Ad Results

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

29/01/2026

ISE: NDI and OBSBOT Expand Partnership

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

29/01/2026

NTCA Asks FCC to Block Nexstar, Tegna Deal

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

29/01/2026

FCC Announces Tentative Agenda for February Open Meeting

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

29/01/2026

CBS Sports AFC Championship Game Attracts 48.6 Million Viewers

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

29/01/2026

Boston Conservatory Orchestra Presents East Coast Premiere of Peter and Leonardo Dugan Piano Concerto

Boston Conservatory Orchestra Presents East Coast Premiere of Peter and Leonardo...

29/01/2026

Mercedes-Benz Unveils New S-Class Built on NVIDIA DRIVE AV, Which Enables an L4-Ready Architecture

Mercedes-Benz is marking 140 years of automotive innovation with a new S-Class b...

29/01/2026

X-Rite Pantone Appoints Cindy Cooperman as Vice President and General Manager of Pantone

X-Rite Pantone Appoints Cindy Cooperman as Vice President and General Manager of...

29/01/2026

Outback Terror: The Falconio Murder

New two-part true crime documentary, OUTBACK TERROR: THE FALCONIO MURDER, aims to shed new light on a case that continues to intrigue on both sides of the world...

29/01/2026

'Love is Blind: Sweden' Returns for a Third Season - Premiering on March 12

Back to All News Love is Blind: Sweden Returns for a Third Season - Premiering ...

29/01/2026

Unmask Bridgerton' Season 4 With Our Complete Coverage Guide

Back to All News Unmask Bridgerton' Season 4 With Our Complete Coverage Guide Yerin Ha as Sophie Baek and Luke Thompson as Benedict Bridgerton in Season ...

29/01/2026

Extraordinary Crime Mysteries, Mythical Worlds and High-Stakes Psychological Thrillers: Inside Netflix's 2026 Chinese-Language Slate

Back to All News Extraordinary Crime Mysteries, Mythical Worlds and High-Stakes...

29/01/2026

FOX Sports Unveils Historic FIFA World Cup 2026 Broadcast Schedule

FOX Sports Unveils Historic FIFA World Cup 2026 Broadcast Schedule Monumental Slate Features 340 Hours of Live First-Run Programming Across FOX Sports Platfo...

29/01/2026

AI Assistants Head into 2026 on a High Note: Comscore Reports Triple-Digit Growth on Mobile

AI Assistants Head into 2026 on a High Note: Comscore Reports Triple-Digit Growt...

29/01/2026

Broadcom confirms Arvato Systems status as a VCSP partner

Broadcom Confirms Arvato Systems' Status as a VCSP Partner Broadcom Partner Program Update Arvato Systems confirmed as authorized VMware Cloud Service Pr...

29/01/2026

Into the Omniverse: Physical AI Open Models and Frameworks Advance Robots and Autonomous Systems

Editor's note: This post is part of Into the Omniverse, a series focused on ...

29/01/2026

Annette Malone appointed as Chief People Officer RT

RT has today announced that Annette Malone has been appointed to the role of Chief People Officer, RT following a public competition. As Chief People Officer...

29/01/2026

GeForce NOW Brings GeForce RTX Gaming to Linux PCs

Get ready to game - the native GeForce NOW app for Linux PCs is now available in beta, letting Linux desktops tap directly into GeForce RTX performance from the...

28/01/2026

2026 Sundance Film Festival Reveals Short Film Program Award Winners

Top L-R: The Liars, Jazz Infernal, Living with a Visionary Second Row L-R: Paper Trail, The Baddest Speechwriter of All, Crisis Actor Third Row: The Boys and ...

28/01/2026

3 Easy Ways to Discover Music That Fits Your Moment on Spotify

Music discovery should feel intuitive and personal. That's why we're continuing to give you more control, so you can ask for what you want, shape what y...

28/01/2026

From $11B in 2025 Payouts to What We're Building for Artists in 2026

Today, Charlie Hellman, Spotify's Head of Music, shared the following note on the Spotify for Artists blog that the company paid out more than $11 billion t...

28/01/2026

Sediba Scriptwriting Training Programme - Oudtshoorn Municipality (Second Call)

The National Film and Video Foundation (NFVF), in partnership with the Oudtshoorn Municipality, invites aspiring and emerging filmmakers to apply for the Sediba...

28/01/2026

MVP makes a tactical switch to Calrec Argo M

As demand for more complex live sports coverage grows, Balkan broadcast specialist MVP has upgraded its flagship HD1 progressive OB truck with the installation ...

28/01/2026

Aussies' love of travel sees 12% surge in ad investment according to Nielsen

Airlines, cruise and tour operators double down on ad spend as Australians' prioritise travel Sydney January 28, 2026 - New Nielsen Ad Intel data shows a...

28/01/2026

Daniel Finn Joins LABF in Philanthropy Role

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

Tegna Expands Local News Offering with Revamped Mobile App

Share Share by: Copy link Facebook X Linkedin Bluesky Email...

28/01/2026

Marshall Electronics Unveils CV420 27X UHD Camera at ISE...

Marshall Electronics launches the CV420-27X, its next-generation ultra-high-definition (UHD) IP camera, at ISE 2026 (Stand 4N900). Engineered for modern IP-base...

28/01/2026

TVM Selects Grass Valley Technology for OB Truck Refurbis...

Grass Valley has announced that Television Mobiles Ltd. (TVM), one of Europe's leading independent outside broadcast providers, has carried out a major refu...

28/01/2026

FOR-A to show cutting edge technology at FOMEX 2026

AI, graphics and virtual software power new production capabilities FOR-A is bringing remarkable new technologies to FOMEX, the Future of Media Exhibition (ex...

28/01/2026

Riedel and Media Tailor Deliver Unified Broadcast and AV...

Continuing a longstanding collaboration, Riedel Communications and Nordic media technology company Media Tailor have once again joined forces to deliver a state...

28/01/2026

Pebble appoints Paul Nagle-Smith to drive fulfilment

Pebble has appointed Paul Nagle-Smith as vice president for customer fulfilment, strengthening its senior leadership focus on customer delivery and operational ...

28/01/2026

TV Azteca Strengthens Disaster Recovery Capabilities with...

Cloud playout solutions provider, Veset has announced that leading Mexican broadcaster, TV Azteca is using Veset Nimbus on AWS as a disaster recovery (DR) playo...

28/01/2026

MVP kicks off major football tournament with a tactical s...

Ensuring it can keep pace with a rapidly evolving live sports market, Balkan broadcast facility provider MVP Most Valuable Production has upgraded its flags...

28/01/2026

Akamai and Yospace Deliver Seamless Personalized Ad Exper...

Akamai Technologies, Inc. (NASDAQ: AKAM), the cloud solutions provider that powers and protects life online, and Yospace, the leader in dynamic ad insertion tec...

28/01/2026

Clear-Com Empowers Reykjavik City Theatre with New Upgrad...

The renowned Reykjavik City Theatre (RCT) recently underwent a major intercom system upgrade using Clear-Com solutions. This milestone project utilizes Clear-C...

28/01/2026

SES Acknowledges Fitch's Rating Action and Reiterates Deleveraging Plan

Luxembourg, January 26, 2026 - SES S.A. ( SES or the Company ), a leading space solutions company, acknowledges the credit rating action announced by Fitch to...