Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

25/03/2026

Samsung Launches Shoppable TV Experience with Amazon

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Gray Media to Simulcast 2026 Atlanta Braves to Home Opener

Share Copy link Facebook X Linkedin Bluesky Email...

25/03/2026

Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at NAB Show

Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at...

25/03/2026

XLNTSOUND Elevates Video Production with Blackmagic Design

XLNTSOUND Elevates Video Production with Blackmagic Design Brie Clayton March 24, 2026 0 Comments Audio company upgrades workflow with Blackmagic Cine...

25/03/2026

First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom Platform at NAB 2026

First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom ...

24/03/2026

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 NAB Show

Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 N...

24/03/2026

NAB 2026: Mediaproxy Highlights Enhancements to its LogServer suite at NAB Show 2026

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Sh...

24/03/2026

Canada's Cgep de Jonquire and Calrec Take Five With a TV Studio Upgrade

C gep de Jonqui re, a public college in Qu bec, has upgraded its TV studio complex with five Calrec Brio consoles and a Dante IP network. The installation was c...

24/03/2026

American Association of Professional Baseball Expands Broadcast Partnerships with RYZ, Bally Sports Live, NLSE, FTF Sports, and SLVR

The American Association of Professional Baseball (AAPB) has announced new and r...

24/03/2026

Ateme KYRION Enabled NT's Nationwide Contribution Network During Southeast Asian Games 2025

National Telecom Public Company Limited (NT) used Ateme's KYRION platform fo...

24/03/2026

FDJ United Upgrades Lottery Production with Grass Valley UHD Cameras

Grass Valley has expanded its relationship with ImSoPROD, the TV production entity of FDJ United, with the deployment of LDX C98 compact cameras across its nati...

24/03/2026

Scripps Sports Launches Free Streaming Channel Scripps Sports Network on March 24

The E.W. Scripps Company is launching Scripps Sports Network (SSN), a free, ad-s...

24/03/2026

SVG Sit-Down: NEP Platform VP Dan Murphy on Software-Driven Production and the Future of Live Sports Workflows

NEP Group has launched NEP Platform, a new software orchestration system that un...

24/03/2026

Daktronics Installs New Video Display and Ribbon Boards at Chase Field

Daktronics has partnered with the Arizona Diamondbacks to design, manufacture and install a new LED video display and three ribbon boards at Chase Field in Phoe...

24/03/2026

Grass Valley Upgrades University of Pittsburgh Athletics to ST 2110 IP Production Infrastructure

Grass Valley has completed an upgrade of University of Pittsburgh Athletics'...

24/03/2026

Daktronics to Upgrade LED Displays at Wrigley Field

Daktronics is upgrading eight LED displays at Wrigley Field in Chicago, totaling more than 8,300 square feet, using the Daktronics Renew product line. The upgra...

24/03/2026

ASG Appoints Kevin Poole as Senior Project and Support Manager

Advanced Systems Group has appointed Kevin Poole as Senior Project and Support Manager within the ASG Workflow and Tools practice. The position is newly created...

24/03/2026

SVG New Sponsor Spotlight: Verimatrix's Juan Martinez on Safeguarding Live Sports Content

In an increasingly streaming-centric world, protecting high-value live sports co...

24/03/2026

The Countdown Is On! Prep for Vegas with SVG's SportsTech@NABShow Blog

Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Show, April 19-22 in Las Vegas, booth W1423. The update includes AI tools, native ...

24/03/2026

The Creator Economy's Growing Impact: Building the Modern Production Studio With Second Rodeo Productions' CEO Scott Brown

The production studio has worked with content juggernauts such as MrBeast, The R...

24/03/2026

MLB Local Media To Keynote Regional Sports Production Summit, June 29-30, Denver

The event will also feature a State of the Industry address from sports-media veteran and strategic advisor Patrick Crakes....

24/03/2026

Victory+ Launches NWSL Sunday Night Soccer Franchise

Victory , a free sports streaming service owned by A Parent Media Co. (APMC), has launched its NWSL Sunday Night Soccer franchise. The platform says the launch ...

24/03/2026

FAST Sports: Contrary to Some Data, Sports Does Have a Future on FAST

Sports content in free streaming is still relatively scant, but it's growing, right along with its monetization capabilities Streaming-tech company Wurl re...

24/03/2026

New Doc Sports Heaven: The Birth of ESPN' Produced by ESPN Historian Mike Soltys Arriving April 6

Directed by Greg DeHart, the doc will feature Sports Broadcasting Hall of Famers...

24/03/2026

Tubi Unveils Plans for Creator-Driven Formula 1 Altcasts in Partnership With Apple TV

For the first time ever, Tubi - Fox's free streaming service - is working w...

24/03/2026

What Does 19% Year-Over-Year Growth Sound Like? For Canadian Artists, It Sounds Like a Career

As the music industry gathers for Canada's Juno Awards, the local edition of...

24/03/2026

Meet SongDNA, a New Beta Feature That Reveals the Creative Connections Behind Your Favorite Tracks

Behind every great song is a complex web of people, stories, and inspirations th...

24/03/2026

The Big Picture' Co-Host Sean Fennessey on Spielberg and the Art of the Interview

Few filmmakers have shaped popular cinema as profoundly as Steven Spielberg. So ...

24/03/2026

ALM/Busy Circuits announce the Quaid Gigaslope & FMco

Latest Eurorack modules revealed ALM/Busy Circuits have just introduced another two Eurorack modules, delivering a powerful new modulator that builds on the...

24/03/2026

Akai Pro unveil the MPC Sample

Smallest, most affordable MPC to date Akai Pro have just introduced their most accessible standalone sampler to date, making the iconic MPC experience avail...

24/03/2026

Electro-Harmonix release Oceans Abyss editor

Create & manage presets on Windows & macOS Electro-Harmonix have announced that their free Mac/Windows application now allows users of their Oceans Abyss re...

24/03/2026

Rohde & Schwarz amplifiers enable high-field immunity testing expansion at IB Lenhardt Lab

Rohde & Schwarz amplifiers enable high-field immunity testing expansion at IB Le...

24/03/2026

NFVF CALL FOR PROPOSALS: FEMALE FILMMAKER PROJECT FACILITATING COMPANY 2026

The National Film and Video Foundation (NFVF) invites eligible Tier 1 and 2 South African production companies to submit proposals to serve as the Facilitating ...

24/03/2026

L3Harris Ramps Up Production for Counter-Unmanned Systems

L3Harris ramps up production of its VAMPIRE C-UxS system....

24/03/2026

Delivering Victory Through Fuzing Precision and Scale

For more than 70 years, L3Harris has delivered essential fuzes and safe-and-arm solutions that bring the might to multi-domain battlefields across the globe, ...

24/03/2026

Clear-Coms EQUIP Wireless System Keeps Youth With A Mission - South Korea Connected

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

24/03/2026

Craft Interview: Rick Bernier, Senior Broadcast Audio A1 Engineer

Rick Bernier reflects on a career that has taken him to the very top of live broadcast audio. As a Senior Broadcast Audio A1 Engineer and Music Director, he has...

24/03/2026

FDJ United Leaves Nothing to Chance with UHD Lottery Prod...

Grass Valley has strengthened its long-standing relationship with ImSoPROD, the TV production entity of the FDJ United, with the deployment of Grass Valley LDX ...

24/03/2026

Utah Scientific to Showcase a Variety of Hybrid SDI IP In...

At the 2026 NAB Show in Las Vegas, Utah Scientific will spotlight its expanding portfolio of hybrid SDI/IP routing, conversion, control, and signal management s...

24/03/2026

Miri V410 Live 4K Encoder-Decoder to Make North American...

Fresh off its global reveal at ISE 2026 in Barcelona, the new V410 live 4K encoder/decoder from Miri Technologies Inc. will make its North American debut at the...

24/03/2026

Cinegy delivers software defined television for the real...

Cinegy GmbH, premier provider of software-defined television technology, will show how its solutions answer the real challenges facing content creators and broa...

24/03/2026

ArtSound FM Futureproofs with DHD Audio Production Consol...

Canberra-based radio and online broadcast network ArtSound FM (https://artsound.fm/) has invested in DHD audio mixing consoles for two new studios at its headqu...

24/03/2026

IBC unveils 2026 Accelerator projects tackling industry c...

IBC today announced the nine projects selected for its 2026 Accelerator Media Innovation Programme, bringing together organisations from across broadcast, strea...

24/03/2026

Mediaproxy Highlights Significant Enhancements to its Log...

Mediaproxy, the global standard for software-based IP compliance monitoring and multiviewing solutions, will showcase the next generation of its industry-leadin...

24/03/2026

Cegep de Jonquiere and Calrec take five with a substantia...

Underscoring its global reputation as one of Canada's most renowned colleges for television production, the C gep de Jonqui re public college in Qu bec has ...