Sony Pixel Power calrec Sony

How to Avoid Speed Bumps and Stay in the AI Fast Lane with Hybrid Cloud Infrastructure

30/11/2020

Cloud or on premises? That's the question many organizations ask when building AI infrastructure.

Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.

As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.

This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.

Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.

Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.

One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.

As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.

At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.

The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.

It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.

Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.

For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.

This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.

Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.

Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.

Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.

With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.

Learn more about Google Cloud's Anthos.

Learn more about NVIDIA DGX A100.
LINK: https://blogs.nvidia.com/blog/2020/11/30/dgx-hybrid-cloud-infrastructu...
See more stories from nvidia

Most recent headlines

20/01/2021

NAMM 2021: Korg's synth trio

Three new instruments unveiled Korg have triggered the annual NAMM announcement avalanche with three new hardware synthesizers, each harking back to a bygon...

20/01/2021

NAMM 2021: Black Lion Audio release their first ever interface

Revolution 2x2 promises premium performance Black Lion Audio started life as a modding company, providing after-market upgrades to studio gear, in particula...

20/01/2021

NAMM 2021: Amp routers and re-amper from Radial

Trio of handy gizmos from Canadian DI experts Radial Engineering have used the online NAMM Believe In Music show to announce a trio of handy routing devices...

20/01/2021

NAMM 2021: Two new APB processors from McDSP

Royal Mu & Royal Q will be free to registered owners McDSP have just announced two new processors for their pioneering computer-controlled analogue processo...

20/01/2021

NAMM 2021: Ashdown debut studio monitors

New speakers aim for modern LS3/5a sound British bass-amp brand Ashdown have just announced a surprise entry to the studio monitor market, with two new near...

20/01/2021

NAMM 2021: Bus-powered Zen Go interface from Antelope

Features Synergy Core processing Not to be outdone by Black Lion Audio, whose premium bus-powered desktop interface we reported on at the beginning of the w...

20/01/2021

NAMM 2021: Nugen Stereoizer Elements announced

Powerful stereo width adjustment made easy Nugen Audio, the Leeds, UK-based plug-in team behind the unique Paragon reverb, are due to release a cut-down ver...

20/01/2021

CEO's 2020 Year in Review and 2021 Preview

20 01 2021 - Media release CEO's 2020 Year in Review and 2021 Preview Mystery Road S2, Bluey, Miss Fisher and the Crypt of Tears 2020 was shaping up to b...

20/01/2021

DHD Audio RX2/XC2 Audio Mixing System Goes On Air at NRJ Norway

DHD Audio RX2/XC2 Audio Mixing System Goes On Air at NRJ Norway data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg...

20/01/2021

Soul Cinematography (with Matt Aspbury) GCS255

Soul Cinematography (with Matt Aspbury) GCS255 data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bpthumb.jpg data-srcset=http...

20/01/2021

TAG Video Systems Appoints Roy Folkman VP Sales North American and LATAM

TAG Video Systems Appoints Roy Folkman VP Sales North American and LATAM data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf4-bp...

20/01/2021

Small Giant Produces Big Results for Top TV Clients by Optimizing Pandemic Production Techniques

Small Giant Produces Big Results for Top TV Clients by Optimizing Pandemic Produ...

20/01/2021

Densitron adds two new products to acclaimed UReady TM control surface range

Densitron adds two new products to acclaimed UReady TM control surface range data-src=https://creativecow.net/wp-content/uploads/avatars/263018/5fa08c562aaf...

20/01/2021

Choirs, meetings and more gone virtual: A Brady Bunch experience

At this point, we've all experienced the ups and downs of working remotely and staying socially distanced. We've held Zoom meetings, taken online classe...

20/01/2021

A new dawn: VSNs 2021 Kick Off begins

After a year full of inconveniences and uncertainty, VSN starts again the first quarter of 2021 with its usual sales Kick Off. On this occasion, and due to the ...

20/01/2021

MultiDyne's Bob McAlpine Retires

HAUPPAUGE, N.Y.-Bob McAlpine is heading to retirement, as MultiDyne announced on Jan. 18 that McAlpine has stepped down as the company's chief operating off...

20/01/2021

Vizrt Revises Product Offering With Flexible Access

BERGEN, Norway-Vizrt has announced a move to a friction-free subscription model, which the company says will give its customers the flexibility to adapt to me...

20/01/2021

Paramount+ Sets March 4 Launch Date

NEW YORK-Paramount+, the rebranded version of the CBS All Access streaming service from ViacomCBS, will officially launch on March 4 in the U.S., Canada and Lat...

20/01/2021

Roy Folkman Joins TAG as VP Sales North America and LATAM

TEL AVIV, Israel-TAG Video Systems has appointed industry veteran Roy Folkman as vice president of sales North America and LATAM. Folkman, who is based in Ontar...

20/01/2021

HBO Max Garners Most New Streaming Subs in Q4, Kantar Reports

NEW YORK-Wonder Woman saved the day for HBO Max, helping the AT&T-owned streaming service earn the most new streaming subscribers for the fourth quarter of 2020...

20/01/2021

Cartoni UV-C Boxer Proven to Neutralize Microorganisms, Including COVID

ROME-Cartoni has shared that its UV-C Boxer was recently certified by Texas-based Microchem Laboratory as being able to neutralize microorganisms, including COV...

20/01/2021

Supreme Court Probes Broadcast Dereg Arguments

WASHINGTON-The FCC and National Association of Broadcasters made their virtual arguments to the Supreme Court Tuesday, Jan. 19, on why a lower court (the Third ...

20/01/2021

FCC Modifies DTS Rules for ATSC 3.0 Flexibility

WASHINGTON-The FCC released an update to its DTS (distributed transmission system) coverage rules to expand the permissible range of signal spillover and replac...

20/01/2021

CES Panels Highlight Streaming's Growing Pains

Streaming video's rapid expansion-fueled by explosive growth during the COVID-19 outbreak-will continue to increase in coming years, along the way finding a...

20/01/2021

Vizrt's Flexible Access Billing Model Allows Content Creators To Scale Use of Software Tools as Needed

Vizrt's Flexible Access Billing Model Allows Content Creators To Scale Use o...

20/01/2021

La franquicia Caf de la Maana' de Spotify: un podcast original de noticias hecho especialmente para Amrica Latina

A quienes les gusta comenzar su d a con podcasts de noticias, buscan historias i...

20/01/2021

Spotify's Morning Coffee' Franchise: A Daily Original News Podcast Brewed Especially for Latin America

Those who like to start their day with news podcasts look for intriguing and acc...

20/01/2021

RT 2FM RISING LIST FOR 2021 REVEALED

RT 2FM RISING INTRODUCES LISTENERS TO THE BEST IN NEW IRISH MUSIC RT 2FM today revealed its exciting 2FM Rising list for 2021. This prestigious list, chosen ...

20/01/2021

Beidh RT i dteannta scolir na hArdteiste agus an Teastais Shisearaigh ant-am ar fad an t-earrach seo

Shakespeare ar an Domhnach, bhar oideachais ar rte.ie/learn, cl racha raidi nu...

20/01/2021

RT with Leaving and Junior Cycle students every step of the way this spring

Shakespeare on Sunday' is a new strand for RT 2, starting this Sunday, which will broadcast Shakespeare productions for Leaving and Junior Cycle students du...

19/01/2021

A Trusted Companion: AI Software Keeps Drivers Safe and Focused on the Road Ahead

Editor's note: This is the latest post in our NVIDIA DRIVE Labs series, whic...

19/01/2021

New Dedicated Support Website Now Available!

Tekst: Were proud to introduce a brand-new support website that aims at gathering all support and knowledge based info in a single destination. Moving forwa...

19/01/2021

NIKOLAJ COSTER-WALDAU AND JOE COLE STAR IN NETFLIX FEATURE FILM AGAINST THE ICE

Back to All News NIKOLAJ COSTER-WALDAU AND JOE COLE STAR IN NETFLIX FEATURE FILM AGAINST THE ICE Entertainment 19 January 2021 GlobalDenmark - THE FILM, DI...

19/01/2021

Netflix to Release Sky Rojo on March 19

Back to All News Netflix to Release Sky Rojo on March 19 Entertainment 19 January 2021 GlobalSpain Stay alive for five more minutes. That's the plan. ...

19/01/2021

Aledade Raises $100 Million Series D to Help More Primary Care Practices Thrive in Value-Based Care

New Funding Will Power Growth of Nationwide Network of More than One Million Pat...

19/01/2021

Aledade: Improving Data-Driven Patient Outcomes

By Somesh Dash, Michael Miao, Becca Faust, and Jules Maltz The ongoing health crisis brought on by COVID-19 has made us especially appreciative of the contribu...

19/01/2021

TechnipFMC Announces Offering of $850,000,000 Senior Notes

Press release | January 19 2021 TechnipFMC Announces Offering of $850,000,000 Senior Notes -- LONDON & PARIS & HOUSTON--(BUSINESS WIRE)-- Regulatory News: ...

19/01/2021

DIGIGRAM APPOINTS A NEW MANAGEMENT TEAM

Three Executive Directors to meet an ambitious company strategy Montbonnot, France, January 18th, 2021 - The French audio equipment manufacturer Digigram has a...

19/01/2021

Aviteng Joins Cinegy A Business Partners

PRESS RELEASE Aviteng Joins Cinegy A Business Partners Munich, Germany, 13 January 2021: Cinegy GmbH opened its Istanbul office Cinegy A at the beginning o...

19/01/2021

The Live Production Benefits of Integrated Camera Control

Tyngsboro, Mass. - Jan 19, 2021 -- Did you know you can quickly and easily control all your show cameras from any Broadcast Pix integrated production system? D...

19/01/2021

Arvato Systems becomes Member of Microsoft Intelligent Security Association

Arvato Systems Becomes Member of Microsoft Intelligent Security Association Further expansion of IT security expertise G tersloh - Arvato Systems has now bec...

19/01/2021

2021-01-19

The iPhone 12 lineup delivers advanced camera systems, and with A14 Bionic - the fastest chip in a smartphone - powerful computational photography features to a...

19/01/2021

Densitron adds two new products to acclaimed UReady control surface range

Densitron, the global leader in innovative Human Machine Interaction (HMI) and display technology, has announced two significant new additions to its popular UR...

19/01/2021

PHABRIX releases the latest Qx Series V4.2 software

PHABRIX is pleased to release the latest V4.2 software for its Qx Series of advanced hybrid IP/SDI test and measurement rasterizers. QxL V4.2 offers simultan...

19/01/2021

Desktop bus-powered Zen Go interface from Antelope

Features Synergy Core processing Not to be outdone by Black Lion Audio, whose premium bus-powered desktop interface we reported on at the beginning of the w...

19/01/2021

Nugen Stereoizer Elements announced

Powerful stereo width adjustment made easy Nugen Audio, the Leeds, UK-based plug-in team behind the unique Paragon reverb, have released a cut-down version ...

19/01/2021

Primetime Ratings Thursday: ABC on Top With Celeb Wheel of Fortune'

ABC had the winning score in Thursday prime, with Celebrity Wheel of Fortune putting up a robust rating. ABC got a 0.8 in viewers 18-49, per the Nielsen overnig...

19/01/2021

Sinclair Set to Launch National Desk Jan. 18

Sinclair Broadcast Group said it will launch its new weekday morning news show The National Desk on Jan. 18....

19/01/2021

Young Rock' Starts on NBC Feb. 16

Young Rock, a comedy about Dwayne Johnson's early life, starts on NBC Feb. 16. It leads into the series premiere of Kenan Thompson comedy Kenan....