Cloud or on premises? That's the question many organizations ask when building AI infrastructure.
Cloud computing can help developers get a fast start with minimal cost. It's great for early experimentation and supporting temporary needs.
As businesses iterate on their AI models, however, they can become increasingly complex, consume more compute cycles and involve exponentially larger datasets. The costs of data gravity can escalate, with more time and money spent pushing large datasets from where they're generated to where compute resources reside.
This AI development speed bump is often an inflection point where organizations realize there are opex benefits with on-premises or collocated infrastructure. Its fixed costs can support rapid iteration at the lowest cost per training run, complementing their cloud usage.
Conversely, for organizations whose datasets are created in the cloud and live there, procuring compute resources adjacent to that data makes sense. Whether on-prem or in the cloud, minimizing data travel - by keeping large volumes as close to compute resources as possible - helps minimize the impact of data gravity on operating costs.
Own the Base, Rent the Spike' Businesses that ultimately embrace hybrid cloud infrastructure trace a familiar trajectory.
One customer developing an image recognition application immediately benefited from a fast, effortless start in the cloud.
As their database grew to millions of images, costs rose and processing slowed, causing their data scientists to become more cautious in refining their models.
At this tipping point - when a fixed cost infrastructure was justified - they shifted training workloads to an on-prem NVIDIA DGX system. This enabled an immediate return to rapid, creative experimentation, allowing the business to build on the great start enabled by the cloud.
The saying own the base, rent the spike captures this situation. Enterprise IT provisions on-prem DGX infrastructure to support the steady-state volume of AI workloads and retains the ability to burst to the cloud whenever extra capacity is needed.
It's this hybrid cloud approach that can secure the continuous availability of compute resources for developers while ensuring the lowest cost per training run.
Delivering the AI Hybrid Cloud with DGX and Google Cloud's Anthos on Bare Metal To help businesses embrace hybrid cloud infrastructure, NVIDIA has introduced support for Google Cloud's Anthos on bare metal for its DGX A100 systems.
For customers using Kubernetes to straddle cloud GPU compute instances and on-prem DGX infrastructure, Anthos on bare metal enables a consistent development and operational experience across deployments, while reducing expensive overhead and improving developer productivity.
This presents several benefits to enterprises. While many have implemented GPU-accelerated AI in their data centers, much of the world retains some legacy x86 compute infrastructure. With Anthos on bare metal, IT can easily add on-prem DGX systems to their infrastructure to tackle AI workloads and manage it the same familiar way, all without the need for a hypervisor layer.
Without the need for a virtual machine, Anthos on bare metal - now generally available - manages application deployment and health across existing environments for more efficient operations. Anthos on bare metal can also manage application containers on a wide variety of performance, GPU-optimized hardware types and allows for direct application access to hardware.
Anthos on bare metal provides customers with more choice over how and where they run applications and workloads, said Rayn Veerubhotla, Director of Partner Engineering at Google Cloud. NVIDIA's support for Anthos on bare metal means customers can seamlessly deploy NVIDIA's GPU Device Plugin directly on their hardware, enabling increased performance and flexibility to balance ML workloads across hybrid environments.
Additionally, teams can access their favorite NVIDIA NGC containers, Helm charts and AI models from anywhere.
With this combination, enterprises can enjoy the rapid start and elasticity of resources offered on Google Cloud, as well as the secure performance of dedicated on-prem DGX infrastructure.
Learn more about Google Cloud's Anthos.
Learn more about NVIDIA DGX A100.
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
24/04/2024
24 04 2024 - Media release Screen Australia celebrates Australian projects bound...
24/04/2024
Berklee Online to Hold 2024 Berklee Onsite Music Conference May 31-June 1 The in-person conference is open to Berklee Online students and the music community ...
24/04/2024
Kargo said it has launched a new product that gives advertisers more details about the connected TV campaigns they are buying....
24/04/2024
Mundo Hispano Digital said it has launched MundoNow Connect, which is designed to use first-party audience data to help advertisers reach Latino connected-TV vi...
24/04/2024
Brittney Griner, the WNBA star who spent 10 months in a Russian prison, sits with Robin Roberts for a primetime special on ABC Wednesday, May 1. The 20/20 speci...
24/04/2024
To give its subscribers more content to pick from, DirecTV Stream is making deals to carry streaming channels from Cineverse and additional digital multicast ch...
24/04/2024
Jenny Padura has been promoted to co-anchor on the 6 and 11 p.m. newscasts at WLTV Miami, known as Univision 23. She starts April 25 and will anchor with Ambros...
24/04/2024
Paris Schutz has joined WFLD Chicago, known as Fox 32, as a political reporter. He starts April 29 and will handle all political coverage for the station, repor...
24/04/2024
Plex has made a deal with the National Football League that will let users watch the NFL Channel, the league's free ad-supported streaming television (FAST)...
24/04/2024
Arnold Schwarzenegger and Sylvester Stallone sit for a chat when TMZ Presents: Arnold & Sly: Rivals, Friends, Icons debuts on Fox Tuesday, April 23. The pair di...
24/04/2024
Lionsgate Television said it signed a new multiyear employment agreement with executive VP, worldwide production, Gary Goodman....
24/04/2024
Miguelangel Lopez, WTMO Orlando (Florida) VP of news, has been named regional VP of news and content for WTMO, WRMD Tampa and WWDT Fort Myers, effective immedia...
23/04/2024
Psychology can play an important role in helping us understand what audiences respond to (Dr Jon Roozenbeek, Cambridge Social Decision-Making Lab)
For newsroom...
23/04/2024
IN ADDITION TO FICTION AND DOCUMENTARY FEATURES, THE SELECTION INCLUDES:
PRO...
23/04/2024
Today, we announced our first quarter 2024 earnings. In a solid start to the year, Spotify reported
Monthly Active Users grew 19% Y/Y to 615 million.
Subscri...
23/04/2024
Idag publicerar Spotify sina finansiella resultat f r f rsta kvartalet 2024. ret har inletts stabilt:
M natliga aktiva anv ndare kade med 19 % j mf rt med f...
23/04/2024
In the last decade, as K-Pop cemented its status as a global phenomenon, Spotify has helped fans around the world keep their fingers on the pulse at every step ...
23/04/2024
Social entrepreneur Hedayat Osyan wins Les Murray Award for Refugee Recognition
23 April, 2024
Media releases
The prestigious award is now in its third yea...
23/04/2024
LONDON IBC is now accepting nominations for its IBC2024 Innovation Awards, which honor achievements in technological innovation and social impact media & entert...
23/04/2024
WASHINGTON, D.C. In response to the introduction of the Broadcast VOICES Act that seeks to encourage more diversity in the ownership of TV and radio stations, t...
23/04/2024
MIAMI, Fla. As part of a push to expand its FAST channel and streaming operations, Hemisphere Media Group has launched its free ad supported television (FAST) c...
23/04/2024
LOS ANGELES DirecTV is adding seven new channels to its rapidly expanding streaming lineup through new licensing agreements with Cineverse Corp. and Scripps Net...
23/04/2024
Entitled Our Creative Future, the manifesto calls for radical new action' t...
23/04/2024
The company has secured investment from private equity firm PAI Partners, which also holds a stake in outside broadcasting company EMG
By Jenny Priestley
Pub...
23/04/2024
Cameron also said he recognised Marlow as a potential UK and European base for his new company, LIGHTSTORM 3D
By Matthew Corrigan
Published: April 23, 2024 ...
23/04/2024
The five categories cover Content Creation, Content Distribution, Content Everywhere, Social Impact and Environment & Sustainability
By Matthew Corrigan
Publ...
23/04/2024
He played a central role in securing key broadcast rights, including the FIFA World Cup 2018 and 2022
By Matthew Corrigan
Published: April 23, 2024
He pla...
23/04/2024
IBC is preparing to honour the highest achievements in technological innovation and social impact with the launch of its prestigious IBC2024 Innovation Awards, ...
23/04/2024
BREA, Calif. Bolin Technology is integrating Network Device Interface (NDI) across its product line, bringing support for the latest NDI technologies to its PTZ...
23/04/2024
WYOMISSING, Pa. PENN Entertainment has announced that longtime Disney and ESPN executive Aaron LaBerge has been named chief technology officer effective July 1,...
23/04/2024
In response to an FCC ruling in March proposing a $1.2 million fine against Nexstar and a ruling that Mission Broadcasting sell WPIX, Nexstar has filled a respo...
23/04/2024
Sony has announced new details about how the National Hot Rod Association (NHRA) is using Sony's Ci Media Cloud platform to streamline its workflows and spe...
23/04/2024
Esports' rapid rise to popularity can be attributed to many factors, from technological advancements that have enhanced the quality of modern gaming experie...
23/04/2024
OpenDrives, Inc., the global provider of software-defined media workflow solutions and data management capabilities, has been selected as a winner in the 2024 N...
23/04/2024
BCNEXXT is pleased to announce that Vpe has won the 2024 NAB Show Product of the Year Award in the Asset Management, Automation and Playout category. The offici...
23/04/2024
Gravity Media, a world leading global provider of complex live creative production and media services, today outlined the broadcast technology and television pr...
23/04/2024
Scality, a global leader in cyber-resilient storage for the AI era, today announced the appointment of Peter Brennan as Chief Executive Officer (CEO) of Scality...
23/04/2024
Blackmagic Design today announced ATEM 1 M/E Constellation 4K and ATEM 2 M/E Constellation 4K switchers, two new Ultra HD models of the ATEM Constellation famil...
23/04/2024
Blackmagic Design today announced Blackmagic Videohub 120x120 12G, the newest model in the Videohub 12G router family. The massive Blackmagic Videohub 120x120 1...
23/04/2024
Blackmagic Design today announced new lower prices for Blackmagic Video Assist 3G and 12G models. Customers can save US$200 on all models. These lower prices ma...
23/04/2024
Adder Technology continues to shine brightly, with its groundbreaking product, the ADDERLink INFINITY 3000 (ALIF3000), once again taking center stage. Hot on t...
23/04/2024
Pliant Technologies' CRP-C12 Compact Radio Pack is an Audio Production, Processing and Networking category winner in the 2024 NAB Show Product of the Year A...
23/04/2024
SipRadius, the specialists in live media transport and transcoding, will showcase their world-leading implementation of AV1 and JPEG-XS over transport streams a...
23/04/2024
Composer Rafael Krux has added a Prism Sound Dream ADA-128 modular conversion system to his production studio where he creates music for commercials, trailers, ...
23/04/2024
PMC proudly provides the ultimate large-scale Dolby Atmos audio system for the legendary musician Steven Wilson at the High End, Munich. He will share his exten...
23/04/2024
Particles emitting from a 3D rotating shape's edge
Graham Quince April 22, 2024
0 Comments
In Fixin' FX, people send me their problematic proj...
Cloud or on premises? That's the question many organizations ask when building AI infrastructure.
