NVIDIA H100 GPUs Set Standard for Generative AI in Debut MLPerf Benchmark
27/06/2023
H100 GPUs set new records on all eight tests in the latest MLPerf training benchmarks released today, excelling on a new MLPerf test for generative AI. That excellence is delivered both per-accelerator and at-scale in massive servers.
For example, on a commercially available cluster of 3,584 H100 GPUs co-developed by startup Inflection AI and operated by CoreWeave, a cloud service provider specializing in GPU-accelerated workloads, the system completed the massive GPT-3-based training benchmark in less than eleven minutes.
Our customers are building state-of-the-art generative AI and LLMs at scale today, thanks to our thousands of H100 GPUs on fast, low-latency InfiniBand networks, said Brian Venturo, co-founder and CTO of CoreWeave. Our joint MLPerf submission with NVIDIA clearly demonstrates the great performance our customers enjoy.
Top Performance Available Today Inflection AI harnessed that performance to build the advanced LLM behind its first personal AI, Pi, which stands for personal intelligence. The company will act as an AI studio, creating personal AIs users can interact with in simple, natural ways.
Anyone can experience the power of a personal AI today based on our state-of-the-art large language model that was trained on CoreWeave's powerful network of H100 GPUs, said Mustafa Suleyman, CEO of Inflection AI.
Co-founded in early 2022 by Mustafa and Kar n Simonyan of DeepMind and Reid Hoffman, Inflection AI aims to work with CoreWeave to build one of the largest computing clusters in the world using NVIDIA GPUs.
Tale of the Tape These user experiences reflect the performance demonstrated in the MLPerf benchmarks announced today.
H100 GPUs delivered the highest performance on every benchmark, including large language models, recommenders, computer vision, medical imaging and speech recognition. They were the only chips to run all eight tests, demonstrating the versatility of the NVIDIA AI platform.
Excellence Running at Scale Training is typically a job run at scale by many GPUs working in tandem. On every MLPerf test, H100 GPUs set new at-scale performance records for AI training.
Optimizations across the full technology stack enabled near linear performance scaling on the demanding LLM test as submissions scaled from hundreds to thousands of H100 GPUs.
In addition, CoreWeave delivered from the cloud similar performance to what NVIDIA achieved from an AI supercomputer running in a local data center. That's a testament to the low-latency networking of the NVIDIA Quantum-2 InfiniBand networking CoreWeave uses.
In this round, MLPerf also updated its benchmark for recommendation systems.
The new test uses a larger data set and a more modern AI model to better reflect the challenges cloud service providers face. NVIDIA was the only company to submit results on the enhanced benchmark.
An Expanding NVIDIA AI Ecosystem Nearly a dozen companies submitted results on the NVIDIA platform in this round. Their work shows NVIDIA AI is backed by the industry's broadest ecosystem in machine learning.
Submissions came from major system makers that include ASUS, Dell Technologies, GIGABYTE, Lenovo, and QCT. More than 30 submissions ran on H100 GPUs.
This level of participation lets users know they can get great performance with NVIDIA AI both in the cloud and in servers running in their own data centers.
Performance Across All Workloads NVIDIA ecosystem partners participate in MLPerf because they know it's a valuable tool for customers evaluating AI platforms and vendors.
The benchmarks cover workloads users care about - computer vision, translation and reinforcement learning, in addition to generative AI and recommendation systems.
Users can rely on MLPerf results to make informed buying decisions, because the tests are transparent and objective. The benchmarks enjoy backing from a broad group that includes Arm, Baidu, Facebook AI, Google, Harvard, Intel, Microsoft, Stanford and the University of Toronto.
MLPerf results are available today on H100, L4 and NVIDIA Jetson platforms across AI training, inference and HPC benchmarks. We'll be making submissions on NVIDIA Grace Hopper systems in future MLPerf rounds as well.
The Importance of Energy Efficiency As AI's performance requirements grow, it's essential to expand the efficiency of how that performance is achieved. That's what accelerated computing does.
Data centers accelerated with NVIDIA GPUs use fewer server nodes, so they use less rack space and energy. In addition, accelerated networking boosts efficiency and performance, and ongoing software optimizations bring x-factor gains on the same hardware.
Energy-efficient performance is good for the planet and business, too. Increased performance can speed time to market and let organizations build more advanced applications.
Energy efficiency also reduces costs because data centers accelerated with NVIDIA GPUs use fewer server nodes. Indeed, NVIDIA powers 22 of the top 30 supercomputers on the latest Green500 list.
Software Available to All NVIDIA AI Enterprise, the software layer of the NVIDIA AI platform, enables optimized performance on leading accelerated computing infrastructure. The software comes with the enterprise-grade support, security and reliability required to run AI in the corporate data center.
All the software used for these tests is available from the MLPerf repository, so virtually anyone can get these world-class results.
Optimizations are continuously folded into containers available on NGC, NVIDIA's catalog for GPU-accelerated software.
Read this technical blog for a deeper dive into the optimizations fueling NVIDIA'
LINK: | https://blogs.nvidia.com/blog/2023/06/27/generative-ai-debut-mlperf/... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
20/05/2024
Sony-Apollo's Bid for Paramount Gets Serious
A bid from Sony Pictures Entertainment and Apollo Global Management to acquire Paramount gained steam late last week, according to a report in the New York Time...
20/05/2024
Vizrt Unveils Viz Libro 8.3 With New Social Media Cropping Function
BERGEN, Norway Vizrt has released Viz Libero 8.3 with the announcement that its latest software version enables users to crop video to various aspect ratios fro...
20/05/2024
The Vampire Next Door Created with Pocket Cinema Camera 6K and DaVinci Resolve
The Vampire Next Door Created with Pocket Cinema Camera 6K and DaVinci Resolve Brie Clayton May 20, 2024 0 Comments Blackmagic Design today announced ...
20/05/2024
Tom Wills To Retire After Nearly 50 Years at WJXT Jacksonville
Tom Wills, long-running anchor at WJXT Jacksonville, Florida, has announced his retirement. He started at WJXT in 1975 and has anchored early-evening news for o...
20/05/2024
AMC Networks Promotes Emily Gotto to Senior VP at Shudder
AMC Networks said it promoted Emily Gotto to senior VP of acquisition and production for Shudder, the company's horror-themed streaming service....
20/05/2024
Paramount Names Jonathan Bingaman President, Domestic Multi-Platform Licensing & Distribution
Jonathan Bingaman has been named president, domestic multi-platform licensing & ...
20/05/2024
DLT Entertainment Gets FAST Laughs With 80's Sitcom Flashback Channel
Producer and distributor DLT Entertainment said it launched a free ad-supported streaming television (FAST) channel called 80's Sitcom Flashback....
20/05/2024
Zeam Media Names Sandie Trombert CMO
Zeam Media said it hired Sandie Trombert as chief marketing officer....
20/05/2024
Meet the VFX producer
Angus Berryman, VFX producer at UNIT studio tells TVBEurope how perseverance paid off as his career progressed By Matthew Corrigan Published: May 20, 2024 ...
20/05/2024
Sony signs NDA with Paramount Global but is reticent about earlier plan
The New York Times said the move was a significant step forward in their effort to court Paramount By Matthew Corrigan Published: May 20, 2024 The New Yor...
20/05/2024
CBC HR Team Getting Ballpark Staff Ready to Play Ball
A pair of stalwart members of the Capitol Broadcasting's dream team have been getting the company's two Coastal Plain League teams ready to launch their...
20/05/2024
RIP: Two deaths' on Shaka ILembe' production
RIP: Two deaths' on Shaka ILembe' productionTwo people, who are part of the Shaka Ilembe' production set to return for a second season, have repo...
20/05/2024
Gangsterism in movies and television: Wees geskool'
Gangsterism in movies and television: Wees geskool'Gangsterism has been portrayed in movies and television: but have you ever seen these films and televisi...
20/05/2024
School project features Die Antwoord' [Watch]
School project features Die Antwoord' [Watch]School projects are difficult. However, this student took some inspiration from the controversial band Die An...
20/05/2024
Tonight on Skeem Saam: Ntswaki sneaks Toby into the house but sadly for her, Leeto arrives unannounced
Tonight on Skeem Saam: Ntswaki sneaks Toby into the house but sadly for her, Lee...
20/05/2024
Thales and Nokia partner to deliver seamless renewal to London Underground
Facebook Twitter LinkedIn Thales, with its transmission network technology partner, Nokia, has been selected by Transport for London (TfL) to deliver an i...
20/05/2024
May 17, 2024
Scripps Research chemists develop new method for making gamma chiral centers on simple carboxylic acids C-H activation-based method should speed drug molecule ...
20/05/2024
First European Election Major TV Debate this Monday Night on Upfront with Katie Hannon
As part of RT 's extensive coverage in the run up to the European Parliament...
19/05/2024
TV Techs Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
19/05/2024
The CW Shares Its 2024-2025 Lineup
LeVar Burton will host the new game show Trivial Pursuit on The CW, while Raven-Symon will host Scrabble....
19/05/2024
Biden, Trump Agree to Debates on CNN, ABC
President Joe Biden and former President Donald Trump have agreed to debates, set for June 27 on CNN and September 10 on ABC....
19/05/2024
End of the Line for Young Sheldon' on May 16
Young Sheldon signs off after seven seasons on CBS, when the series finale airs Thursday, May 18. Jim Parsons and Mayim Bialik reprise their roles as Sheldon Co...
19/05/2024
House of Zwide' June Spoiler: The Zwides recover their millions
House of Zwide' June Spoiler: The Zwides recover their millions The House of Zwide' June teasers reveal that Funani and Nkosi will recover a share of t...
18/05/2024
If Bundling Is Back, What's the Ideal Bundle?
PORTSMOUTH, N.H. Bundling is back in a big way, with all the major streaming companies and many pay TV operators exploring ways to simplify the consumer experie...
18/05/2024
FCC to Vote on LPTV Rules during June Open Meeting
WASHINGTON, D.C. Federal Communications Commission Chairwoman Jessica Rosenworcel has announced a tentative agenda for the June Open Commission Meeting schedule...
18/05/2024
Matthews Launches New Multipurpose Grip Rail Telescopic Grid Pipe Solution
Matthews Studio Equipment has introduced Grip Rail, which the company said offers a better way to mount equipment on location, in the studio, or on the fly....
18/05/2024
IAB Tech Labs, Google Partner on New First Party Data Solution
In a notable development in the industry-wide effort to address privacy concerns while improving efficacy of marketing efforts in a cookieless ad landscape, IAB...
18/05/2024
TV Tech Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
18/05/2024
DHD Elevates the Art of Podcast Production
DHD Elevates the Art of Podcast Production Brie Clayton May 17, 2024 0 Comments Hero image: the DHD DX2 base and expansion modules Latest-generation ...
18/05/2024
Skeem Saam: Friday's episode, 17 May 2024 [video]
Skeem Saam: Friday's episode, 17 May 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soapi...
18/05/2024
Shaka Ilembe' approved for season three
Shaka Ilembe' approved for season threeMzansi Magic's hit series Shaka Ilembe' which stars Nomzama Mbatha has been commissioned for a third season....
17/05/2024
Aerojet Rocketdyne's Camden Site Leverages Modernization Investments to Accelerate Solid Rocket Motor Production
Aerojet Rocketdyne has worked to modernize facilities at its Camden, Arkansas, l...
17/05/2024
FCC Plans to Revise LPTV Rules
The FCC has issued a Notice of Proposed Rulemaking (NPRM) that would revise rules governing low power TV stations (LPTV) in a number of areas, including online ...
17/05/2024
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4 Brie Clayton May 17, 2024 0 Comments With the spring release of Maxon One, we...
17/05/2024
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio Brie Clayton May 17, 2024 0 Comments Hero image credit: 2023 TOHO CO., LT...
17/05/2024
Sterling Event Group Streamlines Live Event Productions with AJA
Sterling Event Group Streamlines Live Event Productions with AJA Brie Clayton May 17, 2024 0 Comments Live event productions only happen once, which ...
17/05/2024
Meet the product manager
Muster Ngobi, product manager at LYNX Technik tells TVBEurope how the ever-evolving media industry provides a truly dynamic working environment By Matthew Corr...
17/05/2024
TV, Streaming Schedule for 2024 NFL Regular Season Is Released
NEW YORK As declines in linear TV viewing make the ongoing popularity of live sports, particularly football, central to financial success of the TV industry, th...
17/05/2024
Netflix Ad Tier Hits 40M Monthly Active Users
During Netflixs second Upfront presentation to advertisers, Amy Reinhard, Netflix's president of advertising, walked advertisers through the continued growt...
17/05/2024
Scripps Promotes Jeff Kiernan to VP, Local News
CINCINNATI The E.W. Scripps Company has added to its leadership team for news by promoting Jeff Kiernan a veteran journalist and general manager of Scripps'...
17/05/2024
Survey: New Disney-Fox-WBD Sports Streamer May Hurt Pay TV Sub Counts
Top executives from Disney, Fox and Warner Bros. Discovery have consistently insisted that their joint venture to launch the Venu Sports streaming bundle in the...
17/05/2024
Caitlin Clark's WNBA Debut Set Viewing Records
ESPN has announced that its coverage of Caitlin Clark's WNBA debut in the Indiana Fever versus the Connecticut Sun season opener was the most-watched WNBA g...
17/05/2024
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K Brie Clayton May 16, 2024 0 Comments Blackmagic Design announced today that Yoic...
17/05/2024
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vook, and Vancouver Film School
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vo...
17/05/2024
WBD Upfront Show Offers Peeks at House of the Dragon,' White Lotus,' Biden-Trump Debate
The Warner Bros. Discovery upfront presentation took place Wednesday, May 15 at ...
17/05/2024
The Black Keys, Jelly Roll, Kate Hudson Set To Perform on The Voice' Finale
Season 25 of The Voice wraps on NBC Tuesday, May 21, with performances from The Black Keys, Jelly Roll, Kate Hudson, Lainey Wilson, Muni Long, Thomas Rhett and ...
17/05/2024
CNN Boss Mark Thompson's Plan Includes More News in More Categories on More Devices (Upfronts)
New CNN CEO Mark Thompson spelled out his plan for the struggling news network d...
17/05/2024
Netflix To Launch In-House Advertising Tech Platform
Netflix, a newcomer to the advertising business, said it plans to launch an in-house advertising technology platform....