Sony Pixel Power calrec Sony

Cloud Service, OEMs Raise the Bar on AI Training with NVIDIA AI

01/12/2021

Look who just set new speed records for training AI models fast: Dell Technologies, Inspur, Supermicro and - in its debut on the MLPerf benchmarks - Azure, all using NVIDIA AI.

Our platform set records across all eight popular workloads in the MLPerf training 1.1 results announced today.

NVIDIA AI trained all models faster than any alternative in the latest round. NVIDIA A100 Tensor Core GPUs delivered the best normalized per-chip performance. They scaled with NVIDIA InfiniBand networking and our software stack to deliver the fastest time to train on Selene, our in-house AI supercomputer based on the modular NVIDIA DGX SuperPOD.

NVIDIA A100 GPUs delivered the best per-chip training performance in all eight MLPerf 1.1 tests. A Cloud Sails to the Top When it comes to training AI models, Azure's NDm A100 v4 instance is the fastest on the planet, according to the latest results. It ran every test in the latest round and scaled up to 2,048 A100 GPUs.

Azure showed not only great performance, but great performance that's available for anyone to rent and use today, in six regions across the U.S.

AI training is a big job that requires big iron. And we want users to train models at record speed with the service or system of their choice.

That's why we're enabling NVIDIA AI with products for cloud services, co-location services, corporations and scientific computing centers, too.

Server Makers Flex Their Muscles Among OEMs, Inspur set the most records in single-node performance with its eight-way GPU systems, the NF5688M6 and the liquid-cooled NF5488A5. Dell and Supermicro set records on four-way A100 GPU systems.

A total of 10 NVIDIA partners submitted results in the round, eight OEMs and two cloud-service providers. They made up more than 90 percent of all submissions.

This is the fifth and strongest showing to date for the NVIDIA ecosystem in training tests from MLPerf.

Our partners do this work because they know MLPerf is the only industry-standard, peer-reviewed benchmark for AI training and inference. It's a valuable tool for customers evaluating AI platforms and vendors.

Servers Certified for Speed Baidu PaddlePaddle, Dell Technologies, Fujitsu, GIGABYTE, Hewlett Packard Enterprise, Inspur, Lenovo and Supermicro submitted results in local data centers, running jobs on both single and multiple nodes.

Nearly all our OEM partners ran tests on NVIDIA-Certified Systems, servers we validate for enterprise customers who want accelerated computing.

The range of submissions shows the breadth and maturity of an NVIDIA platform that provides optimal solutions for businesses working at any scale.

Both Fast and Flexible NVIDIA AI was the only platform participants used to make submissions across all benchmarks and use cases, demonstrating versatility as well as high performance. Systems that are both fast and flexible provide the productivity customers need to speed their work.

The training benchmarks cover eight of today's most popular AI workloads and scenarios - computer vision, natural language processing, recommendation systems, reinforcement learning and more.

MLPerf's tests are transparent and objective, so users can rely on the results to make informed buying decisions. The industry benchmarking group, formed in May 2018, is backed by dozens of industry leaders including Alibaba, Arm, Google, Intel and NVIDIA.

20x Speedups in Three Years Looking back, the numbers show performance gains on our A100 GPUs of over 5x in just the last 18 months. That's thanks to continuous innovations in software, the lion's share of our work these days.

NVIDIA's performance has increased more than 20x since the MLPerf tests debuted three years ago. That massive speedup is a result of the advances we make across our full-stack offering of GPUs, networks, systems and software.

NVIDIA AI delivers more than 20x improvements over three years. Constantly Improving Software Our latest advances came from multiple software improvements.

For example, using a new class of memory copy operations, we achieved 2.5x faster operations on the 3D-UNet benchmark for medical imaging.

Thanks to ways you can fine-tune GPUs for parallel processing, we realized a 10 percent speed up on the Mask R-CNN test for object detection and a 27 percent boost for recommender systems. We simply overlapped independent operations, a technique that's especially powerful for jobs that run across many GPUs.

We expanded our use of CUDA graphs to minimize communication with the host CPU. That brought a 6 percent performance gain on the ResNet-50 benchmark for image classification.

And we implemented two new techniques on NCCL, our library that optimizes communications among GPUs. That accelerated results up to 5 percent on large language models like BERT.

Leverage Our Hard Work All the software we used is available from the MLPerf repository, so everyone can get our world-class results. We continuously fold these optimizations into containers available on NGC, our software hub for GPU applications.

It's part of a full-stack platform, proven in the latest industry benchmarks, and available from a variety of partners to tackle real AI jobs today.
LINK: https://blogs.nvidia.com/blog/2021/12/01/mlperf-ai-cloud-service-oems/...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

28/10/2025

SVG All-Stars: Catherine Chalfant, Manager, Remote Operations, ESPN

SVG All-Stars: Catherine Chalfant, Manager, Remote Operations, ESPNThe Ole Miss alum is an operational force behind ESPN's extensive college-football catalo...

28/10/2025

Elevating the Experience: AI and Data Take Ryder Cup to the Next Level

Elevating the experience: AI and data take Ryder Cup to the next level By Joe OHalloran Tuesday, October 28, 2025 - 10:25 Print This Story NBC produced th...

28/10/2025

Conquering the Air (Waves): Taking a Close Up Look at the IBC Accelerator Private 5G from Land to Sea to Sky'

Conquering the Air (waves): Taking a close up look at the IBC Accelerator Priva...

28/10/2025

World Series 2025: Spectrum SportsNet LA Brings Dodgers Fans Closer to the Action With Pre/Postgame Coverage

World Series 2025: Spectrum SportsNet LA Brings Dodgers Fans Closer to the Actio...

28/10/2025

The Thing with Feathers Brings the Horror of Grief to the Screen

Dylan Southern and Benedict Cumberbatch at the premiere of The Thing with Feathers (photo by George Pimentel / Shutterstock for Sundance Film Festival)...

28/10/2025

Spotify's Greasy Tunes Caf Serves Up the Sights, Sounds, and Flavors of Lagos

For three weeks in Lagos, Spotify's Greasy Tunes Caf pop-up brought the cit...

28/10/2025

Spotify's New OFFCULT Playlist Is a Love Letter to the Future of German Rap

Once a niche subculture, German rap has evolved into an influential cultural movement. Now, Spotify is giving the genre a new home with OFFCULT, a playlist dedi...

28/10/2025

Shane Delia's Malta serves up the Mediterranean this summer

Shane Delia's Malta serves up the Mediterranean this summer 28 October, 2025 Media releases Feast on 9,000 years of culinary history Mondays from 24 No...

28/10/2025

SBS's global sporting festival continues with the FIVB Beach Volleyball World Championships in Adelaide

SBS's global sporting festival continues with the FIVB Beach Volleyball Worl...

28/10/2025

AgileTV achieves ISO/IEC 27001 certification, strengthening its commitment to secure and reliable video services

Bilbao, October 28, 2025 - AgileTV, a leading technology solutions company for t...

28/10/2025

Football Scores Extra Points for Multi-Platform Companies in Nielsen's September Media Distributor Gauge

Disney, NBCUniversal, FOX, Paramount Each Achieve Double-Digit Monthly Growth ...

28/10/2025

Scripps to Sell WRTV to Circle City Broadcasting for $83 million

CINCINNATI The E.W. Scripps Company has announced an agreement to sell WRTV, its local ABC-affiliated station in Indianapolis, to Circle City Broadcasting for $...

28/10/2025

Berklee College of Music and Berklee Valencia Named to Billboards 2025 Top Music Business Schools List

Berklee College of Music and Berklee Valencia Named to Billboards 2025 Top Music...

28/10/2025

Survey: Consumers Rank AI as a Major Influence on Their Shopping Decisions

NEW YORK As AI usage continues to spike, a new study from IAB delves into an important aspect of how AI is transforming the advertising business with new data s...

28/10/2025

Broadcast Tech Pioneer Charlie Jablonski Has Died

Charlie Jablonski, a broadcast tech pioneer who helped shape the modern era of Olympics television coverage, died Oct. 25 at his home in Lake George N.Y., the N...

28/10/2025

Bitmovin Unveils Real-Time Observability Solution for Video Streaming

VIENNA, Austria Bitmovin has launched Bitmovin Observability, a new stand-alone video data solution that delivers real-time insights into video playback. The so...

28/10/2025

LucidLink Now Integrated With Adobe Frame.io

LOS ANGELES LucidLink, the file streaming platform, has announced a Frame.io integration and expanded mobile capabilities at Adobe Max....

28/10/2025

Mediagenix Joins AWS ISV Accelerate Program

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, today announced that it has joined the Ama...

28/10/2025

Lightware Taurus product family introduces 5K support

Lightware, an industry leader in connectivity and signal management solutions, has announced a major update to its Taurus platform, which now delivers flawless...

28/10/2025

Hiltron to Promote its Broad Range of Satcom Products and...

Following a successful mid-September International Broadcasting Convention in Amsterdam, Hiltron Communications will promote its full range of satellite communi...

28/10/2025

Open Broadcast Systems Selects Media Consulting and Servi...

Open Broadcast Systems has chosen MC&S (Media Consulting & Services) as a reseller to help strengthen its presence in France. With over twenty years of experi...

28/10/2025

Bitmovin Unveils Real-Time Observability Solution for Vid...

Bitmovin, leading provider of video streaming solutions, has launched Bitmovin Observability, a new stand-alone video data solution that delivers real-time insi...

28/10/2025

Ease Live Powers Interactive Champions League Viewer Expe...

Ease Live, the leader in interactive TV technology, today announced the successful launch of interactive graphical overlays for UEFA Champions League matches fo...

28/10/2025

LucidLink unveils Frame io integration and expanded mobil...

LucidLink, the file streaming platform, today at Adobe MAX announced a Frame.io integration and expanded mobile capabilities, streamlining collaboration and hel...

28/10/2025

Nick Hascenez Named GM of WNDU South Bend

ATLANTA Gray Media has promoted Nick Hasenecz to general manager of WNDU, its NBC affiliate in the South Bend-Elkhart, Ind., market....

28/10/2025

Applications Open for Berklee Fenway Neighborhood Improvement Grant

Applications Open for Berklee Fenway Neighborhood Improvement Grant Boston nonprofits can apply by December 12 for funding to support community projects that ...

28/10/2025

VEON's JazzCash Wins Silver Award for Innovation in Lending at Money20/20 USA 2025

28 Oct 2025 VEON's JazzCash Wins Silver Award for Innovation in Lending at ...

28/10/2025

A League of Their Own returns on 12 November as Romesh, Jamie, Jill and Micah celebrate the farewell series with a star-studded line-up

Guests include Wayne Rooney, Maya Jama, Dame Laura Kenny, Chloe Kelly, Chris McC...

28/10/2025

Cynthia Erivo and Ariana Grande to lead a once-in-a-lifetime musical event, Wicked: One Wonderful Night

The two-hour special, recorded live from the iconic Dolby Theatre in LA, will ai...

28/10/2025

Eutelsat upgrades teleports with Rohde & Schwarz satellite uplink amplifiers

Eutelsat upgrades teleports with Rohde & Schwarz satellite uplink amplifiers High efficiency and resilient Ku-band amplifiers for excellent RF performance ...

28/10/2025

ABC Welcomes Three New Board Members

These appointments come at a pivotal time for ABC, as the organisation continues to evolve to meet the changing needs of a digital-first media ecosystem. The ne...

28/10/2025

October 27, 2025

Scripps Research awarded $4 million to advance platform for neurodevelopmental disorders The California Institute for Regenerative Medicine (CIRM) grant support...

27/10/2025

You Can Touch This: Haptics Becoming Central to the Virtual Live Experience

You can touch this: Haptics becoming central to the virtual live experience By Adrian Pennington Friday, October 24, 2025 - 09:12 Print This Story The vid...

27/10/2025

A Tale of Two Trailers: France's Stop & Go Doubles Up With its New Hybrid Truck

A tale of two trailers: France's Stop & Go doubles up with its new hybrid tr...

27/10/2025

Pro Padel League Stages City's Cup Finals Inside NYC's Hammerstein Ballroom

Pro Padel League Stages City's Cup Finals Inside NYC's Hammerstein Ballr...

27/10/2025

World Series 2025: Sportsnet Delivers Made-in-Canada' Moment for a Nation United Behind the Toronto Blue Jays

World Series 2025: Sportsnet Delivers Made-in-Canada' Moment for a Nation U...

27/10/2025

ESPN Extends Partnership With Sony's Beyond Sports To Expand Animated Alternate Telecasts

ESPN Extends Partnership With Sony's Beyond Sports To Expand Animated Altern...

27/10/2025

Life After Examines the Implications of a Growing Right-to-Die Movement

Reid Davenport attends the 2025 Sundance Film Festival premiere of Life After at The Ray Theatre on January 27, 2025, in Park City, UT. (Photo by Robin Marsha...

27/10/2025

5 Eerie Audiobooks to Listen to During the Halloween Season

As the days grow shorter and the nights get darker, there's nothing like getting swept up in a story that sends shivers down your spine. In honor of spooky ...

27/10/2025

[UPDATED] Verizon Fios TV, Nexstar Blackout Looms as Contract Ends on Oct. 24

UPDATE: Both parties have reached a new carriage agreement....

27/10/2025

Study: Mini-Dramas Attract Mega Audiences

LONDON As Hollywood jumps into the production of mini-dramas, a new study from Ampere Analysis finds that more than one in 10 internet users have watched drama ...

27/10/2025

Yealink Unveils SmartVision 80 PTZ Camera With NDI Support

LONDON Yealink, a provider of unified communication and collaboration solutions, has joined the NDI ecosystem with the availability of its SmartVision 80 premiu...

27/10/2025

Gray Media Taps Chris Conroy as GM of Cleveland Stations

ATLANTA Gray Media has named Chris Conroy as general manager of its stations in Cleveland, leading WOIO, a CBS affiliate, The CW station WUAB and Telemundo outl...

27/10/2025

Ericsson, Nokia and Fraunhofer HHI Partner on 6G Video Coding Standard

ESPOO, Finland European connectivity leaders Nokia and Ericsson, have partnered with Berlin's Fraunhofer Heinrich Hertz Institute (HHI), to shape and drive ...

27/10/2025

Comcast Expands Its NOW TV Latino Offering

PHILADELPHIA Comcast has expanded NOW TV Latino, its Spanish-language live TV and streaming offering, adding five more channels from Univision, ViX Premium with...

27/10/2025

Leader to showcase hybrid IP and remote production soluti...

Test & measurement innovator, Leader Electronics, will present its latest products and solutions at InterBEE 2025 (Hall 5, Booth 5218) Makuhari Messe in Chiba, ...

27/10/2025

'City of Shadows,' the New Netflix Thriller Arrives on December 12

Back to All News City of Shadows, the New Netflix Thriller Arrives on December 12 Entertainment 27 October 2025 GlobalSpain Link copied to clipboard Downl...