Sony Pixel Power calrec Sony

Cloud Service, OEMs Raise the Bar on AI Training with NVIDIA AI

01/12/2021

Look who just set new speed records for training AI models fast: Dell Technologies, Inspur, Supermicro and - in its debut on the MLPerf benchmarks - Azure, all using NVIDIA AI.

Our platform set records across all eight popular workloads in the MLPerf training 1.1 results announced today.

NVIDIA AI trained all models faster than any alternative in the latest round. NVIDIA A100 Tensor Core GPUs delivered the best normalized per-chip performance. They scaled with NVIDIA InfiniBand networking and our software stack to deliver the fastest time to train on Selene, our in-house AI supercomputer based on the modular NVIDIA DGX SuperPOD.

NVIDIA A100 GPUs delivered the best per-chip training performance in all eight MLPerf 1.1 tests. A Cloud Sails to the Top When it comes to training AI models, Azure's NDm A100 v4 instance is the fastest on the planet, according to the latest results. It ran every test in the latest round and scaled up to 2,048 A100 GPUs.

Azure showed not only great performance, but great performance that's available for anyone to rent and use today, in six regions across the U.S.

AI training is a big job that requires big iron. And we want users to train models at record speed with the service or system of their choice.

That's why we're enabling NVIDIA AI with products for cloud services, co-location services, corporations and scientific computing centers, too.

Server Makers Flex Their Muscles Among OEMs, Inspur set the most records in single-node performance with its eight-way GPU systems, the NF5688M6 and the liquid-cooled NF5488A5. Dell and Supermicro set records on four-way A100 GPU systems.

A total of 10 NVIDIA partners submitted results in the round, eight OEMs and two cloud-service providers. They made up more than 90 percent of all submissions.

This is the fifth and strongest showing to date for the NVIDIA ecosystem in training tests from MLPerf.

Our partners do this work because they know MLPerf is the only industry-standard, peer-reviewed benchmark for AI training and inference. It's a valuable tool for customers evaluating AI platforms and vendors.

Servers Certified for Speed Baidu PaddlePaddle, Dell Technologies, Fujitsu, GIGABYTE, Hewlett Packard Enterprise, Inspur, Lenovo and Supermicro submitted results in local data centers, running jobs on both single and multiple nodes.

Nearly all our OEM partners ran tests on NVIDIA-Certified Systems, servers we validate for enterprise customers who want accelerated computing.

The range of submissions shows the breadth and maturity of an NVIDIA platform that provides optimal solutions for businesses working at any scale.

Both Fast and Flexible NVIDIA AI was the only platform participants used to make submissions across all benchmarks and use cases, demonstrating versatility as well as high performance. Systems that are both fast and flexible provide the productivity customers need to speed their work.

The training benchmarks cover eight of today's most popular AI workloads and scenarios - computer vision, natural language processing, recommendation systems, reinforcement learning and more.

MLPerf's tests are transparent and objective, so users can rely on the results to make informed buying decisions. The industry benchmarking group, formed in May 2018, is backed by dozens of industry leaders including Alibaba, Arm, Google, Intel and NVIDIA.

20x Speedups in Three Years Looking back, the numbers show performance gains on our A100 GPUs of over 5x in just the last 18 months. That's thanks to continuous innovations in software, the lion's share of our work these days.

NVIDIA's performance has increased more than 20x since the MLPerf tests debuted three years ago. That massive speedup is a result of the advances we make across our full-stack offering of GPUs, networks, systems and software.

NVIDIA AI delivers more than 20x improvements over three years. Constantly Improving Software Our latest advances came from multiple software improvements.

For example, using a new class of memory copy operations, we achieved 2.5x faster operations on the 3D-UNet benchmark for medical imaging.

Thanks to ways you can fine-tune GPUs for parallel processing, we realized a 10 percent speed up on the Mask R-CNN test for object detection and a 27 percent boost for recommender systems. We simply overlapped independent operations, a technique that's especially powerful for jobs that run across many GPUs.

We expanded our use of CUDA graphs to minimize communication with the host CPU. That brought a 6 percent performance gain on the ResNet-50 benchmark for image classification.

And we implemented two new techniques on NCCL, our library that optimizes communications among GPUs. That accelerated results up to 5 percent on large language models like BERT.

Leverage Our Hard Work All the software we used is available from the MLPerf repository, so everyone can get our world-class results. We continuously fold these optimizations into containers available on NGC, our software hub for GPU applications.

It's part of a full-stack platform, proven in the latest industry benchmarks, and available from a variety of partners to tackle real AI jobs today.
LINK: https://blogs.nvidia.com/blog/2021/12/01/mlperf-ai-cloud-service-oems/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

13/08/2026

CMG Expands Local Sports Offering With Two NBA Deals

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

Olympic Broadcasting Services to receive IBC2026 Internat...

IBC today announced that its most prestigious honour, the International Honour for Excellence (IHFE), will be presented to Olympic Broadcasting Services (OBS), ...

13/08/2026

Dalet Demonstrates the Future of AI-Orchestrated Live Spo...

Dalet, a leading technology and service provider for media-rich organizations, today announced its participation in the IBC2026 Accelerator Media Innovation Pro...

13/08/2026

dzjinius to showcase new dzjinius on-set application at I...

dzjinius, the all-in-one production management platform for the media and entertainment industry, will showcase its new application, dzjinius on-set , at IBC20...

13/08/2026

BCE Demonstrates Sovereign Cloud Media Workflows powered...

Broadcasting Center Europe (BCE), a leading European provider of media services, system integration and product development, will demonstrate an end-to-end sove...

13/08/2026

Clear-Com to Showcase Communications Solutions for Broadc...

Clear-Com is returning to IBC 2026, taking place September 11-14 in Amsterdam, Netherlands. At Stand 10.D29, Clear-Com will spotlight the award-winning FreeSpe...

13/08/2026

Leader to highlight advanced Test and Measurement solutio...

Test & measurement innovator, Leader Electronics of Europe, will showcase its comprehensive portfolio of Leader, PHABRIX and LeaderPhabrix test and measurement ...

13/08/2026

KRK Brings Advanced Wireless Control to Professional Monitoring With New V Series Five Studio MonitorsKRK Brings Advanced Wireless

KRK Brings Advanced Wireless Control to Professional Monitoring With New V Serie...

13/08/2026

Anthony Noack Captures Artist's Journey in Estonia with Blackmagic Design

Anthony Noack Captures Artist's Journey in Estonia with Blackmagic Design Brie Clayton August 12, 2026 0 Comments Solo filmmaker documents concept...

13/08/2026

ARRI Image Science makes its mobile debut in the HONOR Robot Phone

ARRI Image Science makes its mobile debut in the HONOR Robot Phone Brie Clayton August 12, 2026 0 Comments Hero image displays the HONOR Robot Phone, ...

13/08/2026

ASG Adds Eran Binyamin Zeitoun as Senior Technical Program Manager

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

Vinten To Feature Manual, Robotic Camera Support Offerings At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

SMPTE Unveils IBC 2026 Plans

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

IP Showcase on the Water Announces Schedule for IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

Spectrum, Optimum Ink New Deals for News Carriage and Ads

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

IAB Tech Lab Updates Privacy Standards

Share Copy link Facebook X Linkedin Bluesky Email...

13/08/2026

Suitest Highlights New AI-Powered Device Testing and Qual...

Suitest's Test Automation Platform Simplifies Video Quality Assurance, Monitoring, and Device Certification Across the OTT Ecosystem At IBC2026, Suitest, a...

13/08/2026

Cinegy showcases powerful, agile, cost-effective media so...

Cinegy GmbH, the premier provider of software-defined television technology, will have its key software solutions ready to demonstrate at SET Expo 2026 (18 20...

13/08/2026

Scripps Research establishes endowed chair honoring Peter K. Vogt, influential pioneer in cancer research

Scripps Research has established the Peter K. Vogt Endowed Chair, a new faculty ...

13/08/2026

New research offers fresh insights for how to make better vaccines

LA JOLLA, CA-A vaccine's molecular structure plays a key role in determining how the immune system responds and prepares to protect the body from future exp...

13/08/2026

Event Marks New Season with the RT Concert Orchestra

RT 's Miriam O'Callaghan welcomed a range of specially invited guests to the National Concert Hall last week for a unique event to mark a new season wit...

13/08/2026

Seattle Seahawks Become First Team to Bring Dolby OptiView with Dolby Vision to Fans

August 13 2026, 06:00 (PDT) Seattle Seahawks Become First Team to Bring Dolby O...

13/08/2026

Class Is in Session: GeForce NOW Levels Up Linux, Chromebooks and More

GeForce NOW is giving cloud gaming an extra-credit upgrade just in time for back-to-school season. The native Linux app for GeForce NOW is officially out of be...

12/08/2026

Op-Ed: The Versioning Playbook - How Rights Holders are Getting More From Live Events

Traditional live sports production has focused on creating the best possible pro...

12/08/2026

IBC 2026: FOR-A to Demonstrate Production and Processing Solutions

FOR-A will showcase a range of broadcast and production products at IBC2026 (Stand 2.B53, Amsterdam RAI, September 11-14), including software-based switching, A...

12/08/2026

IBC 2026: AMWA and EBU to Demo NMOS BCP-008 Multi-Vendor IP Status Reporting

The Advanced Media Workflow Association (AMWA) and EBU will host live demonstrations of NMOS BCP-008 Minimum Status Reporting at IBC2026 (September 11-14) on th...

12/08/2026

IBC 2026: Dalet Launches Solution Suites for Media Production and Archive Management

Dalet has announced Dalet Solution Suites, a portfolio of cloud-native solutions...

12/08/2026

Net Insight Enables Centralized Remote Production of Blinkfestivalen 2026 for NRK

Net Insight has announced that DMC Production Norway has selected its Open Live ...

12/08/2026

Zixi Appoints Alyson Stewart as Senior Director of Sales

Zixi has appointed Alyson Stewart as Senior Director of Sales. Stewart will be responsible for direct sales and partnerships, with a focus on broadcasters, medi...

12/08/2026

LiveU Powers Host Broadcast Operations at 2026 Glasgow Games

LiveU's LU900Q intelligent production unit was deployed as part of the host broadcast operation for the Games in Glasgow (July 23-August 2, 2026). Host broa...

12/08/2026

Disney+ and ESPN Acquire Multi-Year Formula E Rights Beginning 2026/27 Season

Disney , ESPN, and Formula E have announced a multi-year deal bringing all Formula E races to Disney and ESPN in the U.S. and to Disney in most international...

12/08/2026

PSSI Launches X-LIVE Managed Service for Live Event Transmission

PSSI has launched X-LIVE, a managed service offering dedicated engineering resources and Appear encoding infrastructure for live event signal processing and tra...

12/08/2026

MoonPay X Games League Draws 18.3 Million Viewers in Inaugural Summer Season

The inaugural MoonPay X Games League Summer Season reached 18.3 million unique live viewers across three stops on ABC and ESPN, a 78.5% increase compared to the...

12/08/2026

IBC 2026: BBright Adds RIST Support to IP-Gateway

BBright will showcase an expanded IP-Gateway at IBC2026, adding support for all RIST profiles to its existing support for MPEG Transport Stream over IP with SMP...

12/08/2026

IBC 2026: BBright Adds EBU OGraf Graphics Support to UHD and ST 2110 Playout Platform

BBright will demonstrate EBU OGraf animated graphics support in its software-bas...

12/08/2026

Interra Systems to Showcase QC and Monitoring Solutions at SET Expo 2026

Interra Systems will demonstrate its ORION, BATON, BATON Captions, and VEGA solutions at SET Expo 2026 (August 17-20, Distrito Anhembi, S o Paulo) at partner Li...

12/08/2026

DPA Microphones Appoints Raul Contreras as West Coast Regional Sales Manager

DPA Microphones has appointed Raul Contreras as West Coast Regional Sales Manager. In the role, Contreras will oversee sales and customer relationships througho...

12/08/2026

Save the Date: SVG LIVE! Returns to LA Nov. 10 to Spotlight Sports & Entertainment Production

Live spectacles ranging from the Super Bowl and FIFA World Cup to the Oscars and...

12/08/2026

Love, Separation, and the Cost of Comfort in How to Divorce During the War

Writer-Director Andrius Bla evi ius and crew attend the premiere of How to Divorce During the War at The Ray Theatre on January 26, 2026, in Park City, UT. (P...

12/08/2026

SSL 360 gets a major update

Enhanced DAW & plug-in control for the UC1, UF8 and UF1 The software that powers SSL's range of control surfaces has just received a major update that d...

12/08/2026

Triton Audio launch the Tilt EQ

In-line preamp features one-knob EQ In addition to their range of in-line preamps, Triton Audio recently managed to squeeze a compressor into an enclosure t...

12/08/2026

AudioRoute from Arvital Audio

Captures system audio with or without a DAW Depending on your setup, capturing system audio in a DAW can be a tedious process, so much so that Arvital Audio...

12/08/2026

2026 NATIONAL NAIDOC AWARDS TO BROADCAST ON NITV LIVE AND DIRECT FROM MPARNTWE

2026 NATIONAL NAIDOC AWARDS TO BROADCAST ON NITV LIVE AND DIRECT FROM MPARNTWE 12 August, 2026 Media releases First Nations excellence will be celebrated l...

12/08/2026

More than six million sports fans stay with SBS for Tour de France and Tour de France Femmes Avec Zwift

More than six million sports fans stay with SBS for Tour de France and Tour de F...

12/08/2026

Nielsen Introduces Groundbreaking Streaming Ad Measurement in Brazil

Nielsen is cementing Digital Ad Intel as the new go-to currency for digital ad intelligence in Brazil-now with streaming monitoring in the mix. S o Paulo, Augu...

12/08/2026

LPTV Advocates Petition FCC for Voluntary 5G Broadcasts

Share Copy link Facebook X Linkedin Bluesky Email...

12/08/2026

Tubi Media Group Inks Content Discovery Deal with Gracenote

Share Copy link Facebook X Linkedin Bluesky Email...