Sony Pixel Power calrec Sony

Cloud Service, OEMs Raise the Bar on AI Training with NVIDIA AI

01/12/2021

Look who just set new speed records for training AI models fast: Dell Technologies, Inspur, Supermicro and - in its debut on the MLPerf benchmarks - Azure, all using NVIDIA AI.

Our platform set records across all eight popular workloads in the MLPerf training 1.1 results announced today.

NVIDIA AI trained all models faster than any alternative in the latest round. NVIDIA A100 Tensor Core GPUs delivered the best normalized per-chip performance. They scaled with NVIDIA InfiniBand networking and our software stack to deliver the fastest time to train on Selene, our in-house AI supercomputer based on the modular NVIDIA DGX SuperPOD.

NVIDIA A100 GPUs delivered the best per-chip training performance in all eight MLPerf 1.1 tests. A Cloud Sails to the Top When it comes to training AI models, Azure's NDm A100 v4 instance is the fastest on the planet, according to the latest results. It ran every test in the latest round and scaled up to 2,048 A100 GPUs.

Azure showed not only great performance, but great performance that's available for anyone to rent and use today, in six regions across the U.S.

AI training is a big job that requires big iron. And we want users to train models at record speed with the service or system of their choice.

That's why we're enabling NVIDIA AI with products for cloud services, co-location services, corporations and scientific computing centers, too.

Server Makers Flex Their Muscles Among OEMs, Inspur set the most records in single-node performance with its eight-way GPU systems, the NF5688M6 and the liquid-cooled NF5488A5. Dell and Supermicro set records on four-way A100 GPU systems.

A total of 10 NVIDIA partners submitted results in the round, eight OEMs and two cloud-service providers. They made up more than 90 percent of all submissions.

This is the fifth and strongest showing to date for the NVIDIA ecosystem in training tests from MLPerf.

Our partners do this work because they know MLPerf is the only industry-standard, peer-reviewed benchmark for AI training and inference. It's a valuable tool for customers evaluating AI platforms and vendors.

Servers Certified for Speed Baidu PaddlePaddle, Dell Technologies, Fujitsu, GIGABYTE, Hewlett Packard Enterprise, Inspur, Lenovo and Supermicro submitted results in local data centers, running jobs on both single and multiple nodes.

Nearly all our OEM partners ran tests on NVIDIA-Certified Systems, servers we validate for enterprise customers who want accelerated computing.

The range of submissions shows the breadth and maturity of an NVIDIA platform that provides optimal solutions for businesses working at any scale.

Both Fast and Flexible NVIDIA AI was the only platform participants used to make submissions across all benchmarks and use cases, demonstrating versatility as well as high performance. Systems that are both fast and flexible provide the productivity customers need to speed their work.

The training benchmarks cover eight of today's most popular AI workloads and scenarios - computer vision, natural language processing, recommendation systems, reinforcement learning and more.

MLPerf's tests are transparent and objective, so users can rely on the results to make informed buying decisions. The industry benchmarking group, formed in May 2018, is backed by dozens of industry leaders including Alibaba, Arm, Google, Intel and NVIDIA.

20x Speedups in Three Years Looking back, the numbers show performance gains on our A100 GPUs of over 5x in just the last 18 months. That's thanks to continuous innovations in software, the lion's share of our work these days.

NVIDIA's performance has increased more than 20x since the MLPerf tests debuted three years ago. That massive speedup is a result of the advances we make across our full-stack offering of GPUs, networks, systems and software.

NVIDIA AI delivers more than 20x improvements over three years. Constantly Improving Software Our latest advances came from multiple software improvements.

For example, using a new class of memory copy operations, we achieved 2.5x faster operations on the 3D-UNet benchmark for medical imaging.

Thanks to ways you can fine-tune GPUs for parallel processing, we realized a 10 percent speed up on the Mask R-CNN test for object detection and a 27 percent boost for recommender systems. We simply overlapped independent operations, a technique that's especially powerful for jobs that run across many GPUs.

We expanded our use of CUDA graphs to minimize communication with the host CPU. That brought a 6 percent performance gain on the ResNet-50 benchmark for image classification.

And we implemented two new techniques on NCCL, our library that optimizes communications among GPUs. That accelerated results up to 5 percent on large language models like BERT.

Leverage Our Hard Work All the software we used is available from the MLPerf repository, so everyone can get our world-class results. We continuously fold these optimizations into containers available on NGC, our software hub for GPU applications.

It's part of a full-stack platform, proven in the latest industry benchmarks, and available from a variety of partners to tackle real AI jobs today.
LINK: https://blogs.nvidia.com/blog/2021/12/01/mlperf-ai-cloud-service-oems/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

SVG New Sponsor Spotlight: Flowstate AI's Sahil Shah on Transforming Video Content with Intelligent AI Agents

As sports media organization continue to seek out new ways to streamline their p...

01/04/2026

SVG GFX Forum 2026: Sessions Now Available to Watch on SVG PLAY

The SVG GFX Forum hit New York City earlier this month for a day packed with sessions focused on the creative strategy and technology behind today's cutting...

01/04/2026

From Buenos Aires to Mexico City, EQUAL Days Bring Latin America Together for Women in Audio

This year, Spotify celebrates the five-year anniversary of EQUAL, our global pro...

01/04/2026

FourFingers announce Tape Splice Pro plug-in

Analogue-style tape splicing in the digital domain In this era of digital recording and multiple layers of Undo, it seems that the fading art of tape splici...

01/04/2026

Zero G introduce Morphology Evolved

Latest release introduces new Orbita Engine Zero G's latest release marks the start of a new series of libraries, as well as introducing an all-new engi...

01/04/2026

Warm Audio introduce the WA-8TRX

Until now, one format has largely been left behind Warm Audio's extensive product range includes modern-day recreations of all manner of sought-after s...

01/04/2026

The Crow Hill Company announce Crystal Pianos

A piano with glass vessels for strings! The Crow Hill Company's recently released Gong Piano offered a refreshing new take on piano libraries, harnessin...

01/04/2026

ESSENCE RS from Aim Audio

Remote Streaming Studio Condenser Aim Audio have just revealed their latest creation, the ESSENCE RS Remote Streaming Studio Condenser, which becomes the wo...

01/04/2026

Call for NFVF funding applications to attend Film Festivals and Markets taking place from 08 - 31 May 2026

The National Film and Video Foundation (NFVF) is pleased to announce that the ca...

01/04/2026

AgileTV powers Liwest's next-generation TV experience with the launch of next IPTV platform in Austria

Bilbao, April 1st, 2026 - AgileTV, a leading provider of end-to-end TV technolog...

01/04/2026

Green Hippo Debuts Hands on Hippotizer Media Server Train...

Green Hippo is excited to announce the launch of its new Hippotizer Media Server training courses at Pixel Academy, a purpose built AV learning hub combining ha...

01/04/2026

TAG Video Systems and Oracle Cloud Infrastructure Partner...

TAG Video Systems, a global leader in IP-native broadcast monitoring, multiviewing, and quality control, today announced a collaboration with Oracle Cloud Infra...

01/04/2026

Professional Wireless Systems PWS Takes on Intercom and R...

Professional Wireless Systems (PWS), a leading provider of wireless audio solutions and RF management, was on site at the Caesars Superdome in New Orleans, wher...

01/04/2026

AgileTV powers Liwest next generation TV experience with...

AgileTV, a leading provider of end-to-end TV technology solutions, has deployed next , the new IPTV platform of the Austrian telco LIWEST, marking the first st...

01/04/2026

LTN and Ateme partner to deliver integrated video process...

LTN, a leader in fully managed IP video transport, and Ateme, a global leader in video compression and delivery solutions, today announced a collaboration integ...

01/04/2026

Adobe Unveils Powerful New Innovations for Creative Pros in Adobe Illustrator

Adobe Unveils Powerful New Innovations for Creative Pros in Adobe Illustrator Deepa Subramaniam April 1, 2026 0 Comments I'm excited to share that...

01/04/2026

Boland Communications Introduces QD4K315HDR10 QD-OLED Series Monitors for Live Production, Film, Post, and Broadcast

Boland Communications Introduces QD4K315HDR10 QD-OLED Series Monitors for Live P...

01/04/2026

2026 NAB Show Exhibitor Insight: Evertz

Share Copy link Facebook X Linkedin Bluesky Email...

01/04/2026

Judge Blocks Order Barring NPR and PBS From Funding

Share Copy link Facebook X Linkedin Bluesky Email...

01/04/2026

Nikon to Sell Mark Roberts Motion Control

Share Copy link Facebook X Linkedin Bluesky Email...

01/04/2026

Mediagenix Showcases Semantic Intelligence-Powered Title Management, Schedule Optimization, and Personalization at NAB 2026

Mediagenix Showcases Semantic Intelligence-Powered Title Management, Schedule Op...

01/04/2026

FCC Approves WJAX-TV License Transfer to Cox

Share Copy link Facebook X Linkedin Bluesky Email...

01/04/2026

Scripps Sports Ink Deal for Ion to Air 2026 Teal Rising Cup

Share Copy link Facebook X Linkedin Bluesky Email...

01/04/2026

UK Group Companies Unveil NAB Show Plans

Share Copy link Facebook X Linkedin Bluesky Email...

01/04/2026

Victoria Mont Brings the Multi-Hyphenate Mindset to Career Jam 2026

Victoria Mon t Brings the Multi-Hyphenate Mindset to Career Jam 2026 The Grammy-winning singer, songwriter, and producer shared how versatility and self-inves...

01/04/2026

Rite of Spring - Save on Ivory 3 German D and American Concert D

A New Season of Expression: Save 30% On Ivory 3There are moments in music when everything changes-when new ideas break through and redefine what's possible....

01/04/2026

Binghamton University Strengthens StudentRun Productions With Riedel's SimplyLive RiMotion R12

Wuppertal April 1, 2026 Binghamton University Strengthens Student Run Producti...

01/04/2026

A Demon Falls for a Human in 'Long Vacation': Netflix Greenlights New Romance Series from Director of 'Crash Landing on You'

Back to All News A Demon Falls for a Human in Long Vacation: Netflix Greenlight...

01/04/2026

All WWE Is Now Live Only on Netflix in Italy

Back to All News All WWE Is Now Live Only on Netflix in Italy Entertainment 01 April 2026 GlobalItaly Link copied to clipboard ALL WWE IS NOW LIVE ON NET...

01/04/2026

TDF Expands Broadcast Channel Lineup with Harmonic

Harmonic's Media Processing Solutions Maximize Bandwidth Efficiency for Terrestrial Broadcast Delivery SAN JOSE, Calif. - April 1, 2026 - Harmonic (NASDAQ: ...

01/04/2026

RT and Virgin Media Television kick off comprehensive freetoair coverage of the 2026 Women's Six Nations Championship

Rugby fans won't miss a moment of the action this spring, with full Women...

01/04/2026

Bluey as Gaeilge starts on RT KIDSjr on Easter Monday

T Bluey ag teacht go RT ! Beginning on Monday 6 April 2026, Bluey will be available as Gaeilge on RT KIDSjr and RT Player. Children will be able to connect w...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

31/03/2026

MeyerPro Delivers LED Production for Microsoft Ignite 2025

MeyerPro delivered the LED production for the Microsoft Ignite 2025 keynote at Chase Center in San Francisco, using more than 2,700 ROE Visual panels across mul...

31/03/2026

MC-IF Expands Membership to Include Smaller Technology Companies to Drive VVC Adoption

The Media Coding Industry Forum (MC-IF) is expanding membership outreach in 2026...

31/03/2026

ViewLift and MyOutdoorTV Launch Conversational AI Search

ViewLift and MyOutdoorTV (MOTV) have announced the launch of ViewLift Conversational AI Search on the MyOutdoorTV platform. The feature enables natural language...

31/03/2026

Atlanta Braves and Gray Media to Simulcast 25 Regular Season Games on Over-the-Air Television

The Atlanta Braves and Gray Media have announced a multi-year agreement to simul...

31/03/2026

Gravity Media to Deliver Broadcast Coverage of the Sydney Autumn Racing Carnival

Gravity Media has delivered broadcast services for TAB Golden Slipper Day at Rosehill Gardens on March 21 and will now cover The Star Championships at Royal Ran...

31/03/2026

Mileto Tecnologia Selects Synamedia Go for OTT Expansion

Synamedia has announced that Mileto Tecnologia, a Brazilian pay-TV operator, has selected the Synamedia Go platform for its OTT expansion. Mileto is also deploy...

31/03/2026

NAB 2026: KMH Integration to Present AV Casting Philosophy

KMH Integration will attend NAB Show in Las Vegas with a focus on what the company calls AV Casting - an approach built on the idea that professional AV and bro...

31/03/2026

Prime Video to Air First and Second Rounds of 2026 Masters Tournament

Prime Video will carry live coverage of the first and second rounds of the 2026 Masters Tournament, beginning at 1:00 p.m. ET on Thursday, April 9 and Friday, A...

31/03/2026

NHL, ESPN, TNT Sports and Sportsnet Launch Joint Marketing Campaign for 2026 Stanley Cup Playoffs

The NHL and its U.S. and Canadian broadcast partners have announced a collaborat...

31/03/2026

Daktronics to Install New Video Display and Show Control System at Wake Forest's Allegacy Stadium

Daktronics has partnered with Wake Forest to manufacture and install a new end z...

31/03/2026

NFL Announces Las Vegas to Host Super Bowl LXIII in 2029

The National Football League has announced that Las Vegas will host Super Bowl LXIII in 2029 at Allegiant Stadium. The announcement was made at the NFL Annual M...

31/03/2026

NFL Partners with TMRW Sports to Launch Professional Flag Football League

The NFL has announced a partnership with TMRW Sports to develop and operate a professional flag football league for women and men. The league will launch with i...

31/03/2026

Zac Brown Band and Blake Shelton Deploy Sennheiser Spectera at Las Vegas Residencies

Sennheiser's Spectera wideband bidirectional wireless system was used by bot...