Sony Pixel Power calrec Sony

Cloud Service, OEMs Raise the Bar on AI Training with NVIDIA AI

01/12/2021

Look who just set new speed records for training AI models fast: Dell Technologies, Inspur, Supermicro and - in its debut on the MLPerf benchmarks - Azure, all using NVIDIA AI.

Our platform set records across all eight popular workloads in the MLPerf training 1.1 results announced today.

NVIDIA AI trained all models faster than any alternative in the latest round. NVIDIA A100 Tensor Core GPUs delivered the best normalized per-chip performance. They scaled with NVIDIA InfiniBand networking and our software stack to deliver the fastest time to train on Selene, our in-house AI supercomputer based on the modular NVIDIA DGX SuperPOD.

NVIDIA A100 GPUs delivered the best per-chip training performance in all eight MLPerf 1.1 tests. A Cloud Sails to the Top When it comes to training AI models, Azure's NDm A100 v4 instance is the fastest on the planet, according to the latest results. It ran every test in the latest round and scaled up to 2,048 A100 GPUs.

Azure showed not only great performance, but great performance that's available for anyone to rent and use today, in six regions across the U.S.

AI training is a big job that requires big iron. And we want users to train models at record speed with the service or system of their choice.

That's why we're enabling NVIDIA AI with products for cloud services, co-location services, corporations and scientific computing centers, too.

Server Makers Flex Their Muscles Among OEMs, Inspur set the most records in single-node performance with its eight-way GPU systems, the NF5688M6 and the liquid-cooled NF5488A5. Dell and Supermicro set records on four-way A100 GPU systems.

A total of 10 NVIDIA partners submitted results in the round, eight OEMs and two cloud-service providers. They made up more than 90 percent of all submissions.

This is the fifth and strongest showing to date for the NVIDIA ecosystem in training tests from MLPerf.

Our partners do this work because they know MLPerf is the only industry-standard, peer-reviewed benchmark for AI training and inference. It's a valuable tool for customers evaluating AI platforms and vendors.

Servers Certified for Speed Baidu PaddlePaddle, Dell Technologies, Fujitsu, GIGABYTE, Hewlett Packard Enterprise, Inspur, Lenovo and Supermicro submitted results in local data centers, running jobs on both single and multiple nodes.

Nearly all our OEM partners ran tests on NVIDIA-Certified Systems, servers we validate for enterprise customers who want accelerated computing.

The range of submissions shows the breadth and maturity of an NVIDIA platform that provides optimal solutions for businesses working at any scale.

Both Fast and Flexible NVIDIA AI was the only platform participants used to make submissions across all benchmarks and use cases, demonstrating versatility as well as high performance. Systems that are both fast and flexible provide the productivity customers need to speed their work.

The training benchmarks cover eight of today's most popular AI workloads and scenarios - computer vision, natural language processing, recommendation systems, reinforcement learning and more.

MLPerf's tests are transparent and objective, so users can rely on the results to make informed buying decisions. The industry benchmarking group, formed in May 2018, is backed by dozens of industry leaders including Alibaba, Arm, Google, Intel and NVIDIA.

20x Speedups in Three Years Looking back, the numbers show performance gains on our A100 GPUs of over 5x in just the last 18 months. That's thanks to continuous innovations in software, the lion's share of our work these days.

NVIDIA's performance has increased more than 20x since the MLPerf tests debuted three years ago. That massive speedup is a result of the advances we make across our full-stack offering of GPUs, networks, systems and software.

NVIDIA AI delivers more than 20x improvements over three years. Constantly Improving Software Our latest advances came from multiple software improvements.

For example, using a new class of memory copy operations, we achieved 2.5x faster operations on the 3D-UNet benchmark for medical imaging.

Thanks to ways you can fine-tune GPUs for parallel processing, we realized a 10 percent speed up on the Mask R-CNN test for object detection and a 27 percent boost for recommender systems. We simply overlapped independent operations, a technique that's especially powerful for jobs that run across many GPUs.

We expanded our use of CUDA graphs to minimize communication with the host CPU. That brought a 6 percent performance gain on the ResNet-50 benchmark for image classification.

And we implemented two new techniques on NCCL, our library that optimizes communications among GPUs. That accelerated results up to 5 percent on large language models like BERT.

Leverage Our Hard Work All the software we used is available from the MLPerf repository, so everyone can get our world-class results. We continuously fold these optimizations into containers available on NGC, our software hub for GPU applications.

It's part of a full-stack platform, proven in the latest industry benchmarks, and available from a variety of partners to tackle real AI jobs today.
LINK: https://blogs.nvidia.com/blog/2021/12/01/mlperf-ai-cloud-service-oems/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

04/06/2026

NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI

NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI Brie Clayton June 3, 2026 0 Comments RTX Spark - a 1-Petaflop Superchip, the Full...

04/06/2026

Inside the Peaky Blinders: The Immortal Man Grade

Inside the Peaky Blinders: The Immortal Man Grade Brie Clayton June 3, 2026 0 Comments Simone Grattarola discusses shaping the look in DaVinci Resolve...

04/06/2026

Cine Gear Expo Announces 2026 Awards of Excellence Recipients

Cine Gear Expo Announces 2026 Awards of Excellence Recipients Brie Clayton June 3, 2026 0 Comments Ed Lachman ASC, Caleb Deschanel ASC, and M. David M...

04/06/2026

St. Vincents Live with Orchestra Tour to Feature Berklee Alum Ruby Plume

St. Vincents Live with Orchestra Tour to Feature Berklee Alum Ruby Plume Berklee alumni St. Vincent and Ruby Plume will appear on the same bill across seven d...

03/06/2026

SES Launches Multi-Orbit Satellite Inflight Connectivity on Viva Airlines

SES and Viva, Mexico's ultra low-cost airline, have launched multi-orbit satellite inflight connectivity on Viva's Airbus aircraft. A total of 60 A320s ...

03/06/2026

CFP, ESPN, and TNT Sports Announce 2026-27 College Football Playoff Broadcast Schedule

The College Football Playoff, ESPN, and TNT Sports have announced kick times and...

03/06/2026

RED Digital Cinema to Host Panels and Demos at Cine Gear Expo 2026

RED Digital Cinema will exhibit at Cine Gear Expo 2026 (Booth 33, June 5-6, Universal Studios Lot), hosting three panels and hands-on product demonstrations. P...

03/06/2026

Roku Launches Soccer Zone for FIFA World Cup 2026

Roku has announced the Soccer Zone, a dedicated hub for FIFA World Cup 2026 content available across the United States, Canada, Mexico, Brazil, Colombia, Argent...

03/06/2026

Liverpool FC and Wasabi Technologies Renew Multi-Year Partnership

Liverpool FC and Wasabi Technologies have announced a multi-year extension of their partnership, with Wasabi continuing as the club's official cloud storage...

03/06/2026

Sky News Australia Deploys Grass Valley AMPP for Cloud-Based Newsroom Production

Grass Valley has announced that Australian News Channel (ANC), operator of Sky News Australia, has deployed Grass Valley AMPP as part of the relocation of its n...

03/06/2026

Gudrun Scharler Appointed CEO of Riedel Networks

The Riedel Group has announced the appointment of Gudrun Scharler as CEO of Riedel Networks. She succeeds Michael Martens, who has led Riedel Networks since 201...

03/06/2026

Clear-Com Deploys Arcadia Central Station and FreeSpeak II at Itaka Arena in Poland

Clear-Com has announced the deployment of its intercom solutions at Itaka Arena ...

03/06/2026

Scott Coker Announces Six Executive Hires for New MMA Promotion

Scott Coker has announced six senior executive appointments for his new global MMA promotion, which launched earlier this year with $60 million in financing. Ad...

03/06/2026

Telemundo Announces Digital and Social Media Plans for FIFA World Cup 2026

Telemundo, the exclusive Spanish-language home of the FIFA World Cup 2026, has announced its digital and social media programming for the tournament, running Ju...

03/06/2026

Bundesliga Launches AI Assistant 'Captain' in Official App, Developed With AWS

The Bundesliga has announced the launch of Captain, an AI assistant built into t...

03/06/2026

Anthony James Partners Serving as Technology Consultant for UNC Kenan Stadium Modernization

Anthony James Partners (AJP) is serving as technology consultant for a moderniza...

03/06/2026

Audio-Technica Presents 2025-26 Samurai and Presidents Awards

Audio-Technica has announced the recipients of its annual sales rep firm awards for the 2025-26 fiscal year. The awards were presented by Jim Schanz, Executive ...

03/06/2026

iodyne to Demo Multi-Cam Ingest and Color Workflows With RED and Adobe at Cine Gear Expo 2026

iodyne will exhibit at Cine Gear Expo 2026 alongside RED Digital Cinema and Adob...

03/06/2026

Women's College World Series 2026: ESPN Brings Out Cinematic Cameras, POVORA CapCams for All-Texas Championship

The broadcaster will deploy 39 cameras for game coverage, six cameras for studio...

03/06/2026

How Comcast Xfinity Made RealTime 4K, Multiview a Reality for World Cup Fans with Vito Forlenza

The 2026 FIFA World Cup is providing a great opportunity for not only Fox Sports...

03/06/2026

Sonys New PTZ Cameras Deliver 4K 60p; New STARVIS Sensor Meets Low-Light Demands

Sony Electronics is introducing the SRG-AS10, a 4K 60p compatible PTZ Auto Framing camera that uses Sony's proprietary AI to automatically recognize and tra...

03/06/2026

NBA Finals 2026: ESPN's 1080p HDR Experience Drives San Antonio Spurs vs. New York Knicks Title Series

Game Creek Video's Flagship A, B, C, and D unit will wind up its first year ...

03/06/2026

New Sponsor Spotlight: Caretta Researchs Evangelos Vrysellas Says Booming Sports-Rights Market May Be Hitting the Brakes

According to Caretta Research, the sports-rights market may be hitting the brake...

03/06/2026

Film Festival Watch: Catch These 11 Must-See Sundance Institute-Supported Films at Tribeca 2026

Retrieval still courtesy of Tribeca. By Jessica Herndon This year, the Tribeca...

03/06/2026

Beat Panner from Sound Particles

Step sequencer-style panning tool revealed Alongside their flagship self-titled sound-design platform, Sound Particles offer an array of creative effects an...

03/06/2026

Eventide to launch the H9 Harmonizer Gen 2

Now features full H90 algorithm library Eventide have announced the upcoming launch of the H9 Harmonizer Gen 2, a new and improved version of their hugely p...

03/06/2026

Aim Audio's Essence price drop

Significant discount available until 1 October 2026 Aim Audio have just announced a promotion that sees a significant discount applied to their Essence micr...

03/06/2026

Clarification: SBS's position on definitions of antisemitism

Clarification: SBS's position on definitions of antisemitism 3 June, 2026 Media releases Statement by Mandi Wicks, SBS Director of News and Current Aff...

03/06/2026

Rohde & Schwarz to supply CERTIUM advanced communications system to Memmingen Airport

Rohde & Schwarz to supply CERTIUM advanced communications system to Memmingen Ai...

03/06/2026

Clear-Com Powers Itaka Arena with Arcadia Central Station and FreeSpeak II beltpacks

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

03/06/2026

Comcast Xfinity to Deliver 4K Coverage of FIFA World Cup 2026

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

Sony to Show New PTZ Cameras at InfoComm 2026

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

Oklahoma City Thunder Tops Nielsen Ranking of Most Viewed NBA Teams

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

SmallHD Introduces OLED 16 4K Production Monitor

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

ANDREW WILSON DELIVERS AUTHENTIC SOUND FOR FILM USING NU...

For more than three decades, Re-recording Mixer Andrew Wilson, AMPS, CAS, has helped bring the natural world to the screen with exceptional audio enjoyed by mil...

03/06/2026

From Stadiums to Campuses to Corporate Studios- Telestrea...

Telestream, a global leader in media workflow technologies, will showcase its latest innovations for modern AV production environments at InfoComm 2026 (Booth N...

03/06/2026

DPA ADVANCES INTEGRATED AUDIO SOLUTIONS FOR PRO AV ENVIR...

DPA Microphones will present a comprehensive portfolio of integrated audio solutions designed to meet the evolving needs of today's professional AV environm...

03/06/2026

Lightware Expands Gemini GVN With Full-Featured USB-C

Lightware announces the GVN-HC-TX220AP, a new transmitter in the Gemini GVN 1G AV-over-IP family that introduces full-featured USB-C for professional 1Gb AV-ove...

03/06/2026

Minno Teams with Evergent to Enhance Faith-Based Streamin...

Evergent, the customer management and monetization leader for streaming and digital subscription businesses, and Minno, the global leader in faith-based content...

03/06/2026

Alfalite brings its LED technology to RTVE iconic Teatro...

Alfalite, Europe's only LED display manufacturer, has completed a new broadcast installation with the deployment of two UHD Finepix 1.5 MATIX AlfaCOB LED di...

03/06/2026

Broadcast Solutions delivers new Ultra HD outside broadca...

Broadcast Solutions, a leading systems integrator and provider of innovative solutions for the broadcast media industry, is completing a contract to build eight...

03/06/2026

NAB Launches Merkhet Solutions to Advance Deployment of BPS

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

FCC Kicks Off First Spectrum Auction in Four Years

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

Utopai Studios Launches Pai 2.0, Cinematic Storytelling AI System

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

Roku Introduces NHL Zone

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

Study: Record Revenue Expected for FIFA World Cup 2026

Share Copy link Facebook X Linkedin Bluesky Email...

03/06/2026

Frequency Launches In-Scene Advertising

Share Copy link Facebook X Linkedin Bluesky Email...