Cloud Service, OEMs Raise the Bar on AI Training with NVIDIA AI
01/12/2021
Our platform set records across all eight popular workloads in the MLPerf training 1.1 results announced today.
NVIDIA AI trained all models faster than any alternative in the latest round. NVIDIA A100 Tensor Core GPUs delivered the best normalized per-chip performance. They scaled with NVIDIA InfiniBand networking and our software stack to deliver the fastest time to train on Selene, our in-house AI supercomputer based on the modular NVIDIA DGX SuperPOD.
NVIDIA A100 GPUs delivered the best per-chip training performance in all eight MLPerf 1.1 tests. A Cloud Sails to the Top When it comes to training AI models, Azure's NDm A100 v4 instance is the fastest on the planet, according to the latest results. It ran every test in the latest round and scaled up to 2,048 A100 GPUs.
Azure showed not only great performance, but great performance that's available for anyone to rent and use today, in six regions across the U.S.
AI training is a big job that requires big iron. And we want users to train models at record speed with the service or system of their choice.
That's why we're enabling NVIDIA AI with products for cloud services, co-location services, corporations and scientific computing centers, too.
Server Makers Flex Their Muscles Among OEMs, Inspur set the most records in single-node performance with its eight-way GPU systems, the NF5688M6 and the liquid-cooled NF5488A5. Dell and Supermicro set records on four-way A100 GPU systems.
A total of 10 NVIDIA partners submitted results in the round, eight OEMs and two cloud-service providers. They made up more than 90 percent of all submissions.
This is the fifth and strongest showing to date for the NVIDIA ecosystem in training tests from MLPerf.
Our partners do this work because they know MLPerf is the only industry-standard, peer-reviewed benchmark for AI training and inference. It's a valuable tool for customers evaluating AI platforms and vendors.
Servers Certified for Speed Baidu PaddlePaddle, Dell Technologies, Fujitsu, GIGABYTE, Hewlett Packard Enterprise, Inspur, Lenovo and Supermicro submitted results in local data centers, running jobs on both single and multiple nodes.
Nearly all our OEM partners ran tests on NVIDIA-Certified Systems, servers we validate for enterprise customers who want accelerated computing.
The range of submissions shows the breadth and maturity of an NVIDIA platform that provides optimal solutions for businesses working at any scale.
Both Fast and Flexible NVIDIA AI was the only platform participants used to make submissions across all benchmarks and use cases, demonstrating versatility as well as high performance. Systems that are both fast and flexible provide the productivity customers need to speed their work.
The training benchmarks cover eight of today's most popular AI workloads and scenarios - computer vision, natural language processing, recommendation systems, reinforcement learning and more.
MLPerf's tests are transparent and objective, so users can rely on the results to make informed buying decisions. The industry benchmarking group, formed in May 2018, is backed by dozens of industry leaders including Alibaba, Arm, Google, Intel and NVIDIA.
20x Speedups in Three Years Looking back, the numbers show performance gains on our A100 GPUs of over 5x in just the last 18 months. That's thanks to continuous innovations in software, the lion's share of our work these days.
NVIDIA's performance has increased more than 20x since the MLPerf tests debuted three years ago. That massive speedup is a result of the advances we make across our full-stack offering of GPUs, networks, systems and software.
NVIDIA AI delivers more than 20x improvements over three years. Constantly Improving Software Our latest advances came from multiple software improvements.
For example, using a new class of memory copy operations, we achieved 2.5x faster operations on the 3D-UNet benchmark for medical imaging.
Thanks to ways you can fine-tune GPUs for parallel processing, we realized a 10 percent speed up on the Mask R-CNN test for object detection and a 27 percent boost for recommender systems. We simply overlapped independent operations, a technique that's especially powerful for jobs that run across many GPUs.
We expanded our use of CUDA graphs to minimize communication with the host CPU. That brought a 6 percent performance gain on the ResNet-50 benchmark for image classification.
And we implemented two new techniques on NCCL, our library that optimizes communications among GPUs. That accelerated results up to 5 percent on large language models like BERT.
Leverage Our Hard Work All the software we used is available from the MLPerf repository, so everyone can get our world-class results. We continuously fold these optimizations into containers available on NGC, our software hub for GPU applications.
It's part of a full-stack platform, proven in the latest industry benchmarks, and available from a variety of partners to tackle real AI jobs today.
LINK: | https://blogs.nvidia.com/blog/2021/12/01/mlperf-ai-cloud-service-oems/... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
09/05/2024
Scripps Appoints New President and CEO of the Scripps Howard Fund
CINCINNATI Meredith Delaney has been appointed president and CEO of the Scripps Howard Fund, the philanthropic arm of The E.W. Scripps Company....
09/05/2024
Walmart Launches the Onn. 4K Streaming Device
Following leaks earlier this month of Walmart's plans to launch a new 4K streaming box, Walmart has officially unveiled the Onn. 4K Pro, a hybrid streaming ...
09/05/2024
DirecTV Adds More CW Stations
DirecTV continues to add CW affiliates to its streaming line-up, with the addition of four stations owned by Gray Television....
09/05/2024
Takeshi Kitano's film KUBI graded with DaVinci Resolve
Takeshi Kitano's film KUBI graded with DaVinci Resolve Brie Clayton May 8, 2024 0 Comments Blackmagic Design today announced that DaVinci Resolve ...
09/05/2024
zweiB updates to latest version of R&S CLIPSTER
zweiB updates to latest version of R&S CLIPSTER Brie Clayton May 8, 2024 0 Comments Specialist in deliverables for cinema, events and trade shows Ro...
09/05/2024
Simplify Your Filmmaking with Portable Lights
Simplify Your Filmmaking with Portable Lights Sean Alami May 8, 2024 0 Comments Discover the sleek, mobile Zhiyun lights that enhance cinematic scenes...
09/05/2024
The Benefits of using an Audio Interface
The Benefits of using an Audio Interface Colin Smith May 8, 2024 0 Comments This tutorial takes you through the hardware and software benefits of usin...
09/05/2024
Mother's Day Idea from CBC
Capitol Broadcasting has a myriad of ways to celebrate Mom! In honor of Mother's Day, here are a few ideas CBC divisions have to help you honor, or remember...
09/05/2024
Lachlan Murdoch Sees Progress Toward Sports Streaming Product
Fox CEO Lachlan Murdoch said his company, The Walt Disney Co. and Warner Bros. Discovery are in a two-minute drill to get their streaming sports joint venture t...
09/05/2024
Dale Earnhardt Jr. Joins Prime Video's NASCAR Team
NASCAR legend Dale Earnhardt Jr. is joining the Prime Video broadcast booth when the streaming network begins NASCAR Cup Series coverage next year. Earnhardt Jr...
09/05/2024
Nexstar Pitches Sports on The CW, Extra Reach Via Stations (Upfronts)
If upfront advertisers are looking for reach, Nexstar Media Group believes its base of local stations gives it a unique way to achieve that goal....
09/05/2024
Pluto TV Debuts NBCUniversal Local Streaming News Channels
NBCUniversal Local's 15 NBC and Telemundo local and regional streaming news channels begin launching on Pluto TV this month, starting May 8 with five channe...
09/05/2024
Don't Tell Mom the Babysitter's Dead' Debuts on BET Plus May 16
BET Plus said it has set May 16 as the premiere date for its original movie Don't Tell Mom the Babysitter's Dead....
09/05/2024
Disney's Rita Ferro Is Banking on Sports, Streaming, Tech (Upfronts)
Heading into the upfront, the advertising market is noticeably healthier than it was a year ago, Rita Ferro, president of global advertising sales at The Walt D...
09/05/2024
Rohde & Schwarz showcases operational efficiency at MPTS
Rohde & Schwarz showcases operational efficiency at MPTS Uncompromised quality and reliability coupled with simplicity and efficiency Rohde & Schwarz will ...
08/05/2024
Saved! and Rudo y Cursi Among Films With May Anniversaries
Diego Luna's character Beto aims to play professional soccer in Carlos Cuar n's film Rudo y Cursi....
08/05/2024
SGL Carbon: Focus on global growth trends pays off
SGL Carbon had a solid start to the first quarter of 2024. Despite the slight decline in sales of 3.9% to 272.6 million (Q1 2023: 283.7 million), adjusted EBI...
08/05/2024
The results are in from Malm Arena as Semi Final 1 participants move through to the Grand Final of this year's Eurovision Song Contest
The results are in from Malm Arena as Semi Final 1 participants move through to...
08/05/2024
Powerful NITV documentary Kindred to premiere during Reconciliation Week
Powerful NITV documentary Kindred to premiere during Reconciliation Week Media releases A journey of family, friendship and home *Watch the trailer here* ...
08/05/2024
Aerojet Rocketdyne Selected by DoD to Demonstrate Powder-in, Engine-out Hypersonic Propulsion Manufacturing
Aerojet Rocketdyne delivers a broad range of capabilities to support hypersonic ...
08/05/2024
L3Harris is Advancing the Future Fleet by Delivering Integrated Solutions
Selected by Fincantieri Marinette Marine, L3Harris is the shipboard design integrator and a key partner on the Fincantieri team for delivering critical subsyste...
08/05/2024
EditShare Goes Beyond Storage at MPTS
EditShare Goes Beyond Storage at MPTS Workflow, server and delivery solutions from storyboard to screen Stand D40, London Olympia, May 15-16, 2024 - EditShar...
08/05/2024
Tegna, Indiana Fever Expand Broadcast Distribution to 11 Additional Markets
TYSONS, Va. Tegna Inc. and the Indiana Fever have announced they have expanded the broadcast distribution of 17 Fever WNBA games to 11 additional markets....
08/05/2024
Comcast Business Boosts Internet Speeds
PHILADELPHIA Comcast Business has increased Internet speeds for customers, nationwide, at no additional cost and has introduced its fastest Internet plans yet ...
08/05/2024
Clear-Com to Showcase Cutting-Edge Communication Solution...
Clear-Com , a renowned provider of professional real-time communication solutions, is thrilled to announce its participation at InfoComm 2024, the largest profe...
08/05/2024
MRMC Achieves its Second Kings Award for Enterprise
Mark Roberts Motion Control (MRMC), a Nikon company, is one of the 252 organisations recognised with a prestigious King's Award for Enterprise. Announced to...
08/05/2024
EditShare goes beyond storage at MPTS
EditShare, the technology leader that enables storytellers to create and manage collaborative workflows at every stage from storyboard to screen, is exhibiting ...
08/05/2024
Magnifi and Linius Fuse Live and Archive Content to Redef...
Magnifi by VideoVerse an AI-driven video technology company and powerful video-editing SaaS platform is pleased to announce a strategic partnership with Linius ...
08/05/2024
NVIDIA RTX GPU Connects DaVinci Resolve to Power
NVIDIA RTX GPU Connects DaVinci Resolve to Power Brie Clayton May 8, 2024 0 Comments Two of the most important questions that the Creative COW audienc...
08/05/2024
Q&A with Visiting Artist Lei Liang
Q&A with Visiting Artist Lei Liang The acclaimed composer discusses his collaboration with Boston Conservatory, his work as a research artist, and what it mea...
08/05/2024
More Stations in San Antonio Launch NextGen TV Broadcasts
A second group of stations has begun broadcasting NextGen TV signals in San Antonio, Texas....
08/05/2024
NBC Orders More Deal or No Deal Island'
NBC has ordered a second season of unscripted Deal or No Deal Island. Joe Manganiello hosts, and executive produces alongside Howie Mandel. Manganiello will ret...
08/05/2024
Tegna Names Greg Retsinas GM At KGW, Portland, Oregon
Tegna said it named Greg Retsinas as president and general manager of KGW, the NBC affiliate in Portland, Oregon, effective June 3....
08/05/2024
Measurement Company Comscore Posts $5.2 Million Loss in 1st Quarter
Comscore lost money in the first quarter as weak linear ad sales impacted its cross-platform measurement business....
08/05/2024
Funny Business as NBC Orders Happy's Place,' Renews Lopez vs. Lopez'
NBC said it bolstered its comedy slate by renewing Lopez vs. Lopez and ordering Happy's Place, starring Reba McEntire....
08/05/2024
Knuckles' Knocks Fallout' From Top of TVision Power Score Rankings
Paramount Plus's Knuckles knocked Amazon Prime Video's Fallout out of the top spot in TVision's Power Score ranking of the top show on connected TV ...
08/05/2024
Tegna Adds 11 Markets To Lineup for Indiana Fever Games
Tegna, which made a deal to broadcast 17 Indiana Fever games featuring top WNBA draft pick Caitlin Clark, said it made deals that will put the games on stations...
08/05/2024
EchoStar Loses 348,000 Pay TV Subs in 1st Quarter
EchoStar said it lost another 348,000 pay TV subscribers so far this year, closing the first quarter with 8.18 million subscribers. That total includes 6.26 mil...
08/05/2024
Fox Has Net Income of $666 Million in 3rd Quarter
Fox reported a profit for its fiscal third quarter....
08/05/2024
IPG's Kinesso Unit Adds Senior Executives to Lineup
Kinesso, the centralized tech and data unit at media agency IPG Mediabrands, named Tom Amies-Cull as global chief operating officer and Amie Owen as global chie...
08/05/2024
Post production houses adopt Cleanfeed Cinema solution
The solutions in-browser stream focuses on low latency, making it suited to low bandwidth scenarios By Matthew Corrigan Published: May 8, 2024 The solutio...
08/05/2024
TAG unveils subtitling language detection feature
Driven by algorithms, the solution performs a quality analysis informed by language-specific dictionaries By Matthew Corrigan Published: May 8, 2024 Drive...
08/05/2024
Mobilelinks acquires 2 SAT Europe to increase SNG truck fleet
The increase in fleet size will reduce travel distances, aligning with sustainability goals, said Mobilelinks By Matthew Corrigan Published: May 8, 2024 T...
08/05/2024
Arqiva adds Caroline Cardozo and James Lelyveld to technology team
The company said the new arrivals would drive collaboration and technological transformation across key business units By Matthew Corrigan Published: May 8, ...
08/05/2024
Actus Digital Set to Shine at CABSAT and Broadcast Asia
Following a successful NAB Las Vegas 2024 and winning a Best of Show Award, Actus Digital, a leading provider of Intelligent Monitoring Platforms, will bring it...
08/05/2024
TAG Revolutionizes Closed Captions and Subtitles Quality...
TAG Video Systems, a leading force in video monitoring solutions, has developed a new Language Detection feature set to transform how operators ensure quality a...
08/05/2024
Pliant Technologies Unveils New SmartBoom LITE Headset at...
Pliant Technologies, a leading provider of professional wireless intercom solutions,presents its new SmartBoom LITE Headset at InfoComm 2024 (Booth C5116). The ...
08/05/2024
Prism Sound Showcases High-Quality Audio Conversion at MP...
At the Media Production & Technology Show 2024, Prism Sound will showcase high-quality audio conversion products designed to suit the demands of professional us...