Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier


Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
See more stories from nvidia

North America Stories



Jun29 IMT AIRBORNE VIDEO DOWNLINK SYSTEM (AVDS) TAKES OFF AT ALEA EXPO 2016 SAVANNAH, GA, JUNE 29, 2016 - Integrated Microwave Technologies (IMT), a leader in...


Images from NAB 2017

Apr25 Images from NAB 2017 Mike Payne of Vislink delivers a presentation on newsnet, a secure, high-bandwidth IP network that completely transforms traditiona...



Apr24 VISLINK UNVEILS ALL-NEW HCAM, HEVC 4K UHD CAMERA TRANSMITTER AT NAB 2017 18 Unit Purchase by UK Based-Broadcast RF to be Finalized at Show LAS VEGAS, ...


Senate Confirms Rosenworcel to a New FCC Term

WASHINGTON, D.C. The Senate has voted to confirm Federal Communications Commission (FCC) Chairwoman Jessica Rosenworcel to another term at the Commission, a mov...


Teradek Launches New Monitoring Solution with AWS Wavelength & Verizon

IRVINE, Calif. Thanks to a recent collaboration with Verizon and Amazon Web Services Teradek has announced a new ultra-low latency monitoring server for their C...


NEP Group Opens Production Centers in L.A. and New York

PITTSBURGH NEP Group has launched two new production centers, the NEP Production Center Los Angeles and NEP Production Center New York....


Oliver Frenzel Named Lawo's Business Development Manager

RASTATT, GERMANY Lawo has named Oliver Frenzel as business development manager for its SMART line of IP network monitoring solutions. In his new position, Frenz...


Telstra Broadcast Services Joins the SRT Alliance

MELBOURNE, Australia The global media services provider, Telstra Broadcast Services (TBS), has announced that it has joined the SRT Alliance, a collaborative gr...


ViacomCBS and CJ ENM to Partner on Streaming Content and Services

NEW YORK and SEOUL, Korea In the wake of the growing popularity of Korean content like Squid Game on Netflix, ViacomCBS and CJ ENM have announced a new strate...


NextGen TV: SpectraRep's EduCast Selected to Deliver Classroom Content to Students Via ATSC 3.0 Broadcasts in N.M.

CHANTILLY, Va. In the first deployment of educational datacasting services using...


Durham Bulls Unveil New Uniforms for Upcoming 2022 Season

New home & road jerseys honor Durham franchises past, alternate jersey recognizes Bull City The Bulls Home Jersey for the 2022 season. The Durham Bulls ...


Creating a More Resilient Future: The Latest Innovations Built for Managing Disruptions

For one of the first times in 2021, air navigation experts from the public and p...


I Am L3Harris - Renee Frohnert

I knew I wanted to be in aerospace when I was seven years old and watched Toy Story with my dad - I fell in love with the character Buzz Lightyear. My dad, an e...


L3Harris Completes Sale of its Narda-MITEQ Business

MELBOURNE, Fla. - L3Harris Technologies (NYSE:LHX) has completed the sale of its Narda-MITEQ business to an investment affiliate of J.F. Lehman & Company. Nard...


Broadband Forum Updates Framework for Edge Computing

FREMONT, Calif. The Broadband Forum industry standards group has announced a new release of TR-466 that is designed to help operators bring edge computing to cl...


ARK Taps Digital Alert Systems for ATSC 3.0 Emergency Messaging

LYNDONVILLE, N.Y. & CEDAR HILL, TX NextGen TV network ARK Multicasting has adopted Digital Alert Systems' DASDEC emergency messaging platform for its ATSC 3...


B+C Hall of Fame Returns with Live, In-Person 30th Anniversary Gala

The Broadcasting+Cable Hall of Fame -- the premier industry event paying tribute to the pioneers, innovators and stars of the electronic arts -- returns with a ...


New Imagine Communications ADC Flex Enables Remote Broadcast Chain Control

DENVER Imagine Communications has enhanced ADC playout automation with the ADC Flex remote-ready control solution that enables media companies to access and con...


Crown Media Taps Globecast For Hallmark Channels' Cloud Playout Migration

LOS ANGELES Globecast is providing Crown Media Family Networks with cloud playout services for Hallmark Channel, Hallmark Movies & Mysteries and Hallmark Drama,...


Houston, We Have a NextGen TV Launch

HOUSTON, Texas In what is being billed as the largest NextGen TV launch to date, 10 local stations in Houston, the eighth-largest TV market in the United States...


CNN Fires Chris Cuomo After Outside Investigation

CNN has fired anchor Chris Cuomo after earlier suspending him indefinitely due to revelations about the extent of his aid to his embattled brother, former New Y...


Magna Sees U.S. Long-Form Video Ad Revenue Rising 4% in 2022

Media buyer Magna Global forecasts that total U.S long-form video ad revenue will rise 7% in 2022 after a 6% gain in 2021 to $65.6 billion....


U.S. TV Ad Spending To Rise By 4% in 2022, Zenith Forecasts

Advertising spending on TV in the United States is expected to increase 4% to $65.151 billion in 2022 from pandemic lows, but growth will be limited and pale co...


GroupM Sees 23% CTV Growth, More Political Spending, Boosting TV

Media buyer GroupM predicted that U.S. TV ad revenue will grow 6.2% to $74.168 billion in 2022, after rising 4.1% in 2021, a historic year for overall advertisi...


Dan Fabrizio Named News Director at WSMV Nashville

Dan Fabrizio has been named news director at WSMV Nashville. He was news director at WAVE Louisville. Gray Television owns News 4, an NBC affiliate....


USTelecom Names Senior Government Affairs Director

USTelecom-The Broadband Association, has tapped a White House official for a top government relations post. Michael Pauls Jr. will join the trade group as seni...


Joe Pickett' Offers Viewers Wild West, and a Main Character Trying to Do the Right Thing

Western drama Joe Pickett, about a game warden and his family finding their way ...


Roku Streaming More Unaired Episodes of Two Quibi Series

Gearing up to create original shows of its own making, Roku is dipping into the Quibi library it acquired to stream what it's calling second seasons of Punk...


Shatner in Space' on Amazon Dec. 15

Shatner in Space, a one-hour special, will stream on Amazon Prime starting Wednesday, Dec. 15. The special shows William Shatner traveling to space on Blue Orig...


Sinclair Launches Website For The National Desk News Program

Sinclair Broadcast Group said it launched a free website for its The National Desk news program, which airs on some Sinclair stations....


GroupM: Global Connected TV Ad Revenue to Hit $32.6B by 2026

NEW YORK In a new forecast for the 2022 ad market and media landscape, GroupM is forecasting rapid growth for connected TV advertising in 2022 and beyond. But i...


Broadband Forum Releases New Version of TR-466

FREMONT, Calif. The Broadband Forum industry standards group has announced a new release of TR-466 that is designed to help operators bring edge computing to cl...


Cinedigm Taps LiveLike for New Interactive Streaming Features

LOS ANGELES The independent streaming company Cinedigm has announced that it is working with LiveLike to deliver new community and gamification elements to Cine...


Zenith: Social Media Advertising Will Surpass TV in 2022

LONDON The dominance of digital media will pass a new milestone in 2022 when worldwide social media advertising will hit $177 billion, overtaking television at ...


Diversity Voted ANA 2021 Marketing Word Of The Year

NEW YORK After conducting an online poll of more than 200 members, the Association of National Advertisers (ANA) has announced that Diversity was voted ANA...


Majority Report: 2022 Predictions on How AI Will Impact Global Industries

There's an old axiom that the best businesses thrive during periods of uncertainty. No doubt, that will be tested to the limits as 2022 portends upheaval on...


Silicon Express Lanes: AI, GPUs Pave Fast Routes for Chip Designers

AI can design chips no human could, said Bill Dally in a virtual keynote today at the Design Automation Conference (DAC), one of the world's largest gatheri...


SVG Voices: Fox Sports Technical Producer Carlos Gonzalez

SVG Voices: Fox Sports Technical Producer Carlos Gonzalez By SVG Staff Tuesday, December 7, 2021 - 6:45 am Print This Story | Subscribe Story Highlights...


SVG Sit-Down: Venue Edge's David Saphirstein on Driving In-Venue Content for Five Bowl Games, Other December Events

SVG Sit-Down: Venue Edge's David Saphirstein on Driving In-Venue Content for...


NEP Sets Its Sights on Centralized-Production Model With New Production Centers in L.A., NYC

NEP Sets Its Sights on Centralized-Production Model With New Production Centers ...


SVG On Demand: How the League of Legends World Championship Final Made Its Quick Switch from China to Iceland

SVG On Demand: How the League of Legends World Championship Final Made Its Quick...


Sports Broadcasting Hall of Fame 2020-21 Ceremony Preview: All Nine HOF Profiles Now Available

Sports Broadcasting Hall of Fame 2020-21 Ceremony Preview: All Nine HOF Profiles...


Global Cisco Study Identifies Top Security Practices

News Summary: Organizations that proactively test their security capabilities are 2.5 times more likely to maintain business resiliency Integrated technology ...


December 07, 2021

New research consortium to tackle maternal health disparities with digital technologies Mobile app-based research platform aims to engage and empower researcher...


MMG Turns to Ross for Futureproofed OB Capability

Ottawa, Canada, December 7th 2021 - Media Mobil GmbH (MMG) is a German provider of outside broadcast services to the MDR group of stations and other third-party...


Durham Holiday Night Market at American Tobacco This Thursday

Get ready for American Tobaccos BIGGEST Durham Night Market of the year filled with lots of holiday cheers this Thursday, December 9, 2021, from 5-9pm. Shop o...





Deloitte: High Churn Rate Shows Competitive, Maturing SVOD Market

As the market and number of video streaming services continues to grow worldwide, customer choice is expanding and with it, the rate of subscriptions, cancellat...