Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier

19/10/2021

Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
LINK: https://blogs.nvidia.com/blog/2021/10/18/exascale-day-ai/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

30/06/2026

CazTVs 12 ENG Teams Across North America Keep Brazilian Fans on Top of World Cup

As Brazil's only way for fans to see all 104 matches, YouTube channel proves the power of digital...

30/06/2026

UJAM release Retrocraft multi-effects

Brings together saturation & lo-fi effects Following on from the release of their Voxcraft vocal-processing plug-in, UJAM have announced the launch of Retro...

30/06/2026

Zensphere v2 from Rapid Flow

New IR reverb engine, Juno-inspired chorus & more The latest version of Rapid Flow's hardware-emulation synth plug-in expands on its predecessor with a ...

30/06/2026

Shy Audio release Shy 90s Smack

Excels at heavy-handed VCA compression For their latest release, Shy Audio have recreated the crunchy' sound of a rackmount compressor that found its w...

30/06/2026

Apple raise Mac & iPad prices

Component scarcity drives cost increases Shortly after Apple's CEO Tim Cook acknowledged that cost increases would soon be inevitable , the company hav...

30/06/2026

Statement regarding GetUp Save Our SBS' campaign

Statement regarding GetUp Save Our SBS' campaign 30 June, 2026 Media releases The GetUp Save Our SBS' campaign is an independent initiative. SBS ...

30/06/2026

The First Hitachi Cash Recycling Devices in the EU Were Deployed at Bank Pekao S.A.

Hitachi and Bank Pekao S.A. have completed the installation of the first Hitachi...

30/06/2026

Clear-Com Upgrades Communication Systems for Jeopardy! and Wheel of Fortune

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

30/06/2026

Telemundo, Peacock See More Record Setting World Cup Audiences

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

FOR-A America Adds Two Execs to U.S. Sales Team

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

A3SA Disputes Weigel Assertions that NextGen TV Threatens EAS

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

MainStreaming Selected by ITV to Support Delivery of ITVX...

MainStreaming, the award-winning and innovative Edge Video Delivery Network, today announced that it has been selected by ITV to support the delivery of ITVX, I...

30/06/2026

Chyron Launches New Chyron Academy

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Clear-Com Upgrades Communication Systems for Jeopardy and...

When Wheel of Fortune and Jeopardy! needed to upgrade their wireless communications system, they turned to Clear-Com FreeSpeak wireless for their iconic televi...

30/06/2026

Supreme Court Gives Trump Tight Control over Independent Regulators

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Rocket Lab to Acquire Iridium in $8 Billion Deal

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Kyocera AVX Releases New Web-Based Antenna Integration Tool

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

YouTube Shorts Get a Makeover

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Rise Announces 2026 Worldwide Mentoring Cohorts

Share Copy link Facebook X Linkedin Bluesky Email...

30/06/2026

Other World Computing Launches New Atlas Core Line with 256GB CFExpress 4.0 Type B Memory Card

Other World Computing Launches New Atlas Core Line with 256GB CFExpress 4.0 Type...

30/06/2026

DaVinci Resolve Studio Used for Taketoshi Sado's Perfume Cold Sleep -25 years Document-

DaVinci Resolve Studio Used for Taketoshi Sado's Perfume Cold Sleep -25 year...

30/06/2026

FOR-A America Expands U.S. Sales Team to Accelerate Growth of Software-Defined Solutions

Fernando Cruz and Jaz Wray Join as Regional Sales Managers; Bringing Extensive S...

30/06/2026

How NVIDIA's Inference Software Stack Powers the Lowest Token Cost

As organizations move from AI pilots to production AI factories, infrastructure decisions have shifted from peak chip specifications to cost per token: how many...

30/06/2026

Into the Omniverse: Three Workflows for Improving Vision AI Agent Accuracy With Synthetic Data and Fine-Tuning

Editor's note: This post is part of Into the Omniverse, a series focused on ...

30/06/2026

June 29, 2026

Scripps Research scientists demonstrate a faster, cheaper route to making critical drugs using common table sugar New method illustrates how to build a tough ch...

29/06/2026

Op-Ed: Why the 2026 World Cup Is Redefining the Economics of Live Sports Production

By Andy Rayner, CTO, Appear The 2026 FIFA World Cup is the largest football tou...

29/06/2026

Study: Esports Plays Major Role in Gen Z Media Habits, Purchasing Behavior

A new multi-country study from ESL FACEIT Group, Hero Esports, and Niko Partners estimates that 400 million Gen Z consumers regularly engage with esports, under...

29/06/2026

ESPN Sets Multiplatform Plans for America 250 Celebration

ESPN will mark America's 250th anniversary with a series of content initiatives across its linear, digital, and streaming platforms, including a special edi...

29/06/2026

OBSBOT Named Official Camera and Webcam Partner of Esports World Cup 2026

The Esports Foundation has named OBSBOT the Official Camera and Webcam Partner for the Esports World Cup 2026, bringing the company's AI-powered imaging tec...

29/06/2026

Insight Productions Launches Insight Storm, 53-Foot Esports Broadcast Truck

Insight Productions has launched Insight Storm, a 53-foot mobile broadcast unit designed specifically for esports production, live entertainment, and digital-fi...

29/06/2026

Gravity Media Delivers Global Distribution, Streaming Services for World Economic Forum in Dalian

Gravity Media once again provided broadcast, streaming, and content-distribution...

29/06/2026

Wimbledon Introduces AI-Powered Fan Features, Modernized Digital Platforms for 2026 Championships

The All England Lawn Tennis Club and IBM have introduced new and enhanced digita...

29/06/2026

Evolve Dark Matter from Excite Audio

Four-layer instrument aimed at dark electronic music Excite Audio's latest software instrument has been designed with dark drum and bass, atmospheric te...

29/06/2026

Tracktion unleashes Waveform 14 DAW

New AI Assistant, Multi-channel Audio, ARA2 improvements & more Tracktion's DAW software has just received its latest major update, gaining a selection ...

29/06/2026

Focusrite publish 2026 Sustainability Report

Details environmental policies & results The Focusrite Group have just announced that following a long audit process, they have published their 2026 sustain...

29/06/2026

Comcast to Spin Off NBCUniversal, Sky

Share Copy link Facebook X Linkedin Bluesky Email...

29/06/2026

Supreme Court Rules Trump Can Fire FTC Commissioner Without Cause

Share Copy link Facebook X Linkedin Bluesky Email...

29/06/2026

CVP Launches Warranty plus to Protect Professional Equipm...

CVP, one of Europes leading suppliers of professional video and broadcast solutions, has announced the launch of CVP Warranty , a new extended warranty programm...

29/06/2026

TitanTV Hires Mark Hadley as Technology Specialist

Share Copy link Facebook X Linkedin Bluesky Email...

29/06/2026

Fox Sports Delivers Another FIFA Mens World Cup Audience Record

Share Copy link Facebook X Linkedin Bluesky Email...

29/06/2026

Claude Meets Blackwell Ultra: Anthropic's Models Now Run on NVIDIA GB300 in Azure

Anthropic's Claude models in Microsoft Foundry - hosted on Microsoft Azure a...

29/06/2026

Arvato Systems Achieves AWS Cloud Operations Competency

Arvato Systems Achieves AWS Cloud Operations Competency The team behind the AWS Cloud Operations Competency (from left to right: Philipp Hellmich, Johanna Bod...

29/06/2026

Ger Gilroy to join RT to present a Daily Sports Podcast

RT today announced that Ger Gilroy will join the RT Podcasts team to present a daily sports podcast. Launching later this year, the new show will set the spor...

29/06/2026

OUTsurance announced as sponsors of Oliver Callan on RT Radio 1

RT Commercial announced OUTsurance as sponsor of the Oliver Callan show on RT Radio 1 from Wednesday 1 July. Oliver Callan doubles the fun, delivering two ...

29/06/2026

Open Models, Closed Environments: Palantir Brings Secure AI to US Agencies With NVIDIA Nemotron

Showcasing the importance of open source innovation in American AI, Palantir'...

28/06/2026

Softube unveil lower cost Console 1 Compact

Half-size model joins Console 1 line-up Shortly after the release of their new Flow Studio controller, Softube have announced the launch of another new surf...