Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier

19/10/2021

Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
LINK: https://blogs.nvidia.com/blog/2021/10/18/exascale-day-ai/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

24/08/2026

New Book Sports Heaven: The Birth of ESPN' Preserves Founder Bill Rasmussen's Origin Story and the Lessons That Still Define the Network Today

Co-authors Mike Soltys and Garrett Sutton reflect on Rasmussen's vision, intentional optimism,' and fan-first philosophy following his death last week...

24/08/2026

Dr. Fill from Yurt Rock

Human-played drum fills on demand Sample library developers Yurt Rock have announced the launch of a new plug-in that's dedicated to creating drum fill...

24/08/2026

Black Rooster Audio launch PS-VC1 Vocal Chain Channel

Debut plug-in in new Professional Series Black Rooster Audio's latest plug-in delivers an all-in-one vocal-processing tool, and is the debut release in ...

24/08/2026

SBS WorldWatch embraces digital future with move to SBS On Demand

SBS WorldWatch embraces digital future with move to SBS On Demand 24 August, 2026 Media releases On 18 September, SBS WorldWatch will transition from a lin...

24/08/2026

Rohde & Schwarz addresses operational efficiency and infrastructure resilience at IBC 2026 in Amsterdam

Rohde & Schwarz addresses operational efficiency and infrastructure resilience a...

24/08/2026

Rohde to Focus on Operational Efficiency, Sustainability at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

24/08/2026

Calrec advances the EBU Dynamic Media Facility vision at...

As the broadcast industry moves toward more flexible production platforms, Calrec will present its evolving audio ecosystem at IBC 2026, on Stand 8.C47. The dem...

24/08/2026

Stop Using Boring Static Highlights - Pro After Effects Workflow

Stop Using Boring Static Highlights - Pro After Effects Workflow Graham Quince August 24, 2026 0 Comments Did you know you can use After Effects expre...

24/08/2026

Paledusk Performance Captured with URSA Cine Immersive

Paledusk Performance Captured with URSA Cine Immersive Brie Clayton August 24, 2026 0 Comments Creative production company THINGS. brings the band'...

24/08/2026

Sky Arts Confirms Double Classical Documentary Showcase Ahead of Edinburgh TV Festival

The Handel Scandal and Dangerous Debussy will both air on Sky Arts this AutumnMo...

24/08/2026

Dalet Accelerates Media Transformation with AI, Automation and Governance at IBC 2026

Dalet, a leading technology and service provider for media-rich organizations, w...

24/08/2026

Arvato Systems becomes a service partner of HANDELSVERBAND.swiss

Arvato Systems Becomes a Service Partner of HANDELSVERBAND.swiss Zurich - Arvato Systems Switzerland has been a service partner of HANDELSVERBAND.swiss since ...

24/08/2026

Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents

According to OpenRouter data, agentic AI workloads consume 15x more tokens than ...

24/08/2026

With Groq 3 LPX in Full Production, NVIDIA Extends Vera Rubin Inference for Agents

The next era of AI inference won't be defined by a single breakthrough chip,...

24/08/2026

How XPUs Meet a World-Class AI Factory

To generate intelligence at scale, AI factories run continuously, and their economics are defined by delivered output: tokens per second, tokens per watt, cost ...

24/08/2026

Documentary on the life and writings of James Connolly to air on RT

We Only Want the Earth: The Life & Ideas of James Connolly airs Wednesday 26 August on RT One and RT Player at 9.35pm RT is to air the compelling documenta...

23/08/2026

Parish Audio introduce Parametric Compressor

Offers up to 10 bands of compression Parish Audio's latest release allows users to place individual compressors anywhere in the frequency range, but tak...

22/08/2026

Macon Blair on Filmmaking and the Long Road to Idiots

O'Shea Jackson Jr., Dave Franco, and Mason Thames appear in Idiots by Macon Blair, an official selection of the 2026 Sundance Film Festival. (Courtesy of ...

22/08/2026

Crafting the Contenders: Adam Bricker, ASC on bringing Hacks home

By the time Hacks reached its fifth and final season, Adam Bricker ASC had spent six years shaping one of television's most distinctive visual identities. T...

22/08/2026

World Cup Drives TVP to Retain Top Spot in July as Live Sport Buoys Polish Viewership

Polsat reclaims second place, ByteDance climbs to eighth, and live football miti...

22/08/2026

DirecTV Offers New Customers a Year of Free Netflix with Ads

Share Copy link Facebook X Linkedin Bluesky Email...

22/08/2026

Judge Sets Early October Hearing for ABC Lawsuit Against FCC

Share Copy link Facebook X Linkedin Bluesky Email...

22/08/2026

ORF Taps Net Insight for Full IP Upgrade

Share Copy link Facebook X Linkedin Bluesky Email...

22/08/2026

Breezeline Teams Up with DirecTV to Launch New Streaming Bundle

Share Copy link Facebook X Linkedin Bluesky Email...

22/08/2026

Avid brings agentic media production to IBC2026

Avid brings agentic media production to IBC2026 Brie Clayton August 21, 2026 0 Comments After launching Avid Content Core at NAB 2026, Avid expands it...

22/08/2026

Making of Lord of the Flies Shot with Pocket Cinema Camera 6K Pro

Making of Lord of the Flies Shot with Pocket Cinema Camera 6K Pro Brie Clayton August 21, 2026 0 Comments Filmmaker Lisa Marie Russo shoots on the bea...

22/08/2026

Homecoming Artist Spotlight: Dogs In A Pile

Homecoming Artist Spotlight: Dogs in a Pile The rising jam band talks about where it all started on the Berklee campus ahead of their Homecoming performance o...

22/08/2026

Berklee Alumna Lexi Vollero MA '22 Receives Fulbright Award to Brazil

Berklee Alumna Lexi Vollero MA '22 Receives Fulbright Award to Brazil Vollero, a Berklee NYC graduate, has been selected for a Fulbright Open Research Awa...

21/08/2026

FOX Sports Rolls Out Its Most Ambitious Live Motorsports Production' Ever at IndyCar Freedom 250 GP in DC

A massive deployment of specialty cameras, graphics, and AR will showcase the na...

21/08/2026

Creative Studio Zookeeper Embraces Pinball Motif for West Coast Conference PSA

The West Coast Conference unveiled its new 30-second public service announcement, the latest expression of the Conference's We Rise in the West brand iden...

21/08/2026

ESPN Soft-Launches a New NFL Graphics Package, Scorebug During Thursday Night's Raiders-Texans Preseason Game

New look will serve as the foundation for ESPN's upcoming NFL season and Sup...

21/08/2026

ESPN to Debut Little League Alumni Alt-Cast for 2026 MLB Little League Classic

ESPN will air the ninth annual MLB Little League Classic presented by New York Life on Sunday, August 23, at 7 p.m. ET from Historic Bowman Field in Williamspor...

21/08/2026

His Story Becomes Part of Football History': Dean Grossman Honors His Father Sandy With Pete Rozelle Award Speech

In an emotional acceptance speech in Canton, Grossman celebrated the pioneering ...

21/08/2026

Rapid Flow release miniGRID

Hardware-style timing shifts for software instruments Following on from the release of Omniclock, Rapid Flow have launched a new sequencer plug-in that can ...

21/08/2026

Love Synthesizers announce First Love pre-orders

Highly anticipated synthesizer ships in October 2026 Iceland-based Love Synthesizers have announced that their highly anticipated synthesizer is now availab...

21/08/2026

The Forsytes' Adds Gregg Sulkin & Gabriel Antunes As PBS Masterpiece Series Starts Filming Season 3

Masterpiece PBS The Forsytes has expanded its cast as its begins production in ...

21/08/2026

BBC reveals haunting first look and further casting for The Witch Farm

The BBC has unveiled first-look pictures from The Witch Farm, a new ghost story and mystery set in the Welsh countryside, coming soon to BBC iPlayer and BBC One...

21/08/2026

A first look at Edward Bluemel as Hercule Poirot.

The BBC and BritBox have revealed the first look of Edward Bluemel as Hercule Poirot in the forthcoming six-part series Hercule from Mammoth Screen and Agatha C...

21/08/2026

Inside Euphoria's Editorial Heart: Aaron I. Butler, ACE on craft, collaboration and controlled madness

Our priority was making the best, most powerful, most meaningful story possible,...

21/08/2026

Clear-Com Appoints Venuetech as its Main Partner for the Middle East

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

21/08/2026

Techex Names Stuart Almond as Chief Revenue Officer

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Avid Brings Agentic Media Production to IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Avid brings agentic media production to IBC2026

Avid will unveil how it is transforming production to help media organizations unite content, agentic workflows, and business insights at IBC2026 (RAI Amsterda...

21/08/2026

Grass Valley Connects SDI IP and Software as One Unified...

New routing, modular processing, orchestration and monitoring capabilities bridge dedicated hardware and software-based processing as part of the Dynamic Media ...

21/08/2026

Indiana Pacers Selects DAZN As Exclusive Streaming Partner

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Chyron To Showcase Newsroom Advancements At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

21/08/2026

Broadpeak to Launch Multiview as a Service at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...