Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier

19/10/2021

Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
LINK: https://blogs.nvidia.com/blog/2021/10/18/exascale-day-ai/...
See more stories from nvidia

Most recent headlines

17/12/2025

The EU Investigative Journalism Award 2025: bold reporting, regional impact, and rise in public-interest journalism

Investigative journalists across the Western Balkans and T rkiye continue to con...

17/12/2025

Sports Broadcasting Hall of Fame Inducts 10 Industry Icons During Unforgettable Night

Sports Broadcasting Hall of Fame Inducts 10 Industry Icons During Unforgettable ...

17/12/2025

ESPN to Debut MNF Playbook with Next Gen Stats, a New AI-Driven NFL Data-AltCast

ESPN to Debut MNF Playbook with Next Gen Stats, a New AI-Driven NFL Data-AltCastThe series, powered by Adrenaline TruPlay AI, launches Dec. 22 and runs through ...

17/12/2025

Inaugural Optum Golf Channel Games Debut Under the Lights' in Primetime on Golf Channel and USA Network

Inaugural Optum Golf Channel Games Debut Under the Lights' in Primetime on ...

17/12/2025

Ring In the New Year With New Playlists Mixed by Artists, and More Spotify Hacks

The right playlist is essential on New Year's Eve, building the energy as you get ready and keeping it high as you count down to midnight. This year, Spotif...

17/12/2025

Clear-Com's Arcadia Central Station Links Toledo Walleye and Mud Hens Venues with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/12/2025

Broadcast and Streaming Serve Up a Historic Month of TV in Nielsen's The Gauge

Audiences Watched Over 103 Billion Minutes of TV on Thanksgiving Day NFL Games ...

17/12/2025

EdgeBeam Wireless Makes Initial Sale, Expands Executive Team

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Warner Bros. Discovery Tells Shareholders to Reject Paramount Bid

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

NDI, Zoom Collaborate on Seamless Connectivity

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Broadcasters Mark Momentous Year of Challenges Amid Viewing Fragmentation

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Tennessee Public Broadcaster to Trial AI Metadata

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Chyron Unveils New AXIS Maps

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Broadcast Solutions Group Acquires PMT Professional Motion Technology

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Study: U.S. Pay TV, Video Revenue to Total $190.7B in 2030

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

Texas Attorney General Takes Aim at 5 TV Manufacturers

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

DirecTV Wins Appeal in Retransmission Price-Fixing Suit

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

E.W. Scripps Rejects Sinclair Takeover Bid

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

17/12/2025

KPop Demon Hunters Stars Visit Berklee for Weeklong Celebration

KPop Demon Hunters Stars Visit Berklee for Weeklong Celebration Andrew Choi and EJAE, who voiced the film's main characters and contributed to its soundtr...

17/12/2025

Heated Rivalry will be coming to Sky and streaming service NOW on 10 January

Wednesday 17 December 2025 Heated Rivalry will be coming to Sky and streaming service NOW on 10 JanuaryTurn on cookies to view this content. Go to Privacy opti...

17/12/2025

Inside The Unseen World Of Indian Customs: Netflix Reveals The Brave Heroics Of The Customs Officers In Taskaree

Back to All News Inside The Unseen World Of Indian Customs: Netflix Reveals The...

17/12/2025

Netflix announces PAPARAZZI KING: the docu series coming to Netflix on January 9th

Back to All News Netflix announces PAPARAZZI KING: the docu series coming to Ne...

17/12/2025

Netflix Unveils First Look at 'Jo Nesbo's Detective Hole' Premiering on March 26, 2026

Back to All News Netflix Unveils First Look at Jo Nesbo's Detective Hole Pr...

17/12/2025

Netflix Welcomes Warner Bros. Discovery Board Recommendation

Back to All News Netflix Welcomes Warner Bros. Discovery Board Recommendation Business 17 December 2025 Global Link copied to clipboard After Careful Revi...

17/12/2025

RT announces appointment of Kathy Fox to role of Commissioning Editor, Documentaries and Features

RT has announced that Kathy Fox has been appointed Commissioning Editor with re...

17/12/2025

UC San Diego Lab Advances Generative AI Research With NVIDIA DGX B200 System

The Hao AI Lab research team at the University of California San Diego - at the forefront of pioneering AI model innovation - recently received an NVIDIA DGX B...

17/12/2025

Into the Omniverse: OpenUSD and NVIDIA Halos Accelerate Safety for Robotaxis, Physical AI Systems

Editor's note: This post is part of Into the Omniverse, a series focused on ...

17/12/2025

The Glitterball awaits: Dancing with the Stars unveils dance pairings for 2026

With the new season of Dancing with the Stars shimmering in the not-too-distant future this New Year, the celebrity and dancer pairings of the twelve couples ha...

16/12/2025

Stranger Things' Playlist Takeover Challenges Fans to Decode Clues and Unlock Exclusive Volume 2' Content

Hawkins has landed on Spotify, just in time for Stranger Things Season 5, Volume...

16/12/2025

Spotify and NAVER Bring Music Integrations and Premium Benefits to Korea

Wherever you are, your favorite music and audio content should go seamlessly with you. That's why Spotify has partnered with NAVER Corp, Korea's leading...

16/12/2025

Around the World With Spotify Wrapped: 2025 Fan Destinations You Had to See

2025 Wrapped arrived bigger and bolder than ever. This year's experience is designed to be ultra personal and shareable, with new features like Wrapped Part...

16/12/2025

L3Harris Delivers Most Powerful Thrusters for NASA's Lunar Gateway

Three 12-kilowatt Advanced Electric Propulsion System thrusters, supplied by L3Harris Technologies, form the core of Gateway's propulsion system. Pictured i...

16/12/2025

Palantir and L3Harris: Reindustrializing Defense Through AI-Powered Production

The challenge facing America's defense industrial base is not just about speed - its about rebuilding the foundation that makes speed possible. Our nations ...

16/12/2025

NFL Boosts Broadcast, Streaming Viewing Share in November

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/12/2025

Spanish Broadcaster Updates Playout With Pebble Solutions

SEVILLE, Spain Canal Sur, the public broadcasting service for Andalusia, Spain, has completed a total technology refresh based on Pebble's resilient, softwa...

16/12/2025

Telescript International Buys Prompter Software Company

NEW YORK Teleprompting hardware provider Telescript International has acquired all software code and intellectual property previously owned by Telescript West. ...

16/12/2025

Ookla: T-Mobile Is Fastest Fixed Wireless Access Provider

As cable operators face increased competition from 5G fixed wireless access providers, a new report from Ookla Research finds that T-Mobile is the FWA speed lea...

16/12/2025

Apple TV App for Android Now Supports Google Cast

Apple has announced a major upgrade to the Apple TV app for device owners outside the Apple ecosystem with news that the Apple TV app for Android now supports G...

16/12/2025

PT Telkom Satelit Indonesia and Space42 Explore Partnership to Extend 5G Direct-to-Device Services

Space42 grows Direct-to-Device partner ecosystem through a Memorandum of Underst...

16/12/2025

VEON Announces Release Date for Full Year and Fourth Quarter 2025 Results of Both VEON and Kyivstar

16 Dec 2025 VEON Announces Release Date for Full Year and Fourth Quarter 2025 R...

16/12/2025

VEON's Kyivstar Invests in Renewable Energy in Ukraine with Acquisition of Solar Power Company

16 Dec 2025 VEON's Kyivstar Invests in Renewable Energy in Ukraine with Acq...

16/12/2025

Emma Appleton, Fares Fares, Frida Gustavsson and Jakob Oftebro Star in Swedish Thriller Series Bytet'

Back to All News Emma Appleton, Fares Fares, Frida Gustavsson and Jakob Oftebro...

16/12/2025

Docu-reality 'My Korean Boyfriend' Gets a Trailer and Premiere Date: January 1st. Is Real Life Really like a K-drama?

Back to All News Docu-reality My Korean Boyfriend Gets a Trailer and Premiere D...

16/12/2025

Czech TV Elevates Video Streaming with Harmonic

Harmonic's XOS Advanced Media Processor Improves Streaming Video Quality and Boosts Viewer Engagement SAN JOSE, Calif. - Dec. 16, 2025 - Harmonic (NASDAQ: ...

16/12/2025

RT Sport Manager of the Year Nominees 2025 Revealed

RT Sport Awards 2025 live on RT One and RT Player at 8:05pm on Saturday 20 December. On Saturday 20 December live on RT One and RT Player at the earlier t...

16/12/2025

Music legend Brian Kennedy revealed as the twelfth and final contestant for Dancing with the Stars 2026

Singer -songwriter Brian Kennedy has been announced as the final celebrity dance...

15/12/2025

Harlem Globetrotters Celebrate 100th Anniversary With New Brand Campaign From The Famous Group

Harlem Globetrotters Celebrate 100th Anniversary With New Brand Campaign From Th...

15/12/2025

2026 Sundance Film Festival Reveals 54 Titles Selected for Short Film Program Presented by Ketel One Vodka

Top L-R: La Tierra Del Valor (The Home of the Brave), Mangittatuarjuk (The Gnawe...

15/12/2025

L3Harris to Provide Assured Communications for US Air Force's Survivable Airborne Operations Center Program

L3Harris will leverage 15 years of experience supporting the E-4B Nightwatch and...