Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier

19/10/2021

Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
LINK: https://blogs.nvidia.com/blog/2021/10/18/exascale-day-ai/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

18/08/2026

Dot Group to show how cutting carbon cuts cost - live at...

At Stand 14.A57, the data company will demonstrate GreenDot and IBM Aspera together, giving media and entertainment businesses real-time visibility of what thei...

18/08/2026

Blue Lucy launches Connected Value Audit

New tool provides a robust audit of operational workflows, calculating the tangible value each delivers today, and informing business decisions for tomorrow. W...

18/08/2026

Media Utilities transitions to Media Utilities - a DigiNe...

Media Utilities is integrating its activities into DigiNet and will maintain a recognisable presence in the market under the name: Media Utilities, a DigiNet br...

18/08/2026

Appear demonstrates broadcast-grade REMI production over...

Proof of Concept validates reliable multi-camera live production from remote racecourses without fixed network infrastructure Appear ASA (Appear, OSE:APR), a g...

18/08/2026

Stingr brings frictionless second-screen interaction to I...

Stingr, a new venture from the founders of Hornets Tech, is bringing its second-screen interaction platform to IBC2026. The second screen has never really wor...

18/08/2026

Hiltron to Promote its Latest Generation Satellite Commun...

Long-established satellite equipment manufacturer and systems integrator Hiltron Communications will promote its new HACUX-IDU2 antenna control unit touchscreen...

18/08/2026

EMAM, PlayBox Neo and SNEWS Launch Combined Nuvex System

EMAM, PlayBox Neo and SNEWS Launch Combined Nuvex System Brie Clayton August 17, 2026 0 Comments Integrated platform melds media asset management, pla...

18/08/2026

The United Stand Scales Live Fan Show with Blackmagic Design Workflow

The United Stand Scales Live Fan Show with Blackmagic Design Workflow Brie Clayton August 17, 2026 0 Comments ATEM Constellation 8K and HyperDeck Stud...

18/08/2026

Twin Cities PBS to Become Minnesota PBS

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

MPA, ByteDance Reach AI Copyright Protection Deal

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

DirecTV to Launch Curated Multiview for Live Sports

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Sinclair Taps Carol Kellum to Head Nebraska Stations

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Corridor Television Pays $27,000 for Violations of FCCs EAS Rules

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Triveni Digital Accelerates TV 3 0 Transition in Brazil W...

Triveni Digital Now Offers a Joint Solution With MediaKind and a Lab System Bundle Supporting ISDB-Tb and TV 3.0 Broadcast Services Triveni Digital, a trusted ...

18/08/2026

BeckTV Debuts BeckFlow at IBC and Showcases Expertise for...

At IBC2026, BeckTV, a premier systems integrator for the broadcast industry, will introduce BeckFlow to the European market. BeckFlow is the first web-based sch...

18/08/2026

PTZOptics Launches Rise 4K Bringing Ultra HD Quality and...

New flagship PTZ camera combines cinematic 4K imaging, professional broadcast connectivity and the complete Horizon intelligent video experience for productions...

18/08/2026

VisualOn IBC Show Preview - AI-Powered CAE Advanced Playb...

At IBC2026, VisualOn will demonstrate how video service providers can slash bandwidth costs, maximize ad revenue, and deploy premium interactive features withou...

18/08/2026

Paying It Forward: Greg Tabor on Giving Back to the Next Generation

The relationships built during graduate school often continue to shape careers long after a degree is earned, creating a community of scientists who learn from ...

18/08/2026

Stunning Irish performances at European Athletics and Swimming Championships reach almost 1.7 million viewers

Stunning Irish performances at European Athletics and Swimming Championships rea...

18/08/2026

An Irish Atlantic Rainforest: The Story of a West Cork Rainforest on the edges of the Beara Peninsula

The two-part series begins Sunday 23 August at 6.30pm on RT One and RT Player ...

17/08/2026

Thank You Mr. Brown: Documentary on Steadicam, Skycam Inventor Garrett Brown Is in the Works

Producer William Forbes and director Andrew Schwartz detail the decade-long effo...

17/08/2026

SHIK open S32 pre-orders

New MIDI processor & macro controller revealed SHIK have announced that they have opened pre-orders for the S32, a standalone MIDI processor and macro contr...

17/08/2026

Melbourne Instruments introduce 10-year motor warranty

Cover extended on innovative motorised pot system Melbourne Instruments have just revealed that the innovative motorised pot system used in their synths and...

17/08/2026

1010music update the Bluebox

Latest firmware version now available 1010music have just released a free firmware update that brings some nice new features to their renowned Bluebox digit...

17/08/2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry Days 2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry...

17/08/2026

Calrec Integrates ImPulseV with NEP Platform

Calrec's ImPulseV Virtualised Audio Mixing Engine joins NEP Platform, the industry's largest ecosystem of trusted production software, bringing scalable...

17/08/2026

PTZOptics To Unveil Rise 4K Broadcast PTZ Camera At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

17/08/2026

Calrec Integrates ImPulseV With NEP Platform

Share Copy link Facebook X Linkedin Bluesky Email...

17/08/2026

Calrec Integrates ImPulseV with NEP Platform Advancing Sc...

Continuing its virtualisation strategy, Calrec has integrated its ImPulseV virtualised DSP software with NEP Platform, bringing its scalable audio processing ca...

17/08/2026

Mediaproxy debuts AI-powered monitoring - browser based m...

Mediaproxy, the global standard for software-based IP compliance monitoring and multiviewing solutions, will highlight major innovations in compliance monitorin...

17/08/2026

FilmLight Showcases Workflow Automation, Advanced Media Collaboration, and Baselight v8 Preview at IBC 2026

Visitors to IBC 2026 will see how FilmLight is reshaping the modern post pipelin...

17/08/2026

Arqiva x IBC 2026 - Simplify Complexity and Unlock Greater Value

Visitors to Stand 1.C41 can explore innovations in areas such as addressable advertising, hybrid distribution, managed services and operational simplification. ...

16/08/2026

Gospel Musicians release Gospel Drums

Virtual drummer joins line-up The latest release from Gospel Musicians adds a virtual drummer to the company's line-up, combining a pair of meticulously...

15/08/2026

JH Audio expand Universal-Fit range

In-ear monitoring line-up gains new universal models In-ear monitoring experts JH Audio have just announced a significant expansion of their Universal-Fit r...

15/08/2026

Press Release: NFVF Releases PESP6 Project 1, Stream1: Group 2, Stream 2 and Stream 3 Funding Approvals

14 August 2026 | Johannesburg - The National Film and Video Foundation (NFVF), a...

15/08/2026

FCC Broadband Report Shows Rapid Expansion of High-Speed Internet

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

Adte and Haystack News Partner on CTV Ads in Runup to Midterms

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

IBC 2026: Dalet to Demo AI-Orchestrated Live Sports Workflows

Share Copy link Facebook X Linkedin Bluesky Email...

15/08/2026

Add rounded corners to mask in After Effects

Add rounded corners to mask in After Effects Graham Quince August 14, 2026 0 Comments Ever wished you could smoothly round the corners of a Mask Path ...

15/08/2026

Director Go Riju's Rhapsody Rhapsody Shot on Blackmagic PYXIS 6K

Director Go Riju's Rhapsody Rhapsody Shot on Blackmagic PYXIS 6K Brie Clayton August 14, 2026 0 Comments Anamorphic cinematography and color gradi...

14/08/2026

AT&T Returns as Sponsor of Fifth-Annual DirtFish Women in Motorsport Summit

AT&T returns as a sponsor of the DirtFish Women in Motorsport (WiM) Summit, which marks its fifth year Aug. 21-22 in Snoqualmie, WA. This year's event will ...

14/08/2026

Perfect Game Blends Broadcast Polish with Social Swagger as All-American Classic Makes Move to Citizens Bank Park

A six-camera flypack production will anchor Sunday's game while Perfect Game...

14/08/2026

UJAM introduce Virtual Drummer Neon

Latest instalment delivers disco-inspired grooves The latest addition to UJAM's virtual drum line-up has been designed with contemporary pop, disco, dan...

14/08/2026

Yorkville launch the EL24S

Elite range gains giant 24-inch powered sub The latest expansion of Yorkville's Elite range introduces what the company say is the world's first act...

14/08/2026

Call for the 20th South African Film & Television Awards (SAFTAs20) Overall Judging Chairpersons Nominations

The National Film and Video Foundation (NFVF), an agency of the Department of Ar...

14/08/2026

LiveU, Panasonic LUMIX Launch 'Live Anywhere' Production Workflow

Share Copy link Facebook X Linkedin Bluesky Email...

14/08/2026

PBS Station Takes Iron Mountain to Court Over Archives

Share Copy link Facebook X Linkedin Bluesky Email...