Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier

19/10/2021

Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
LINK: https://blogs.nvidia.com/blog/2021/10/18/exascale-day-ai/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

30/09/2026

SVG Students To Watch: Jacquelynn Dupree, Clark Atlanta University

Drawn to the many moving pieces of a live broadcast, this Los Angeles native is building a path in production management and technical operations...

30/09/2026

NHL on TNT Opens New Season in 1080p HDR With Stanley Cup Final on the Horizon

TNT Sports goes big for its season opener in Philadelphia, and REMI workflows at Techwood will again anchor much of regular-season production...

30/09/2026

Katlyn Alexander Named CEO of Qvest North America

Qvest has appointed Katlyn Alexander as CEO of Qvest in North America, effective August 16, 2026. Alexander, who previously served as COO of Qvest US, succeeds ...

30/09/2026

AAPB Wraps 2026 Season with Record Viewership and Expanded Broadcast Footprint

The American Association of Professional Baseball (AAPB) has wrapped its 2026 season, with leaguewide attendance surpassing 1.4 million for the fifth consecutiv...

30/09/2026

Veritone Partners with ATP Media to License Tennis Archive in North America

Veritone has announced a multi-year content licensing agreement with ATP Media, the broadcast production and distribution arm of the ATP Tour, making ATP's ...

30/09/2026

Netflix To Stream WWE Exclusively in Japan Beginning October 1

Netflix has announced it will become the exclusive home for WWE programming in Japan beginning October 1, 2026. The lineup includes Raw, SmackDown, NXT, Premium...

30/09/2026

SES and Sky Extend Satellite Capacity Agreement for UK and Ireland

SES and Sky have announced a new multi-year agreement for direct-to-home satellite services across the United Kingdom and Republic of Ireland, running into the ...

30/09/2026

Big Blue Marble Adds Live Multiview Channels to Cloud Video Kit via AWS Elemental Dynamic Multiview

Big Blue Marble has announced the addition of live multiview channels to its Clo...

30/09/2026

NHRA Announces Multi-Year Media Rights Deals With FOX Sports, The CW, and FloSports

The NHRA has announced multi-year media rights agreements with FOX Sports, The C...

30/09/2026

FOX 5 Atlanta to Broadcast Nashville Predators Games in 2026-27 Season

FOX 5 Atlanta (WAGA-TV) will carry Nashville Predators games during the 2026-27 season as part of Scripps Sports' regional broadcast network for the team. G...

30/09/2026

SVG Sit-Down: Brahma AIs Patrio Cummins on the Possibilities of AI (and the Misconceptions)

AI was a big buzz on the IBC show floor but there weren't a ton of companies...

30/09/2026

PGA TOUR Names Ryan Holcomb Senior Vice President and Head of Original Content

The PGA TOUR has announced the appointment ofRyan Holcomb as Senior Vice President and Head of Original Content, according to The Hollywood Reporter. Holcomb wi...

30/09/2026

ESPN Drops the Puck on Enhanced Audio for the New NHL Season

The sound will be more immersive, with improved design and more mikes on the ice and the players The National Hockey League's season opener on Tuesday nigh...

30/09/2026

TNT Sports' Chris Brown, Lee Mabry on Beginning 2026-27 NHL Season With an Onsite Effort in Philly

TNT Sports is dropping the puck on the 2026-27 NHL season in a big way in Philad...

30/09/2026

International Swimming League Names Gravity Media as Production Partner

The International Swimming League ( ISL ) today announced the appointment of Gravity Media, global leader in live production and content and media services and ...

30/09/2026

Give Me the Backstory: Get to Know Amir Bar-Lev, the Director of The Last First: Winter K2

By Ramona Flume One of the most exciting things about the Sundance Film Festiva...

30/09/2026

Sync Audio release MegaMorph

Add an envelope generator to any plug-in Sync Audio's latest creation is a handy utility plug-in that can be used to combine and modulate other effects ...

30/09/2026

Strymon launch the La Brea

All-analogue tape-style drive joins Series A Strymon's reputation was built on their digital knowhow, so many were surprised (and intrigued) when they a...

30/09/2026

Sonuscore The Pulse: Synth Wave & Epic Atmospheres

Two new expansion packs released Sonuscore have just introduced two new expansion packs for The Pulse, its production engine instrument for modern cinematic...

30/09/2026

Clear-Com's Arcadia Central Station Brings Professional Production Communications to...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

30/09/2026

AWARN Alliance Urges FCC to Let Broadcasters Tap Full 3.0 Capabilities

Share Copy link Facebook X Linkedin Bluesky Email...

30/09/2026

Senator Asks If All-GOP FCC Would Violate Federal Law

Share Copy link Facebook X Linkedin Bluesky Email...

30/09/2026

Marshall PTZ Cameras Bring Legendary Progressive Rock Exp...

The An Evening with Emerson, Lake and Palmer tour brings one of rock's most iconic bands back to the stage. These performances seamlessly blend live foota...

30/09/2026

Schibsted Media Chooses DHD RX2 and TX2 Mixers for Remote...

Schibsted Media, one of Norways largest and most influential digital media publishers and content producers, has invested in mixers and digital signal processor...

30/09/2026

Big Blue Marble adds live multiview channels to its video...

Big Blue Marble announces the addition of live multiview channels to Cloud Video Kit, its broadcast-grade video processing platform. The feature is powered by A...

30/09/2026

Telekom Slovenije brings local advertising to internation...

Leading video software provider Synamedia today announced that Telekom Slovenije, Slovenia's largest provider of telecommunications and TV services, is open...

30/09/2026

PODCAST EXPO 2026 Recorded Using Blackmagic Design Workflow

PODCAST EXPO 2026 Recorded Using Blackmagic Design Workflow Brie Clayton September 29, 2026 0 Comments Conference featuring 24 sessions over two days ...

30/09/2026

IBC2026 Show Report

IBC2026 Show Report David Kirk September 29, 2026 0 Comments The International Broadcasting Convention has long been Europe's equivalent of the US...

30/09/2026

SGO Unveils Workflows Slate To Enable Automated Burn-ins, Slates

Share Copy link Facebook X Linkedin Bluesky Email...

30/09/2026

Public Advocacy Group Urges Broadcasters to Stop Airing Trump Taxpayer Funded Ad

Share Copy link Facebook X Linkedin Bluesky Email...

30/09/2026

Qvest Promotes Katlyn Alexander to CEO, North America

Share Copy link Facebook X Linkedin Bluesky Email...

30/09/2026

Mavis Camera 8-2 adds iPhone 18 Pro Support with Variable...

Mavis has launched Mavis Camera 8.2, the latest release of its professional camera app for the iPhone and iPad. This update brings support for iPhone 18 Pro and...

30/09/2026

Harmonic Launches Recon Product Family Developed in Partnership with Comcast

New Solution Expands Harmonic's Network Intelligence Portfolio and Brings Comcast-Developed Fiber Monitoring Technology to Broadband Operators, Providing Re...

30/09/2026

A Look Back at (My) 524 Months with Broadcast Cameras

Thank you to Film-TV Video for the original article - you can view it here It was early 1983. I had just turned 21 when I joined Hitachi Denshi's European...

30/09/2026

Claire Brock and Sophie Morris discover how consumers can shop smarter in new RT documentary series

How to Shop Well Now starts Monday at 9.35pm on RT One and RT Player On the...

30/09/2026

From Training to Production, NVIDIA and CoreWeave Close the Loop on Agentic AI

Building on nearly a decade of co-engineering, CoreWeave has built NVIDIA compute, networking and software into a cloud purpose-built for AI that's still re...

29/09/2026

Oak View Group Names Cisco as Official Technology Partner

Oak View Group (OVG) has announced Cisco as an Official Technology Partner, with plans to standardize infrastructure across its venue network on Cisco solutions...

29/09/2026

SportsNet Pittsburgh Wins Three Mid-Atlantic Emmy Awards

SportsNet Pittsburgh (SNP) won three honors at the 2026 Mid-Atlantic Emmy Awards. Program awards went to Bucs BP in the Sports Program Live category (produced ...

29/09/2026

CBC, PWHL Revive Hockey Night in Canada' on Saturdays

The Professional Women's Hockey League has announced home openers for all 12 teams for the 2026-27 season, along with a broadcast partnership with CBC under...

29/09/2026

Manifold Technologies Recognized as MXL Contributor Following IBC Innovation Award

Manifold technologies has been recognized as a contributor to the Media eXchange...

29/09/2026

Fubo Launches My Local Sports RSN Add-On Package

FuboTV has announced My Local Sports, allowing subscribers in select markets to add their local regional sports network (RSN) as an add-on to a Fubo Sports subs...

29/09/2026

ANI Deploys Grass Valley AMPP and Framelight X for News Operations

Asian News International (ANI), a wire agency and video news provider based in India, has deployed Grass Valley's AMPP Media Operating System and Framelight...

29/09/2026

SABC Deploys Ikegami UHK-X600 Cameras for IP-Based Production

South African Broadcasting Corporation (SABC) has deployed Ikegami UHK-X600 cameras as part of an upgrade to IP-based production infrastructure. The deployment ...

29/09/2026

Busy in Bristol: ESPN Headquarters Come Alive With New Studio W, Remote-Production Workflows

REMI, REMCO models will drive the bulk of the broadcaster's NHL productions ...

29/09/2026

NASCAR Productions' Keith D'Alessandro on the Continued Evolution of Its Centralized Production Hub

Three years in, the facility is supporting more centralized race production, com...

29/09/2026

NBC Sports Brings Robust Sunday Night Baseball Production Playbook to MLB Wild Card Round

NBC, Peacock, and NBSN are carrying all four Wild Card series with a production ...

29/09/2026

Sundance Institute Announces 2026 Doc Fund Grantees

19 Nonfiction Projects Across All Stages of Production to Receive More Than $1 million in Support as Documentary Film Program Approaches 25th Anniversary LOS ...