Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier

19/10/2021

Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
LINK: https://blogs.nvidia.com/blog/2021/10/18/exascale-day-ai/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

26/08/2026

Bolin Technology and ITDev Join AIMS

Share Copy link Facebook X Linkedin Bluesky Email...

26/08/2026

Enco to Highlight Caption, Translation Enhancements at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

26/08/2026

ZOO Digital Chooses Interra Systems BATON for Quality Control

Share Copy link Facebook X Linkedin Bluesky Email...

26/08/2026

Gomez Criticizes FCC's Media Bureau on Political Advertising

Share Copy link Facebook X Linkedin Bluesky Email...

26/08/2026

Tedial to Demo AI-Driven Media Supply Chain Solutions at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

26/08/2026

AIMS Welcomes Bolin Technology and ITDev as Newest Member...

PTZ Camera Manufacturer and FPGA Design Specialist Join Alliance to Advance IPMX and Open AV-over-IP Standards The Alliance for IP Media Solutions (AIMS) today...

26/08/2026

ZOO Digital Selects Interra Systems BATON for File-Based...

BATON offers ZOO Digital advanced audio and video quality analysis, and scalable architecture Interra Systems, a leading provider of end-to-end quality assuran...

26/08/2026

Scottish Rugby Expands Managed Coach Communications Partn...

Riedel Communications today announced the continued expansion of its managed coach communications partnership with Scottish Rugby Union. Now entering its third ...

26/08/2026

Zixi Demonstrates Hybrid Workflows and Proven Live Video...

Zixi brings Broadcaster V19 and showcases interoperable platform on Stand 5.A76 Zixi, a leader in live video delivery and workflow orchestration, will be exhib...

26/08/2026

Scripps Research professor Jeffery Kelly elected to the European Academy of Engineering

LA JOLLA, CA-Jeffery Kelly, the H. Lutcher Brown Professor of Chemistry at Scrip...

26/08/2026

Indie Developer Launches Orty, aWindows App That Helps Freelance VideoEditors Find Better Clients

Indie Developer Launches Orty, aWindows App That Helps Freelance VideoEditors Fi...

26/08/2026

BTS on Sinners and Is God Is Shot with Pocket Cinema Camera 6K Pro

BTS on Sinners and Is God Is Shot with Pocket Cinema Camera 6K Pro Brie Clayton August 25, 2026 0 Comments Award winning filmmaker Travis Henry elevat...

25/08/2026

Open, Sustainable, Predictable: What Utah Scientific Is Bringing to IBC 2026

Open, Sustainable, Predictable: What Utah Scientific Is Bringing to IBC 2026 As broadcast leaders prepare to gather at the RAI Amsterdam for IBC 2026, the main ...

25/08/2026

The Big Shift: Inside NC State's Phased Move From SDI to SMPTE ST 2110

NC State's Matthew Byrd breaks down how an IP-based infrastructure is delivering greater flexibility and scalability for Wolfpack productions...

25/08/2026

Monumental Sports Network Adds DAZN as Distribution Partner for Monumental+ in the DMV

Deal expands the DTC reach in-market of Capitals, Wizards, Mystics games and oth...

25/08/2026

Jacksonville Jaguars Carlos Caceres on Producing Shows at an Ever-Evolving EverBank Stadium

The two-year renovation period will create a stadium of the future for the NFL f...

25/08/2026

Behind The Mic: Genie Bouchard Joins ESPN for 2026 US Open; NBC Sports Names College Football Announce Hosts

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

25/08/2026

LD Systems Installs L-Acoustics A Series at Shell Energy Stadium in Houston

Shell Energy Stadium in Houston has installed a new L-Acoustics A Series loudspeaker system, designed and installed by LD Systems, a Clair Global brand. The 20,...

25/08/2026

FloCollege Expands Distribution and Adds Features for 2026-27 Season

FloCollege is expanding its distribution and product offerings for the 2026-27 season, covering more than 20 NCAA partner conferences across Division I, II, and...

25/08/2026

TNA Wrestling and REVOLT Announce Content Partnership

TNA Wrestling and REVOLT have announced a content partnership bringing exclusive TNA Xplosion matches and content from TNA's library to REVOLT. Our indust...

25/08/2026

Gracenote: FAST Sports Programming Growth Outpaces Channel Growth

Gracenote, Nielsen's content intelligence business, has released its Q3 2026 Data Hub analysis showing that FAST sports programming is growing at more than ...

25/08/2026

Amagi Appoints Thomas dHrouville Head of Sales for France, Benelux, and Nordics

Amagi has appointed Thomas d'H rouville as Head of Sales for France, Benelux, and Nordics. Based in Paris, he will lead Amagi's growth strategy across t...

25/08/2026

IPC Appoints CCATech as Channel Partner in Brazil

IPC has appointed CCATech as its channel partner in Brazil, expanding the company's presence in Latin America. CCATech was founded in 2023 by Carlos Abrah o...

25/08/2026

FanConnect Introduces FC4 Multi-Output Media Player

FanConnect has announced the FC4, a multi-output media player designed to drive mid-sized video walls, multi-screen concession stands, and multi-display digital...

25/08/2026

JWX Launches JWX Content Hub for Publisher Video Distribution and Monetization

JWX has launched JWX Content Hub, a platform for publisher video that combines content transformation, social distribution, audience engagement, and monetizatio...

25/08/2026

Techex Appoints Stuart Almond as Chief Revenue Officer

Techex has appointed Stuart Almond as Chief Revenue Officer. Almond brings more than 25 years of experience across technology, media, and telecommunications, ha...

25/08/2026

IBC 2026: Grass Valley to Showcase Unified SDI, IP, and Software Infrastructure

Grass Valley will demonstrate infrastructure connecting SDI, SMPTE ST 2110, MXL, and software-based processing at IBC2026 (Booth 9.A01, RAI Amsterdam, September...

25/08/2026

Taking Control: How Professional Sports Teams Are Building Their In-Market Future as the RSN Model Fractures

Franchises are taking greater ownership of production, distribution, and the fan...

25/08/2026

The PRO Tour Takes Golf Broadcasts Wireless With BMG's REMI-Driven Production Model

The first-year circuit for former professional athletes leans on LiveU, Starlink...

25/08/2026

UNIVERSAL FILM AND FOCUS FEATURES RENEW EXCLUSIVE PARTNERSHIP WITH SUNDANCE INSTITUTE TO SUPPORT RISING FILMMAKERS

Announcing the 2026 Sundance Institute Breakthrough | Focus Features Fellows L...

25/08/2026

Soundgas third John Paul Jones auction now live

Auction Part 3 running until 9 September 2026 Soundgas have announced that the latest stage of their John Paul Jones Gear Auction is now live, and that bids...

25/08/2026

MONO Music Conference programme announced

Over 60 award-winning artists, songwriters, producers, engineers The MONO Music Conference (formerly Music Expo SF), San Francisco's premier event for m...

25/08/2026

Groove Synthesis update the 3rd Wave

All three versions receive firmware upgrade Groove Synthesis have just launched a free firmware update that kits the 3rd Wave out with two major new feature...

25/08/2026

Clear-Com FreeSpeak Cell Field Trial Demonstrates Cellular Intercom Capabilities...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

25/08/2026

BMG Taps LiveU For REMI Coverage of Golf's Pro Tour

Share Copy link Facebook X Linkedin Bluesky Email...

25/08/2026

Rate of Subscription Fee Hikes Drops for Netflix, Disney+ and Amazon

Share Copy link Facebook X Linkedin Bluesky Email...

25/08/2026

Law&Crime Reconvenes Court TV on Amagi CLOUDPORT

Share Copy link Facebook X Linkedin Bluesky Email...

25/08/2026

Akta Tech To Showcase AI-First Video Platform At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

25/08/2026

Major Live Sports Events Bolster Broadcast Viewing in Q2 2026

Share Copy link Facebook X Linkedin Bluesky Email...

25/08/2026

Lingopal debuts real-time AI translation advances for mul...

Lingopal, the AI-powered live translation and localization specialist, is unveiling new platform capabilities at IBC2026 (11 14 September, RAI Amsterdam), helpi...

25/08/2026

TV5MONDE combines AI and editorial expertise with Bminty...

Bminty is supporting TV5MONDE in the evolution of its editorial processes through a new AI-assisted press information generation solution. Combining the Louise ...

25/08/2026

Two Cultures. Millions Reached. One Berklee Connection.

Two Cultures. Millions Reached. One Berklee Connection. Meet Annie Dickinson and Zhengxi Zhang-the couple who turned their creative partnership into music car...

25/08/2026

Law and Crime Moves Court TV to Amagi CLOUDPORT for Unifi...

Amagi, the media industry cloud platform for unified broadcast, streaming, and monetization, today announced that Law&Crime has migrated its Court TV channel, s...

25/08/2026

Broadcast Solutions demonstrates world-class technology a...

Broadcast Solutions, a leading systems integrator and provider of innovative solutions for the broadcast and media industry, is showcasing the breadth of its ca...

25/08/2026

Leader boosts Test and Measurement capabilities for Denma...

Thatcham, UK 25 August 2026: Test & measurement innovator, Leader Electronics, has announced that leading broadcast rental company Minitech has purchased a Le...

25/08/2026

Appear and TVTEL power centralised VAR signal transport i...

Appear's X20 Platform enables visually lossless video contribution with sub-frame latency and full path redundancy for TVTEL's centralised VAR operation...

25/08/2026

Big Blue Marble to showcase next-generation 5G Broadcast...

World-first demonstration combines 5G Broadcast and Media over QUIC for seamless, ultra-low-latency hybrid media delivery Big Blue Marble will showcase new dev...