Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier

19/10/2021

Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
LINK: https://blogs.nvidia.com/blog/2021/10/18/exascale-day-ai/...
See more stories from nvidia

Most recent headlines

01/06/2029

IMT AIRBORNE VIDEO DOWNLINK SYSTEM (AVDS) TAKES OFF AT ALEA EXPO 06

Jun29 IMT AIRBORNE VIDEO DOWNLINK SYSTEM (AVDS) TAKES OFF AT ALEA EXPO 2016 SAVANNAH, GA, JUNE 29, 2016 - Integrated Microwave Technologies (IMT), a leader in...

01/04/2025

Images from NAB 2017

Apr25 Images from NAB 2017 Mike Payne of Vislink delivers a presentation on newsnet, a secure, high-bandwidth IP network that completely transforms traditiona...

01/04/2024

VISLINK UNVEILS ALL-NEW HCAM, HEVC 4K UHD CAMERA TRANSMITTER AT NAB 2017

Apr24 VISLINK UNVEILS ALL-NEW HCAM, HEVC 4K UHD CAMERA TRANSMITTER AT NAB 2017 18 Unit Purchase by UK Based-Broadcast RF to be Finalized at Show LAS VEGAS, ...

03/12/2021

Beverley Callard joins cast of Newark, Newark

Thursday 2 December 2021 Beverley Callard (Coronation Street) is set to star as Pauline in Golds recently announced comedy, Newark, Newark. The series is produc...

03/12/2021

EMG & Imagine Communications Case Study

EMG & Imagine Communications Case Study posted: 03/12/2021 Creating efficiencies in remote production in Tokyo EMG is a leading global provider of broadca...

02/12/2021

FOOD NETWORK CANADA IGNITES TASTE BUDS THIS WINTER WITH A FULLY STOCKED SLATE OF NEW SERIES AND RETURNING HITS

FOOD NETWORK CANADA IGNITES TASTE BUDS THIS WINTER WITH A FULLY STOCKED SLATE OF...

02/12/2021

Hitachi Selected by the University of Tsukuba for its Second Proton Therapy System

First-ever additional proton therapy center order from an existing facility in J...

02/12/2021

Grass Valley and Broadcast Solutions Group Sign Multi-Million Enterprise Pricing Agreement

MONTREAL, December 2, 2021 - Grass Valley announces it has signed an enterprise ...

02/12/2021

IBC Announces Changes to IBC Digital

LONDON Despite the cancellation of the 2021 IBC in-person event, IBC is refining its IBC Digital online program to reflect last minute changes....

02/12/2021

Artel Joins Ross openGear

OTTAWA Ross Video has announced that Artel Video Systems has joined its Emmy-award winning openGear signal processing platform. Created in 2006, openGear is the...

02/12/2021

ESPN Digital Hits Record 120M U.S. Users in October

BRISTOL, Conn. The fall sports season has been boosting digital audiences on ESPN Digital to new records, with the company reporting 120 million unique visitors...

02/12/2021

CBC/Radio-Canada Plans 3,500+ Hours of Live Winter Olympics Coverage

OTTAWA, Canada In the runup to the Olympic Winter Games Beijing 2022, CBC/Radio-Canada has announced that its coverage of the XXIV Olympic Winter Games Beijing ...

02/12/2021

How Take 1 helps broadcasters and streaming services meet the demand for subtitled and localised content

TVBEurope talks to Take 1 CEO Louise Tapia about the companys work providing sub...

02/12/2021

Sonys Airpeak S1 Drone for Video Professionals Now Available for Order

SAN DIEGO Sony Electronics today announced the availability timing of the company's first-ever professional drone, Airpeak S1. The introductory model in the...

02/12/2021

Discovery Extends Relationship with AWS To Assist in Global Rollout of Discovery+

SEATTLE Discovery has turned to Amazon Web Services (AWS) to assist with the glo...

02/12/2021

Vislink Introduces New Mobile Viewpoint BaseLink 5G Mobile Encoder

HACKETTSTOWN, N.J. Vislink this week launched its new Mobile Viewpoint BaseLink 5G mobile encoder for remote production and enhancements to its and Mobile Viewp...

02/12/2021

AccuWeather Network Inks Measurement Deal with Nielsen

STATE COLLEGE, Penn. The AccuWeather Network has announced that it has entered into a multi-year agreement with Nielsen for cable TV measurement to help deepen ...

02/12/2021

Senate Panel Approves Rosenworcel's Nomination to FCC

WASHINGTON D.C. The Senate Commerce, Science, and Transportation Committee has voted to approve Jessica Rosenworcel s nomination to another term at the Federal ...

02/12/2021

Gigi Sohn Navigates Issue-Filled FCC Nomination Hearing

WASHINGTON, D.C. As expected, Democratic Federal Communications Commission nominee Gigi Sohn took some tough questions during her Senate Commerce Committee nomi...

02/12/2021

Ross Updates its Servers

OTTAWA Ross has added new functionality to its video server line of products, which include Mira, Tria and Kiva products and has reduced prices as well....

02/12/2021

New ViacomCBS Report Shows Improved Diversity in Management Ranks

NEW YORK As part of ViacomCBS's efforts to improve the diversity of its workplace and the content it delivers to the public, the company has issued its seco...

02/12/2021

A+E Networks to Launch in Encompass' Altitude Media Cloud

ATLANTA In a notable example of how media companies are moving operations into cloud-based infrastructures, Encompass Digital Media has announced that it will l...

02/12/2021

Canon Launches a New Reference Display and a PTZ Camera

MELVILLE, N.Y. Canon USA has announced two new products, the DP-V1830 18.4-inch 4K/HDR professional reference display and the CR-X300 4K outdoor PTZ camera....

02/12/2021

Alibi secures UK broadcasting rights for Pretty Hard Cases, fronted by Meredith MacNeill and Adrienne C. Moore

1st December 2021 UKTV today announces that Alibi has secured rights to the UK b...

02/12/2021

SVG Voices: WWE Director of Television Production Management Jeremy Shand

SVG Voices: WWE Director of Television Production Management Jeremy Shand By SVG Staff Thursday, December 2, 2021 - 6:30 am Print This Story | Subscribe ...

02/12/2021

SVG Esports Production Summit: NBA 2K League's Matt Arden & TJ Canty on Pivoting to Remote Production, Creating a New Fan Experience

SVG Esports Production Summit: NBA 2K League's Matt Arden & TJ Canty on Pivo...

02/12/2021

Sky Deutschland Pushes Ahead With Pioneering 5G Trials for In-Stadium App and e2e Broadcasting

Sky Deutschland pushes ahead with pioneering 5G trials for in-stadium app and e2...

02/12/2021

SVG, Hazeleden Betty Ford Families in Recovery Series Looks at Dealing with Stigma, Shame, and Guilt

SVG, Hazeleden Betty Ford Families in Recovery Series Looks at Dealing with Stig...

02/12/2021

Sports Broadcasting Hall of Fame 2020-21: Fred Gaudelli, Father of the Modern Pro-Football Broadcast

Sports Broadcasting Hall of Fame 2020-21: Fred Gaudelli, Father of the Modern Pr...

02/12/2021

The SVG Podcast: Inside the League of Legends World Championship Final With Riot Games' Nick Troop and Carrie Dunn

The SVG Podcast: Inside the League of Legends World Championship Final With Riot...

02/12/2021

SVG Summit Preview: Dec. 14 Sessions Dive Deep in Market Segments

SVG Summit Preview: Dec. 14 Sessions Dive Deep in Market Segments By SVG Staff Thursday, December 2, 2021 - 2:09 pm Print This Story | Subscribe Story H...

02/12/2021

Net Insight delivers JPEG XS to Nimbra media network customers

Net Insight's automatable JPEG XS products for IP and Cloud deliver resource savings Stockholm, Sweden - Net Insight announces the launch of JPEG XS applic...

02/12/2021

25/11/2021

SBS has today launched its first ever bilingual podcast series - The Ugly Ducklings of Italian Cuisine (Scarrafoni in cucina) in English and Italian - celebrati...

02/12/2021

Signal source analyzer from Rohde & Schwarz in operation at laboratories of US Air Force

Signal source analyzer from Rohde & Schwarz in operation at laboratories of US A...

02/12/2021

Riedel Continues Growth Path and Expands Leadership Structure

Wuppertal December 2, 2021 Riedel Continues Growth Path and Expands Leadership Structure As part of its global growth strategy, the Riedel Group announces a s...

02/12/2021

Nokia to drive KDDI's 5G transition with standalone core and monetization solutions

Nokia to drive KDDI's 5G transition with standalone core and monetization so...

02/12/2021

Nokia Corporation financial calendar for 2022

Nokia Corporation financial calendar for 2022 Nokia Corporation Stock Exchange Release 2 December 2021 at 08:00 EET Nokia Corporation financial calendar ...

02/12/2021

Nokia deploys 400GE IP solution to enable TOP-IX to scale its interconnection infrastructure and expand its service portfolio

Nokia deploys 400GE IP solution to enable TOP-IX to scale its interconnection in...

02/12/2021

Emily Receives a Birthday Surprise in Sneak Peek at 'Emily in Paris' Season 2

Back to All News Emily Receives a Birthday Surprise in Sneak Peek at Emily in P...

02/12/2021

LinkedIn launches in Hindi to boost access to opportunities...

LinkedIn launches in Hindi to boost access to opportunities for 600 million people Published on Dec 2, 2021 Categories: Asia, Product News LinkedIn Corpora...

02/12/2021

Fujifilm wins top award for its service operation

Fujifilm wins top award for its service operation Fujifilm's UK Graphics Service team wins big at the European Field Service Awards December 2, 2021 Pr...

02/12/2021

Eutelsat's Konnect Africa and Vodacom partner to bring high-speed broadband to unserved regions of Tanzania

Photo credit: (Shutterstock) Press release - 2 December 2021 13:07 Eutelsa...

02/12/2021

Enterprise And Media Organizations Drive Revenue, Engagement, And Demand With Brightcove Solutions, Independent Study Reveals

All Press ReleasesShare All Press Releases Enterprise And Media Organization...

02/12/2021

Go Shops Year End Sale Is Back! Here Are The Best Deals To Look Out For!

02 December 2021 Go Shops Year End Sale Is Back! Here Are The Best Deals To Look Out For! Go Shop kicks off the holiday shopping season with a month-long Ye...

02/12/2021

EnergaCAMERIMAGE 2021 winners trust in ARRI's Super 35 and LF cameras

Toru , Poland, became a top destination for cinematographers and cinephiles once again this November when Camerimage rolled out its red carpets. After last year...

02/12/2021

MediaKind and Arqiva partner to break down the barriers to cloud migration with unique, fully-managed video service

Launch of a pioneering Media & Entertainment partnership enabling cloud migratio...

02/12/2021

2021-12-02

Apple today revealed the 2021 App Store Award winners, recognising the 15 best apps and games that helped users tap into personal passions, discover creative ou...

02/12/2021

It's heartbreaking': Gomora' viewers want Mazet freed from the wheelchair

It's heartbreaking': Gomora' viewers want Mazet freed from the whee...