Sony Pixel Power calrec Sony

An Engineer Recalls How AI Broke the Exascale Barrier

19/10/2021

Thorsten Kurth still remembers the night he discovered his team broke the exascale barrier.

On the couch at home at 9 p.m., he was pouring over the latest results from one of the first big jobs run on Summit, then the world's top supercomputer, based at Oak Ridge National Laboratory.

The 12-person team had spent nights and weekends seeking a way that AI could track hundreds of hurricanes and atmospheric rivers buried in terabytes of historical climate data.

Only a few weeks earlier, their software failed to run on more than 64 of the system's nodes.

But this time - just two days before a paper on the work was due - it exercised 4,560 of Summit's 4,608 nodes to deliver the results. In the process, it achieved 1.13 exaflops of mixed-precision AI performance.

That was a good feeling, a lot of hard work paid off, recalled Kurth of the work he led while at Lawrence Berkeley Lab in 2018.

Entering the Exascale Era Today, we celebrate the work of everyone who's cracked a quintillion operations per second.

That's a billion billion or 10 to the 18th power. That's why we mark Exascale Day on Oct. 18.

About the same time Kurth's team was completing its work, researchers at Oak Ridge also entered the exascale era, hitting 1.8, then 2.36 exaflops on Summit, analyzing genomics to better understand the nature of opioid addiction.

COVID-19 Ignites Exascale Work Since then, many others have pushed the limits of science with GPUs.

In March 2020, the Folding@home project put out a call for donations of free cycles on home computers to run research examining the COVID-19 virus.

Ten days later their virtual, distributed system surpassed 1.5 exaflops, creating a crowd-sourced exascale supercomputer fueled in part by more than 356,000 NVIDIA GPUs.

AI Supercomputing Goes Global Today, academic and commercial labs worldwide are deploying a new generation of accelerated supercomputers capable of exascale-class AI.

The latest is Polaris, a system Hewlett Packard Enterprise (HPE) is building at Argonne National Lab capable of up to 1.4 AI exaflops. Researchers will use it to advance cancer treatments, explore clean energy and push the limits of physics, work that will be accelerated by 2,240 NVIDIA A100 Tensor Core GPUs.

Another powerful system stands on the campus of the University of California at Berkeley. Perlmutter uses 6,159 A100 GPUs to deliver nearly 4 exaflops of AI performance for more than 7,000 researchers working on projects that include drawing the largest 3D map of the visible universe to date.

Polaris and Perlmutter also use NVIDIA's software tools to help researchers prototype exascale applications.

Europe Erects Exascale AI Infrastructure Atos will build an even larger AI supercomputer for Italy's CINECA research center. Leonardo will pack 14,000 A100 GPUs on an NVIDIA Quantum 200Gb/s InfiniBand network to hit up to 10 exaflops of AI performance.

It's one of eight systems in a regional network that backers call an engine to power Europe's data economy.

One of Europe's largest AI-capable supercomputers is slated to come online in Switzerland in 2023. Alps will be built by HPE at the Swiss National Computing Center using NVIDIA GPUs and Grace, our first data center CPU. It's expected to scale to heights up to 20 AI exaflops.

An Industrial HPC Revolution Begins The move to high-performance AI extends beyond academic labs.

Advances in deep learning combined with the simulation technology of accelerated computing has put us at the beginnings of an industrial HPC revolution, said NVIDIA founder and CEO Jensen Huang in a keynote earlier this year.

Selene uses a modular architecture based on the NVIDIA DGX SuperPOD NVIDIA was an early player in this trend.

In the first days of the pandemic, we commissioned Selene, currently ranked as the world's fastest industrial supercomputer. It helps train autonomous vehicles, refine conversational AI techniques and more.

In June, Tesla Inc. unveiled its own industrial HPC system to train deep neural networks for its electric cars. It packs 5,760 NVIDIA GPUs to deliver up to 1.8 exaflops.

Beyond the Numbers Three years after winning a Gordon Bell award for breaking the exascale barrier, Kurth, now a senior software engineer at NVIDIA, sees the real fruit of his team's labors.

Improved versions of the AI model they pioneered are now available online for any climate scientist to use. They handle in an hour what used to take weeks. Governments can use them to plan budgets for disaster response.

In the end, Exascale Day is all about the people, because to succeed at this level, you need an excellent team with specialists who understand every aspect of what you are trying to do, Kurth said.
LINK: https://blogs.nvidia.com/blog/2021/10/18/exascale-day-ai/...
See more stories from nvidia

Most recent headlines

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

18/03/2024

USC Basketball Star Juju Watkins on Fashion, Film, Friendship Bracelets, and More

Listeners turn to Spotify to connect with their favorites-from artists and album...

18/03/2024

Young professionals successfully complete vocational training at SGL's Meitingen site

Seven young professionals completed their vocational training at SGL Carbon in M...

18/03/2024

Vintage Allure

Released this past January, the music video for Ariana Grande's yes, and? brings a modern approach to vintage allure. The video was directed by Christian ...

18/03/2024

ST Engineering iDirect Unveils Intuition at SATELLITE 2024 Conference and Exhibition

Global satellite communications leader gives market a first look at its next-gen...

18/03/2024

Box to Box Films shares with MediaSilo

Box to Box Films Shares with MediaSilo Amy and Drive to Survive producer updates collaborators simply and securely Boston, MA, March 18, 2024 - Box to Box Fi...

18/03/2024

Telestream Introduces AI-Powered Tools for Rapid Content Delivery at NAB Show 2024

Telestream Introduces AI-Powered Tools for Rapid Content Delivery at NAB Show 20...

18/03/2024

Docufiction Film Bringing Down a Mountain Edited with DaVinci Resolve Studio

Docufiction Film Bringing Down a Mountain Edited with DaVinci Resolve Studio Brie Clayton March 18, 2024 0 Comments Blackmagic Design today announced ...

18/03/2024

FingerWorks Telestrators Releases Enhancements to Computer Vision Live Tracking Software at NAB 2024

FingerWorks Telestrators Releases Enhancements to Computer Vision Live Tracking ...

18/03/2024

DirecTV to Allow Subscribers to Opt Out of Local Stations

DirecTV announced a new feature over the weekend that will allow its subscribers to opt out of their local stations in return for a discount. Customers who ch...

18/03/2024

Logging and reviewing: Moving towards a sustainable workflow

Jane Sung, COO at Cinedeck, explains how broadcasters and content production companies can achieve the goal of moving towards creating a more sustainable, effic...

18/03/2024

Altice Media sold to French shipping tycoon for 1.55 billion

The deal includes BFM TV, one of the country's largest 24-hour news channels, as well as documentary channel RMC D couverte, and RMC Story By Jenny Priestl...

18/03/2024

Meet the CEO and founder

By TVBEurope Staff Published: March 18, 2024 Nick Franco tells TVBEurope how he went from being a master plasterer and refurbishing the ornate plasterwork ...

18/03/2024

Master the Avatar State: Glowing Eyes in Adobe After Effects

Master the Avatar State: Glowing Eyes in Adobe After Effects Levi Borland March 18, 2024 0 Comments In this step-by-step tutorial, learn how to recrea...

18/03/2024

Next Season of Doctor Who' on Disney Plus May 10

The next season of Doctor Who, with Ncuti Gatwa as the 15th Doctor, premieres on Disney Plus and around the world May 10. It is the first season to launch on Di...

18/03/2024

Screen Australia and VicScreen launch new Screen Careers initiative

18 03 2024 - Media release Screen Australia and VicScreen launch new Screen Careers initiative LTR Denise Eriksen, Esther Coleman Hawkins, Caroline Pitcher, K...

18/03/2024

CBC/WRAL Night Helps Bring in Over $26k for PBS NC

Capitol Broadcasting and WRAL-TV continued a decades-long tradition of supporting PBS North Carolina, our state's public television station, to good result ...

18/03/2024

Banglalink Gets Unified Licence to Deliver Superior Digital Services in Bangladesh

18 Mar 2024 Banglalink Gets Unified Licence to Deliver Superior Digital Service...

18/03/2024

Thuraya partners with Niflink to deliver telemedicine and eLearning to users across its network

Abu Dhabi, 18 March, 2024 : Abu Dhabi, 18 March 2024: Thuraya Telecommunication...

18/03/2024

Thuraya partners with Niflink to deliver telemedicine and eLearning to users across its ne...

Abu Dhabi, 18 March, 2024 : Abu Dhabi, 18 March 2024: Thuraya Telecommunication...

18/03/2024

Major League Soccer: IMG on Capturing Fan Rituals and Delivering Consistent Coverage

Major League Soccer: IMG on capturing fan rituals and delivering consistent cove...

18/03/2024

Smashing Padel: Inside Aurora's Innovative Production of the Inaugural Hexagon Cup

Smashing padel: Inside Aurora's innovative production of the inaugural Hexag...

18/03/2024

Airspeeder Teams Up With EMG for World's First Live Broadcast of Flying Car Series

Airspeeder teams up with EMG for world's first live broadcast of flying car ...

18/03/2024

Netflix Announces News About 26 Upcoming Nordic Titles - Including 12 Brand New Titles

Back to All News Netflix Announces News About 26 Upcoming Nordic Titles - Inclu...

18/03/2024

Final sprint in the AS4 market communication

Final Sprint in the AS4 Market Communication: All Arvato Systems Customers Are Ready to Go Customers for market communication AS4-ready Arvato Systems is now...

18/03/2024

Tonight on Uzalo: Nkunzi takes a drastic decision

Tonight on Uzalo: Nkunzi takes a drastic decisionDon't miss Monday, 18 March's riveting episode of South African soapie Uzalo on SABC 1 on DStv channel ...

18/03/2024

Thales to modernize Montreal Mtro blue Line,improving passengers' punctuality and train reliability

Facebook Twitter LinkedIn Following a call for tenders, the Soci t de tra...

18/03/2024

Streaming today: Vida the Vet' on Netflix - 18 March 2024

Streaming today: Vida the Vet' on Netflix - 18 March 2024Looking for something to watch tonight? Check out all the new streaming releases from all your fav...

18/03/2024

Skeem Saam': Is Tobias Maswahla Evelyn's son?

Skeem Saam': Is Tobias Maswahla Evelyn's son?Is actor Sicelo Buthelezi's character Tobias Maswahla related to Deputy Principal Evelyn Maswahla in S...

18/03/2024

Tonight on Generations: Khensani tries to mend his friendship with Sphe

Tonight on Generations: Khensani tries to mend his friendship with SpheDon't miss Monday, 18 March's riveting episode of South African soapie Generation...

18/03/2024

Question: Did George Lucas rip off Dune?

Question: Did George Lucas rip off Dune?Miles Phillips explores Dune's Legacy and its echo in Star Wars, claiming that the former is among the best science ...

18/03/2024

Tonight on Skeem Saam: Jacobeth kicks Bullet to the curb

Tonight on Skeem Saam: Jacobeth kicks Bullet to the curbDon't miss Monday, 16 March's riveting episode of South African soapie Skeem Saam on SABC 1 on D...

18/03/2024

Tonight on Muvhango: Matshidiso finds incriminating information on Nkele

Tonight on Muvhango: Matshidiso finds incriminating information on NkeleDon't miss Monday, 18 March's riveting episode of South African soapie Muvhango ...

18/03/2024

Tonight on Smoke and Mirrors: In a haze of alcohol, Sakhile knocks down Fanyana

Tonight on Smoke and Mirrors: In a haze of alcohol, Sakhile knocks down FanyanaDon't miss Monday, 18 March's riveting episode of South African soapie Sm...

18/03/2024

Tonight on Scandal: Jojo's bad PR costs him more than he can afford

Tonight on Scandal: Jojo's bad PR costs him more than he can affordDon't miss Monday, 18 March's riveting episode of South African soapie Scandal! o...

18/03/2024

Tonight on Champions: Lebo's family are tearing him apart

Tonight on Champions: Lebo's family are tearing him apartDon't miss Monday, 18 March's riveting episode of South African soapie Champions on Mzansi ...

18/03/2024

Tonight on Gqeberha: Msimelelo lays down the rules at the Tshisa Nyama

Tonight on Gqeberha: Msimelelo lays down the rules at the Tshisa NyamaDon't miss Monday, 18 March's riveting episode of South African soapie Gqeberha: T...

18/03/2024

Tonight on Umkhokha: Zisebenzele makes a bet with Khululiwe that Siphamandla will do it within a week

Tonight on Umkhokha: Zisebenzele makes a bet with Khululiwe that Siphamandla wil...

18/03/2024

Cyberani and Thales enter a strategic alliance to strengthen the Kingdom's cybersecurity

Facebook Twitter LinkedIn Mr. Saeed Al Saeed, CEO of Cyberani, and Mr. Pie...

18/03/2024

Thales to equip Cibao International Airport in Dominican Republic with new Air Traffic Control Radar System

Facebook Twitter LinkedIn Instituto Dominicano de Aviaci n Civil (IDAC) se...

17/03/2024

WATCH: Highlights from the 2024 Cape Town Carnival [video]

WATCH: Highlights from the 2024 Cape Town Carnival [video]The Mother City's biggest annual street parade returned to Green Point on Saturday with the Cape T...

17/03/2024

WATCH: Highlights from the 2024 Cape Town Carnival

WATCH: Highlights from the 2024 Cape Town CarnivalThe Mother City's biggest annual street parade returned to Green Point on Saturday with the Cape Town Carn...

17/03/2024

Young Papi leaves Big Brother Mzansi'

Young Papi leaves Big Brother Mzansi'Young Papi was the thirteenth housemate to get evicted from the Big Brother Mzansi' reality TV show on Sunday, 17...

17/03/2024

Smoke and Mirrors': Why Thandiswa might dump Caesar

Smoke and Mirrors': Why Thandiswa might dump Caesar Smoke and Mirrors' spoilers reveal that Caesar will propose marriage to Thandiswa. Will she stay wit...

16/03/2024

Josh Brolin Drama Outer Range' Returns To Prime Video May 16

Western drama Outer Range is back with season two on Prime Video May 16. Josh Brolin stars and executive produces. He also directs the season's penultimate ...

16/03/2024

Kristen Wiig Lined Up to Host SNL' for Fifth Time

Kristen Wiig hosts Saturday Night Live for the fifth time on April 6. Wiig stars in and executive produces Palm Royale, which premieres March 20 on Apple TV Plu...

16/03/2024

Magnite, Mediaocean Join To Make Buying CTV Campaigns Easier

Media buyers using Mediaocean's Prisma platform will be able to plan, execute and reconcile ad campaigns on connected TV directly from programmers who work ...

16/03/2024

Bitmovin, Yospace Combine To Insert Ads Into Live Streams

Streaming infrastructure company Bitmovin is teaming up with ad-insertion vendor Yospace to enable broadcasters to put commercials in live-streaming programming...

16/03/2024

Bumble Engages Peacock's The Traitors' To Promote Dating Deception Detector'

Bumble, the dating service, has tapped into Peacock's murder-mystery competi...

16/03/2024

Gerald Levin, Former Time Warner CEO, Has Died

Gerald Levin, former CEO of Time Warner, died March 13. He was 84 and had battled Parkinson's disease....