Sony Pixel Power calrec Sony

Sustainable Strides: How AI and Accelerated Computing Are Driving Energy Efficiency

22/07/2024

AI and accelerated computing - twin engines NVIDIA continuously improves - are delivering energy efficiency for many industries.

It's progress the wider community is starting to acknowledge.

Even if the predictions that data centers will soon account for 4% of global energy consumption become a reality, AI is having a major impact on reducing the remaining 96% of energy consumption, said a report from Lisbon Council Research, a nonprofit formed in 2003 that studies economic and social issues.

The article from the Brussels-based research group is among a handful of big-picture AI policy studies starting to emerge. It uses Italy's Leonardo supercomputer, accelerated with nearly 14,000 NVIDIA GPUs, as an example of a system advancing work in fields from automobile design and drug discovery to weather forecasting.

Energy-efficiency gains over time for the most efficient supercomputer on the TOP500 list. Source: TOP500.org Why Accelerated Computing Is Sustainable Computing Accelerated computing uses the parallel processing of NVIDIA GPUs to do more work in less time. As a result, it consumes less energy than general-purpose servers that employ CPUs built to handle one task at a time.

That's why accelerated computing is sustainable computing.

Accelerated systems use parallel processing on GPUs to do more work in less time, consuming less energy than CPUs. The gains are even greater when accelerated systems apply AI, an inherently parallel form of computing that's the most transformative technology of our time.

When it comes to frontier applications like machine learning or deep learning, the performance of GPUs is an order of magnitude better than that of CPUs, the report said.

By transitioning from CPU-only operations to GPU-accelerated systems, HPC and AI workloads can save over 40 terawatt-hours of energy annually, equivalent to the electricity needs of nearly 5 million U.S. homes.

NVIDIA offers a combination of GPUs, CPUs, and DPUs tailored to maximize energy efficiency with accelerated computing. User Experiences With Accelerated AI Users worldwide are documenting energy-efficiency gains with AI and accelerated computing.

In financial services, Murex - a Paris-based company with a trading and risk-management platform used daily by more than 60,000 people - tested the NVIDIA Grace Hopper Superchip. On its workloads, the CPU-GPU combo delivered a 4x reduction in energy consumption and a 7x reduction in time to completion compared with CPU-only systems (see chart below).

On risk calculations, Grace is not only the fastest processor, but also far more power-efficient, making green IT a reality in the trading world, said Pierre Spatz, head of quantitative research at Murex.

In manufacturing, Taiwan-based Wistron built a digital copy of a room where NVIDIA DGX systems undergo thermal stress tests to improve operations at the site. It used NVIDIA Omniverse, a platform for industrial digitization, with a surrogate model, a version of AI that emulates simulations.

The digital twin, linked to thousands of networked sensors, enabled Wistron to increase the facility's overall energy efficiency by up to 10%. That amounts to reducing electricity consumption by 120,000 kWh per year and carbon emissions by a whopping 60,000 kilograms.

Up to 80% Fewer Carbon Emissions The RAPIDS Accelerator for Apache Spark can reduce the carbon footprint for data analytics, a widely used form of machine learning, by as much as 80% while delivering 5x average speedups and 4x reductions in computing costs, according to a recent benchmark.

Thousands of companies - about 80% of the Fortune 500 - use Apache Spark to analyze their growing mountains of data. Companies using NVIDIA's Spark accelerator include Adobe, AT&T and the U.S. Internal Revenue Service.

In healthcare, Insilico Medicine discovered and put into phase 2 clinical trials a drug candidate for a relatively rare respiratory disease, thanks to its NVIDIA-powered AI platform.

Using traditional methods, the work would have cost more than $400 million and taken up to six years. But with generative AI, Insilico hit the milestone for one-tenth of the cost in one-third of the time.

This is a significant milestone not only for us, but for everyone in the field of AI-accelerated drug discovery, said Alex Zhavoronkov, CEO of Insilico Medicine.

This is just a sampler of results that users of accelerated computing and AI are pursuing at companies such as Amgen, BMW, Foxconn, PayPal and many more.

Speeding Science With Accelerated AI In basic research, the National Energy Research Scientific Computing Center (NERSC), the U.S. Department of Energy's lead facility for open science, measured results on a server with four NVIDIA A100 Tensor Core GPUs compared with dual-socket x86 CPU servers across four of its key high-performance computing and AI applications.

Researchers found that the apps, when accelerated with the NVIDIA A100 GPUs, saw energy efficiency rise 5x on average (see below). One application, for weather forecasting, logged gains of nearly 10x.

Scientists and researchers worldwide depend on AI and accelerated computing to achieve high performance and efficiency.

In a recent ranking of the world's most energy-efficient supercomputers, known as the Green500, NVIDIA-powered systems swept the top six spots, and 40 of the top 50.

Underestimated Energy Savings The many gains across industries and science are sometimes overlooked in forecasts that extrapolate only the energy consumption of training the largest AI models. That misses the benefits from most of an AI model's life when it's consuming relatively little energy, delivering the kinds of efficiencies users described above.

In an analysis citing dozens of sources, a recent study debunked as misleading and inflated projections based on training mo
LINK: https://blogs.nvidia.com/blog/accelerated-ai-energy-efficiency/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

07/04/2026

NAB 2026: Ikegami USA To Launch Two New Viewfinders, Refine UHD Cameras

Ikegami USA will launch a refinement to the UHK-X700 and UHK-X750 3-CMOS -in. UHD cameras in the UNICAM XE series plus two new 7-in. viewfinders at NAB 2026 in...

07/04/2026

NAB 2026: NAB Leadership Foundation to Host Technology Students Career Mixer

The NAB Leadership Foundation and NAB PILOT will host a career mixer for technology students at NAB Show 2026 on April 18, 5-6:30 p.m., North Hall, Room N225/22...

07/04/2026

Survey: AVoIP Adoption Accelerating, With Interoperability and Security as Key Drivers

Audinate Group Limited and Futuresource Consulting have published results from a...

07/04/2026

NAB 2026: Eluvio Announces Commercial Availability of Content Fabric Bucharest Release

Eluvio has announced the commercial availability of its Content Fabric Bucharest...

07/04/2026

NAB 2026: Eluvio Introduces Inline AI Video Intelligence and Updated EVIE

Eluvio has unveiled a new architecture for video AI and an updated Eluvio Video Intelligence Editor (EVIE) ahead of NAB Show 2026. Eluvio AI runs analysis and i...

07/04/2026

Professional Fighters League Partners With Sky New Zealand for Exclusive Broadcast Rights

The Professional Fighters League (PFL) has announced a deal with Sky New Zealand...

07/04/2026

NBA, Enjoy Basketball' To Produce Live Game Altcast, Enjoy the NBA Trivia Show as Part of New Multi-Platform Collab

The NBA and Enjoy Basketball, the digital media company co-founded by YouTube cr...

07/04/2026

Beyond Golf: PGA of America, Ko-Mar Productions Offer Clients a Customizable Production Studio

The 4,000-sq.-ft. space in Frisco, TX, has produced live and packaged programmin...

07/04/2026

A New POV: RefCam's Rise in the Bundesliga Signals a Potential New Era for Soccer Broadcasts

What began as a referee training tool is evolving into a powerful production ass...

07/04/2026

NAB 2026: Manifold Technologies to Join NEP Platform as Deployable Application

Manifold Technologies will announce at NAB Show 2026 (Booth C.1808) that its manifold CLOUD platform will be available as a deployable application within NEP Pl...

07/04/2026

Shaquille O'Neal and TNT Sports to Launch DUNKMAN Professional Dunk League in Summer 2026

Shaquille O'Neal, Authentic Brands Group, and TNT Sports, in partnership wit...

07/04/2026

NAB 2026: Telos Alliance Unveils Omnia XII Audio Processor

Telos Alliance will debut the Omnia XII, a new FM/HD/DAB audio processor, at NAB Show 2026 in Las Vegas. Built on a 2RU hardware platform, Omnia XII features a...

07/04/2026

NAB 2026: AWS to Showcase AI and Cloud Media Technologies

Amazon Web Services (AWS) will exhibit at NAB Show 2026 (April 18-22, Las Vegas Convention Center, Booth W1701), with demonstrations, speaking sessions, and int...

07/04/2026

NAB 2026: Synamedia to Demonstrate AI by Quortex

Synamedia will demonstrate AI by Quortex at NAB Show 2026, a framework that applies AI capabilities to video workflows on demand rather than continuously. The s...

07/04/2026

NAB 2026: TVNewsCheck Announces 2026 Women in Technology Award Honorees

TVNewsCheck will present its 15th annual Women in Technology Awards on Tuesday, April 21, at 5 p.m. PT at NAB Show, in the Media and Entertainment Theater (W146...

07/04/2026

NAB 2026: Akta to Showcase AI Video Platform

Akta will demonstrate its AI video platform at NAB Show 2026, highlighting new capabilities in media processing and vertical video formatting alongside its exis...

07/04/2026

ESPN Expands to Disney+ in Europe and Select Asia-Pacific Markets

ESPN and Disney have announced the launch of ESPN on Disney in Europe and select Asia-Pacific markets, bringing the offering to 53 countries and territories a...

07/04/2026

Announcing the 2026 Sundance Institute Native Lab Fellows

LOS ANGELES, CA, April 7, 2026 - The nonprofit Sundance Institute announced today the fellows selected for the 2026 Native Lab, the signature initiative of the ...

07/04/2026

Prompted Playlist Levels Up to Include Podcasts, Helping You Explore More Interests and Curiosities

Starting today, Prompted Playlist is expanding beyond music to now include podca...

07/04/2026

VSL release Synchron Harpsichord (Blanchet)

Launched alongside piano promotion The latest instalment in VSL's Synchron Series line-up captures the sound of a faithful copy of a Fran ois tienne Bl...

07/04/2026

Roland announce SPD-SX Pro Version 2.0

Flagship sampling pad gets an update Roland's flagship sampling pad has just received a major update that kits it out with an array of new features and ...

07/04/2026

Sound Devices unveil the Astral Mini Plus

Popular compact wireless system upgraded Sound Devices have recently introduced a new and improved version of their compact wireless transmitter bodypacks, ...

07/04/2026

YEP November 2025 Newsletter

The November 2025 YEP Newsletter highlights a recent YEP Coffee Chat, offering members the chance to connect with industry professionals in an informal setting ...

07/04/2026

YEP December 2025 Newsletter

The December 2025 YEP Newsletter includes a Spotlight on Emily Vail, showcasing her career journey and work in the industry, alongside Mentorship Reflections by...

07/04/2026

US Space Force Selects L3Harris to Strengthen America's Defense with Advanced Space Surveillance

Ground-Based Electro-Optical Deep Space Surveillance (GEODSS) telescope operated...

07/04/2026

Haivision Unveils Makito ONE Live Video Contribution Platform

Share Copy link Facebook X Linkedin Bluesky Email...

07/04/2026

Neutrik To Unveil TRUE1 Data Connector Series At 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

07/04/2026

Chris Welcker Deployed Full DPA Arsenal to Record Live Mu...

Catgut Sound Owner and Production Sound Mixer Chris Welcker, CAS, has built a career at the intersection of music and film. A former musician and composer, Welc...

07/04/2026

SDVI Launches Next Generation Rally Platform to Give Medi...

SDVI Corporation today announced the next generation of its Rally media supply chain management platform, introducing a redesigned orchestration engine that rep...

07/04/2026

Avid to Debut Avid Content Core on AWS at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

07/04/2026

Frequency Launches Smarter Ways to Operate Streaming Chan...

Frequency, the engine behind many of the world's leading streaming television channels, at NAB 2026 will be launching new Studio services to help content ow...

07/04/2026

Ikegami to Introduce Expanded Range of Broadcast Producti...

Ikegami USA has chosen NAB 2026 in Las Vegas as the launch platform for new additions to its range of broadcast-quality television production equipment. These w...

07/04/2026

Kiloview Advancing Broadcast IP Workflows with a Smarter...

April 19, 2026, Las Vegas Kiloview, an innovative provider of AV-over-IP technologies, will showcase its latest broadcast IP solutions at NAB 2026, presenting...

07/04/2026

Bitmovin Adds Support for SGAI in its Playback Products t...

Bitmovin has announced support for Server-Guided Ad Insertion (SGAI) across its playback products using HLS interstitials, enabling more advanced ad-supported s...

07/04/2026

Synamedia unveils AI by Quortex - a just-in-time AI-plugi...

Synamedia is unveiling AI by Quortex at The NAB show, a just-in-time AI plugin framework that applies intelligence only when needed across video processing, dis...

07/04/2026

Cuez Brings Four New Innovations to NAB 2026 From Story-C...

Cuez will showcase four additions to its cloud-based newsroom, rundown and automation platform at NAB Show 2026 (April 18 22, Las Vegas, Booth N1867): Cuez ...

07/04/2026

Barix Extends Transport Options for Multi-Engine IP Encoder

Barix Extends Transport Options for Multi-Engine IP Encoder Brie Clayton April 7, 2026 0 Comments New for NAB, Barix adds SRT and RIST support to Mult...

07/04/2026

Elite Media Technologies Selects Interra Systems' BATON File-Based QC Solution

Elite Media Technologies Selects Interra Systems' BATON File-Based QC Soluti...

07/04/2026

Tightrope Media Systems to Debut Cablecast LiveBridge for Simultaneous Streaming at NAB 2026

Tightrope Media Systems to Debut Cablecast LiveBridge for Simultaneous Streaming...

07/04/2026

Cuez Brings Four New Innovations to NAB 2026: From Story-Centric Newsroom to Open AI Agent Framework

Cuez Brings Four New Innovations to NAB 2026: From Story-Centric Newsroom to Ope...

07/04/2026

ASG Names Andrea Cummis VP of Systems Engineering

Share Copy link Facebook X Linkedin Bluesky Email...

07/04/2026

KTVJ Completes Major Signal Upgrade

Share Copy link Facebook X Linkedin Bluesky Email...

07/04/2026

Hearst's WDSU to Air Million Dollar Rodeo Competition

Share Copy link Facebook X Linkedin Bluesky Email...

07/04/2026

Grass Valley Launches Future Playmakers Program

Share Copy link Facebook X Linkedin Bluesky Email...

07/04/2026

Saranyu Technologies Launches MATCH - Multi-View Sports S...

Designed for synchronized multi-stream playback, low-latency delivery, and real-time analytics, MATCH introduces a unified viewing experience for sports broadca...