Sony Pixel Power calrec Sony

NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency

23/08/2024

A deep technology conference for processor and system architects from industry and academia has become a key forum for the trillion-dollar data center computing market.

At Hot Chips 2024 next week, senior NVIDIA engineers will present the latest advancements powering the NVIDIA Blackwell platform, plus research on liquid cooling for data centers and AI agents for chip design.

They'll share how:

NVIDIA Blackwell brings together multiple chips, systems and NVIDIA CUDA software to power the next generation of AI across use cases, industries and countries.

NVIDIA GB200 NVL72 - a multi-node, liquid-cooled, rack-scale solution that connects 72 Blackwell GPUs and 36 Grace CPUs - raises the bar for AI system design.

NVLink interconnect technology provides all-to-all GPU communication, enabling record high throughput and low-latency inference for generative AI.

The NVIDIA Quasar Quantization System pushes the limits of physics to accelerate AI computing.

NVIDIA researchers are building AI models that help build processors for AI.

An NVIDIA Blackwell talk, taking place Monday, Aug. 26, will also spotlight new architectural details and examples of generative AI models running on Blackwell silicon.

It's preceded by three tutorials on Sunday, Aug. 25, that will cover how hybrid liquid-cooling solutions can help data centers transition to more energy-efficient infrastructure and how AI models, including large language model (LLM)-powered agents, can help engineers design the next generation of processors.

Together, these presentations showcase the ways NVIDIA engineers are innovating across every area of data center computing and design to deliver unprecedented performance, efficiency and optimization.

Be Ready for Blackwell NVIDIA Blackwell is the ultimate full-stack computing challenge. It comprises multiple NVIDIA chips, including the Blackwell GPU, Grace CPU, BlueField data processing unit, ConnectX network interface card, NVLink Switch, Spectrum Ethernet switch and Quantum InfiniBand switch.

Ajay Tirumala and Raymond Wong, directors of architecture at NVIDIA, will provide a first look at the platform and explain how these technologies work together to deliver a new standard for AI and accelerated computing performance while advancing energy efficiency.

The multi-node NVIDIA GB200 NVL72 solution is a perfect example. LLM inference requires low-latency, high-throughput token generation. GB200 NVL72 acts as a unified system to deliver up to 30x faster inference for LLM workloads, unlocking the ability to run trillion-parameter models in real time.

Tirumala and Wong will also discuss how the NVIDIA Quasar Quantization System - which brings together algorithmic innovations, NVIDIA software libraries and tools, and Blackwell's second-generation Transformer Engine - supports high accuracy on low-precision models, highlighting examples using LLMs and visual generative AI.

Keeping Data Centers Cool The traditional hum of air-cooled data centers may become a relic of the past as researchers develop more efficient and sustainable solutions that use hybrid cooling, a combination of air and liquid cooling.

Liquid-cooling techniques move heat away from systems more efficiently than air, making it easier for computing systems to stay cool even while processing large workloads. The equipment for liquid cooling also takes up less space and consumes less power than air-cooling systems, allowing data centers to add more server racks - and therefore more compute power - in their facilities.

Ali Heydari, director of data center cooling and infrastructure at NVIDIA, will present several designs for hybrid-cooled data centers.

Some designs retrofit existing air-cooled data centers with liquid-cooling units, offering a quick and easy solution to add liquid-cooling capabilities to existing racks. Other designs require the installation of piping for direct-to-chip liquid cooling using cooling distribution units or by entirely submerging servers in immersion cooling tanks. Although these options demand a larger upfront investment, they lead to substantial savings in both energy consumption and operational costs.

Heydari will also share his team's work as part of COOLERCHIPS, a U.S. Department of Energy program to develop advanced data center cooling technologies. As part of the project, the team is using the NVIDIA Omniverse platform to create physics-informed digital twins that will help them model energy consumption and cooling efficiency to optimize their data center designs.

AI Agents Chip In for Processor Design Semiconductor design is a mammoth challenge at microscopic scale. Engineers developing cutting-edge processors work to fit as much computing power as they can onto a piece of silicon a few inches across, testing the limits of what's physically possible.

AI models are supporting their work by improving design quality and productivity, boosting the efficiency of manual processes and automating some time-consuming tasks. The models include prediction and optimization tools to help engineers rapidly analyze and improve designs, as well as LLMs that can assist engineers with answering questions, generating code, debugging design problems and more.

Mark Ren, director of design automation research at NVIDIA, will provide an overview of these models and their uses in a tutorial. In a second session, he'll focus on agent-based AI systems for chip design.

AI agents powered by LLMs can be directed to complete tasks autonomously, unlocking broad applications across industries. In microprocessor design, NVIDIA researchers are developing agent-based systems that can reason and take action using customized circuit design tools, interact with experienced designers, and learn from a database of human and agent experiences.

NVIDIA experts aren't just building this technology - t
LINK: https://blogs.nvidia.com/blog/hot-chips-2024/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

19/11/2026

Samba Combines Streaming, Linear TV Data

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Charting the Progress of Brazil TV 3.0 with VVC

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Skydance to Combine Warner Bros. Television Group and Paramount Television Studios

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

19/11/2026

Australia's Seven Selects RTS Comms for New Headquarters

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Richard Burki Expands the Possibilities of Immersive Audi...

As Founder and Creative Director of Future Phonic Studios, the Netherlands' first Dolby Atmos music studio, Richard Burki has spent more than a decade pushi...

19/11/2026

Boris FX Black Friday Sale - 25% Off Everything

Boris FX Black Friday Sale - 25% Off Everything Brie Clayton November 19, 2026 0 Comments Check out the Boris FX Black Friday sale on Monday, November...

19/11/2026

Virtual Production Finds Its Middle Ground with Blackmagic Design

Virtual Production Finds Its Middle Ground with Blackmagic Design Brie Clayton November 19, 2026 0 Comments How Neon Vision is using PYXIS 12K and Ult...

19/11/2026

FL Studio Announces Black Friday Discounts of Up to 50% Across Its Software Lineup

FL Studio Announces Black Friday Discounts of Up to 50% Across Its Software Line...

19/11/2026

TBS Drama Series Tagusari Brothers Uses DaVinci Resolve Studio

TBS Drama Series Tagusari Brothers Uses DaVinci Resolve Studio Brie Clayton November 19, 2026 0 Comments TBS ACT streamlines post production for broad...

19/11/2026

Beeble launches SwitchX 3.0 with dynamic environments and greater creative control

Beeble launches SwitchX 3.0 with dynamic environments and greater creative contr...

19/11/2026

NDI Releases Latest Version With Recording, Playback APIs

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Newsmax Asks Court to Block Foxs Acquisition of Roku

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

HPA to Honor The Odyssey Director Christopher Nolan with Judges Award for Creativity and Innovation

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

19/11/2026

Australian Professional Leagues Renews Partnership with B...

Five-year deployment has automated APL's media supply chain from fixture to archive, managing over 200,000 assets Blue Lucy, the workflow orchestration and...

19/11/2026

Riding the Australian wave through co-pros

Riding the Australian wave through co-pros 11 November 2026 L-R: The Surfer, We Bury the Dead Australian stories are captivating global audiences and attracti...

19/11/2026

Screen Australia and Australian Film Television and Radio School announce the First Nations Producer Fellowship Program 2027

Screen Australia and Australian Film Television and Radio School announce the Fi...

19/11/2026

AES Adds Dialogue Intelligibility to Loudness Website

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Rise Awards 2026 Celebrate Inspirational Women in Broadcast

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

BPS Trial at Dominion Energy Substation Proves Successful

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Wisycom and DPA Prove Essential for Demanding and Unpredi...

iStreamU LLC, a rapidly growing production and systems integration company founded by longtime Producer/Director Ivan Gonzalez, has standardized its audio workf...

19/11/2026

Seven Scripps Research scientists named to Clarivate's 2026 list of Highly Cited Researchers

LA JOLLA, CA-Clarivate, a global information and analytics company, named seven ...

19/11/2026

Season's Streamings and Savings: Black Friday Deals Come to GeForce NOW

GeForce NOW is kicking off Black Friday with more reasons to make time for gaming. Six-month memberships are back for a limited time. Save 30% on the first six-...

18/11/2026

William Kamau: Young Journalist of the Year finalist 2026

William Kamau is an investigative journalist from Kenya. He says witnessing the pain, displacement and killings' that followed the country's 2007 elect...

18/11/2026

Humberto Basilio: Young Journalist of the Year finalist 2026

Humberto Basilio is a freelance science, health and environmental journalist from Mexico. He says that working in one of the most dangerous countries in the wo...

18/11/2026

Aaron Atsahyel: Young Journalist of the Year finalist 2026

Aaron Atsahyel is a multimedia investigative journalist from Nigeria who draws on his own experiences as someone displaced by the Boko Haram insurgency to tell...

18/11/2026

SVG TranSPORT 2026: All Sessions Now Available To Watch on SVG PLAY

Held in New York City, the event explored the latest technologies and trends shaping the future of live-sports transmission and distribution...

18/11/2026

Samsung Takes the Gold at Your Olympic Games Dakar; Galaxy Phones Play Role in Coverage

The Youth Olympic Games Dakar 2026 opened in Senegal on October 31, giving young...

18/11/2026

Eventide launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

18/11/2026

IK Multimedia announce Tonex Parametric

Parametric Tone Models emulate control responses & interactions IK Multimedia have just announced the launch of Parametric Tone Models, a new technology tha...

18/11/2026

Shure launch the MV360 Spatial Audio Microphone

Captures immersive audio on phone, tablet or computer via USB-C Shure have just announced the launch of the MV360 Spatial Audio Microphone, a compact USB-C ...

18/11/2026

SBS announces key appointments across programming and commissioning

SBS announces key appointments across programming and commissioning 18 November, 2026 Media releases SBS has announced a series of appointments and role up...

18/11/2026

The National Film and Video Foundation (NFVF) Call for Festival and Market Hosting Funding Applications is Open

The National Film and Video Foundation (NFVF), an agency of the Department of Sp...

18/11/2026

DIRECTV teams with Gracenote to enhance the sports programming experiences that fans want

Strategic renewal builds on existing engagement, supports DIRECTV's objectiv...

18/11/2026

SMPTE Publishes Engineering Report on Content Authenticity

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Senate Commerce Committee Approves Thumann Severs for FCC Commissioner

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

wTVision Qualifies NEOiD PTZ Cameras for Virtual Sets, AR

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Spanish Media Group Deploys Lawo IP Audio Infrastructure

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Library of American Broadcasting Foundation Honors 2026 Giants of Broadcasting & Electronic Arts

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

18/11/2026

Monthly Subscription Streaming Service Prices Up Just 8% Since 2022

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Spectrum News Streamlines Workflow With Amagi

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Media Links Joins Panasonic Kairos Partner Program

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Signiant Acquires Burnlab's Ceivo AI-Driven Media Platform

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Democrats Urge Delay of Thumann Severs FCC Confirmation

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Hisong Unveils AirStudio Muse Audio Capture System

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Spectrum Reach Taps Debbie Presser to Lead Sales at AdLink New York

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Nationwide EAS Test Runs Without Apparent Hiccups

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

SMPTE Identifies Key Requirements for Content Provenance...

SMPTE, the home for media professionals, technologists and engineers, today announced the publication of an engineering report with the summarized results of an...

18/11/2026

Live from London, its Saturday night! Saturday Night Live UK returns 16 January on Sky and NOW

Wednesday 18 November 2026 Live from London, it's Saturday night! Saturday ...

18/11/2026

Sky Kids Investigates: Being a Boy

BAFTA award-winning series sees 16-year-old reporter explore topics including toxic digital influencers and disrespectful attitudes to girls in a groundbreaking...