Sony Pixel Power calrec Sony

NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency

23/08/2024

A deep technology conference for processor and system architects from industry and academia has become a key forum for the trillion-dollar data center computing market.

At Hot Chips 2024 next week, senior NVIDIA engineers will present the latest advancements powering the NVIDIA Blackwell platform, plus research on liquid cooling for data centers and AI agents for chip design.

They'll share how:

NVIDIA Blackwell brings together multiple chips, systems and NVIDIA CUDA software to power the next generation of AI across use cases, industries and countries.

NVIDIA GB200 NVL72 - a multi-node, liquid-cooled, rack-scale solution that connects 72 Blackwell GPUs and 36 Grace CPUs - raises the bar for AI system design.

NVLink interconnect technology provides all-to-all GPU communication, enabling record high throughput and low-latency inference for generative AI.

The NVIDIA Quasar Quantization System pushes the limits of physics to accelerate AI computing.

NVIDIA researchers are building AI models that help build processors for AI.

An NVIDIA Blackwell talk, taking place Monday, Aug. 26, will also spotlight new architectural details and examples of generative AI models running on Blackwell silicon.

It's preceded by three tutorials on Sunday, Aug. 25, that will cover how hybrid liquid-cooling solutions can help data centers transition to more energy-efficient infrastructure and how AI models, including large language model (LLM)-powered agents, can help engineers design the next generation of processors.

Together, these presentations showcase the ways NVIDIA engineers are innovating across every area of data center computing and design to deliver unprecedented performance, efficiency and optimization.

Be Ready for Blackwell NVIDIA Blackwell is the ultimate full-stack computing challenge. It comprises multiple NVIDIA chips, including the Blackwell GPU, Grace CPU, BlueField data processing unit, ConnectX network interface card, NVLink Switch, Spectrum Ethernet switch and Quantum InfiniBand switch.

Ajay Tirumala and Raymond Wong, directors of architecture at NVIDIA, will provide a first look at the platform and explain how these technologies work together to deliver a new standard for AI and accelerated computing performance while advancing energy efficiency.

The multi-node NVIDIA GB200 NVL72 solution is a perfect example. LLM inference requires low-latency, high-throughput token generation. GB200 NVL72 acts as a unified system to deliver up to 30x faster inference for LLM workloads, unlocking the ability to run trillion-parameter models in real time.

Tirumala and Wong will also discuss how the NVIDIA Quasar Quantization System - which brings together algorithmic innovations, NVIDIA software libraries and tools, and Blackwell's second-generation Transformer Engine - supports high accuracy on low-precision models, highlighting examples using LLMs and visual generative AI.

Keeping Data Centers Cool The traditional hum of air-cooled data centers may become a relic of the past as researchers develop more efficient and sustainable solutions that use hybrid cooling, a combination of air and liquid cooling.

Liquid-cooling techniques move heat away from systems more efficiently than air, making it easier for computing systems to stay cool even while processing large workloads. The equipment for liquid cooling also takes up less space and consumes less power than air-cooling systems, allowing data centers to add more server racks - and therefore more compute power - in their facilities.

Ali Heydari, director of data center cooling and infrastructure at NVIDIA, will present several designs for hybrid-cooled data centers.

Some designs retrofit existing air-cooled data centers with liquid-cooling units, offering a quick and easy solution to add liquid-cooling capabilities to existing racks. Other designs require the installation of piping for direct-to-chip liquid cooling using cooling distribution units or by entirely submerging servers in immersion cooling tanks. Although these options demand a larger upfront investment, they lead to substantial savings in both energy consumption and operational costs.

Heydari will also share his team's work as part of COOLERCHIPS, a U.S. Department of Energy program to develop advanced data center cooling technologies. As part of the project, the team is using the NVIDIA Omniverse platform to create physics-informed digital twins that will help them model energy consumption and cooling efficiency to optimize their data center designs.

AI Agents Chip In for Processor Design Semiconductor design is a mammoth challenge at microscopic scale. Engineers developing cutting-edge processors work to fit as much computing power as they can onto a piece of silicon a few inches across, testing the limits of what's physically possible.

AI models are supporting their work by improving design quality and productivity, boosting the efficiency of manual processes and automating some time-consuming tasks. The models include prediction and optimization tools to help engineers rapidly analyze and improve designs, as well as LLMs that can assist engineers with answering questions, generating code, debugging design problems and more.

Mark Ren, director of design automation research at NVIDIA, will provide an overview of these models and their uses in a tutorial. In a second session, he'll focus on agent-based AI systems for chip design.

AI agents powered by LLMs can be directed to complete tasks autonomously, unlocking broad applications across industries. In microprocessor design, NVIDIA researchers are developing agent-based systems that can reason and take action using customized circuit design tools, interact with experienced designers, and learn from a database of human and agent experiences.

NVIDIA experts aren't just building this technology - t
LINK: https://blogs.nvidia.com/blog/hot-chips-2024/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

22/07/2026

Clear-Com Delivers Integrated Communications for Fryderyk Awards Gala in Krakw

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

22/07/2026

IAB Tech Lab Updates Podcast Technical Measurement Guidelines

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

FCC Adopts Plan for C-Band Auction in July 2027

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

LTN surpasses 3000 satellite-to-IP migrations as FCC vote...

Proven managed IP solution helps broadcasters confidently navigate the future of broadcast distribution LTN announces it has completed successful satellite-to-...

22/07/2026

Chaos Releases V-Ray 7 Update 4 Connecting Real-Time Work...

Today, Chaos announced V-Ray 7, update 4, eliminating the need for asset conversions and tool switching, which slow down media and entertainment pipelines. Arti...

22/07/2026

An AI playground for the Project Indigo camera app

An AI playground for the Project Indigo camera app Marc Levoy July 22, 2026 0 Comments At left is the user interface of our Playground, running on an ...

22/07/2026

RTS Chooses Custom Consoles Desks and MediaWalls for Stud...

Custom Consoles announces the completion of a large technical furniture project for Radio T l vision Suisse (RTS) at the networks recently inaugurated productio...

22/07/2026

Graham Media's WDIV Opens Satellite Newsroom/Coffee Shop

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

FCC Approves License Transfer of WTVQ-DT to Scripps

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

Spectrum Reach Expands Operations in N.Y.

Share Copy link Facebook X Linkedin Bluesky Email...

22/07/2026

Miris spatial streaming platform adds support for glTF in...

Culver City, CA, July 21, 2026 3D streaming infrastructure provider Miris today announced glTF intake, including the binary .glb form, to its spatial streamin...

22/07/2026

Documentary Lo Invisible Captured with Blackmagic PYXIS 6K

Documentary Lo Invisible Captured with Blackmagic PYXIS 6K Brie Clayton July 21, 2026 0 Comments Camera's versatile design allowed filmmakers to c...

22/07/2026

AAF Bridge converts AAF and XML Timelines to Ableton Live - and back

AAF Bridge converts AAF and XML Timelines to Ableton Live - and back Jerome Gardier July 21, 2026 0 Comments A two-way converter for macOS and Windows...

22/07/2026

From Class to Concert: Explore a Student-Led Production of David Bowies Work Through Photos

From Class to Concert: Explore a Student-Led Production of David Bowies Work Thr...

22/07/2026

Audio at Parity: Comscore Launches Transcript-Level Targeting and Measurement with Spotify, SiriusXM, Triton Digital, Acast, and Libysn

Audio at Parity: Comscore Launches Transcript-Level Targeting and Measurement wi...

22/07/2026

Arvato Systems and Lobster Enter into a Partnership

Arvato Systems and Lobster Enter into a Partnership and Combine the Integration Platform and Managed Services Flexible integration solutions for cloud, hybrid...

22/07/2026

RT PUBLISHES 2025 ANNUAL REPORT

RT REPORTS NET SURPLUS OF 22.5 MILLION IN 2025...

22/07/2026

Documentary on film censorship in Ireland coming to RT

In the Opinion of the Censor airs Monday 27 July at 9.35pm on RT One and RT Player In the Opinion of the Censor looks at how films for theatrical release wer...

22/07/2026

NVIDIA Open Sources First GPU-Accelerated Medical Physics Simulation Framework

Before a healthcare robot can be useful in the real world, it has to learn how the physical world pushes back. Anatomy varies. Instruments bend, press, slip and...

21/07/2026

High Interest, limited resources: AI in Mongolia's newsrooms

New research involving a cross-section of Mongolias independent media landscape finds enthusiasm for AI as a tool to improve efficiency, sustainability and resi...

21/07/2026

FIFA World Cup 2026: The Firsts, Breakthroughs, and Lasting Legacies

With winners Spain having already paraded the World Cup trophy through Madrid in front of millions of fans and the dust now settling on an epic tournament of th...

21/07/2026

NHL Launches Centralized Production Operation for Regional Broadcasts; Four Teams Aboard To Start

In a time of disarray in regional sports broadcasting, the league will provide c...

21/07/2026

With Boland Monitors, NEPs PGA TOUR Unit Ready for Future

When NEP designed one of its largest recurring mobile production unit fleets for PGA TOUR coverage, the leading media services provider faced a familiar challe...

21/07/2026

elysia Channex Studio now available

High-end analogue channel strip boasts plug-in recall Originally revealed as a prototype back at NAMM 2024, the Channex Studio channel strip represented a b...

21/07/2026

Musik Hack announce HyFi mastering platform

Relies on same DSP as plug-in range Musik Hack's line-up has been influenced heavily by founder Stan Greene's work as a mixing engineer, and their M...

21/07/2026

Dirty Boy Jr. Series from Warm Audio

Official collaboration with boutique builder Dirty Boy Pedals Warm Audio have just announced the launch of a new guitar pedal range created in collaboration...

21/07/2026

SBS scores biggest ever FIFA World Cup Reach as Spain triumph in the final

SBS scores biggest ever FIFA World Cup Reach as Spain triumph in the final 21 July, 2026 Media releases Spain v Argentina attracted a Total TV reach of al...

21/07/2026

Rohde & Schwarz showcases broad range of EMC test solutions at EMC+SIPI 2026 in Dallas, Texas

Rohde & Schwarz showcases broad range of EMC test solutions at EMC SIPI 2026 in ...

21/07/2026

TVP Claims Top Spot as the World Cup and the Opole Music Festival Drive June Viewership in Poland

Warner Bros. Discovery's unbroken lead is interrupted as sports and live mus...

21/07/2026

Savannah Bananas Tap Calrec to Expand Banana Ball TV Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

Where Growth Takes Root Viaccess-Orca Showcases the Found...

Across the TV and streaming ecosystem, industry players face mounting pressure to do more with less. They must simplify operations, protect premium content and ...

21/07/2026

Tuxera breaks performance ceilings and brings SMB/NFS mul...

Tuxera, a leading prover of quality-assured file systems and networking technologies, is bringing its latest advances in connectivity performance to the media w...

21/07/2026

COW Jobs: Apple Motion Expert for Custom FCP Rigged Graphics Package

COW Jobs: Apple Motion Expert for Custom FCP Rigged Graphics Package Brie Clayton July 21, 2026 0 Comments HIRING: Apple Motion Expert for Custom FCP ...

21/07/2026

Cinegy directly addresses the real issues of software-def...

Cinegy GmbH, the premier provider of software-defined television technology, will use its presence at IBC2026 (stand 7.A01, Amsterdam RAI, 11 14 September) to...

21/07/2026

Calrec brings leading audio solutions and long term busin...

Calrec will be located in Hall 8, on Stand C47 Beyond bigger For years, broadcast facilities were built around one assumption: provision for the biggest pro...

21/07/2026

Pebble takes the next step towards the future of media de...

Pebble, the leading automation, content management and integrated channel specialist, will discuss its future-facing developments for the new generation of medi...

21/07/2026

nxtedition Brings Production, AI and Automation Together...

nxtedition returns to IBC2026 with its consolidated production platform, showing how scripting, editing, graphics, AI-assisted tools and automation can work wit...

21/07/2026

Big Blue Marble brings C2PA Content Credentials to Cloud...

C2PA content signing helps broadcasters, public institutions, and publishers give audiences a verifiable record of where their video content came from and how i...

21/07/2026

HDHomeRun Enables Operation During Internet Outages

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

Calif. Federal Judge Pauses Paramount-WBD Merger

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

AWARN Rebuts Weigel Claims of 3.0 EAS Problems

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

FCC Announces Tentative Agenda for August Open Meeting

Share Copy link Facebook X Linkedin Bluesky Email...

21/07/2026

VIDA Introduces QC Manager for Collaborative Quality Cont...

New capability centralizes collaboration, feedback, security and status tracking within VIDA, providing a structured, auditable approach to master quality contr...

21/07/2026

Lightcraft Launches Exclusive Spark Story Beta for Filmmakers and Creators at SIGGRAPH 2026

Lightcraft Launches Exclusive Spark Story Beta for Filmmakers and Creators at SI...

21/07/2026

Indie Road Movie Where in the Hell Shot with Pocket Cinema Camera 4K

Indie Road Movie Where in the Hell Shot with Pocket Cinema Camera 4K Brie Clayton July 20, 2026 0 Comments Colorist blends vintage film looks to shape...