Sony Pixel Power calrec Sony

NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency

23/08/2024

A deep technology conference for processor and system architects from industry and academia has become a key forum for the trillion-dollar data center computing market.

At Hot Chips 2024 next week, senior NVIDIA engineers will present the latest advancements powering the NVIDIA Blackwell platform, plus research on liquid cooling for data centers and AI agents for chip design.

They'll share how:

NVIDIA Blackwell brings together multiple chips, systems and NVIDIA CUDA software to power the next generation of AI across use cases, industries and countries.

NVIDIA GB200 NVL72 - a multi-node, liquid-cooled, rack-scale solution that connects 72 Blackwell GPUs and 36 Grace CPUs - raises the bar for AI system design.

NVLink interconnect technology provides all-to-all GPU communication, enabling record high throughput and low-latency inference for generative AI.

The NVIDIA Quasar Quantization System pushes the limits of physics to accelerate AI computing.

NVIDIA researchers are building AI models that help build processors for AI.

An NVIDIA Blackwell talk, taking place Monday, Aug. 26, will also spotlight new architectural details and examples of generative AI models running on Blackwell silicon.

It's preceded by three tutorials on Sunday, Aug. 25, that will cover how hybrid liquid-cooling solutions can help data centers transition to more energy-efficient infrastructure and how AI models, including large language model (LLM)-powered agents, can help engineers design the next generation of processors.

Together, these presentations showcase the ways NVIDIA engineers are innovating across every area of data center computing and design to deliver unprecedented performance, efficiency and optimization.

Be Ready for Blackwell NVIDIA Blackwell is the ultimate full-stack computing challenge. It comprises multiple NVIDIA chips, including the Blackwell GPU, Grace CPU, BlueField data processing unit, ConnectX network interface card, NVLink Switch, Spectrum Ethernet switch and Quantum InfiniBand switch.

Ajay Tirumala and Raymond Wong, directors of architecture at NVIDIA, will provide a first look at the platform and explain how these technologies work together to deliver a new standard for AI and accelerated computing performance while advancing energy efficiency.

The multi-node NVIDIA GB200 NVL72 solution is a perfect example. LLM inference requires low-latency, high-throughput token generation. GB200 NVL72 acts as a unified system to deliver up to 30x faster inference for LLM workloads, unlocking the ability to run trillion-parameter models in real time.

Tirumala and Wong will also discuss how the NVIDIA Quasar Quantization System - which brings together algorithmic innovations, NVIDIA software libraries and tools, and Blackwell's second-generation Transformer Engine - supports high accuracy on low-precision models, highlighting examples using LLMs and visual generative AI.

Keeping Data Centers Cool The traditional hum of air-cooled data centers may become a relic of the past as researchers develop more efficient and sustainable solutions that use hybrid cooling, a combination of air and liquid cooling.

Liquid-cooling techniques move heat away from systems more efficiently than air, making it easier for computing systems to stay cool even while processing large workloads. The equipment for liquid cooling also takes up less space and consumes less power than air-cooling systems, allowing data centers to add more server racks - and therefore more compute power - in their facilities.

Ali Heydari, director of data center cooling and infrastructure at NVIDIA, will present several designs for hybrid-cooled data centers.

Some designs retrofit existing air-cooled data centers with liquid-cooling units, offering a quick and easy solution to add liquid-cooling capabilities to existing racks. Other designs require the installation of piping for direct-to-chip liquid cooling using cooling distribution units or by entirely submerging servers in immersion cooling tanks. Although these options demand a larger upfront investment, they lead to substantial savings in both energy consumption and operational costs.

Heydari will also share his team's work as part of COOLERCHIPS, a U.S. Department of Energy program to develop advanced data center cooling technologies. As part of the project, the team is using the NVIDIA Omniverse platform to create physics-informed digital twins that will help them model energy consumption and cooling efficiency to optimize their data center designs.

AI Agents Chip In for Processor Design Semiconductor design is a mammoth challenge at microscopic scale. Engineers developing cutting-edge processors work to fit as much computing power as they can onto a piece of silicon a few inches across, testing the limits of what's physically possible.

AI models are supporting their work by improving design quality and productivity, boosting the efficiency of manual processes and automating some time-consuming tasks. The models include prediction and optimization tools to help engineers rapidly analyze and improve designs, as well as LLMs that can assist engineers with answering questions, generating code, debugging design problems and more.

Mark Ren, director of design automation research at NVIDIA, will provide an overview of these models and their uses in a tutorial. In a second session, he'll focus on agent-based AI systems for chip design.

AI agents powered by LLMs can be directed to complete tasks autonomously, unlocking broad applications across industries. In microprocessor design, NVIDIA researchers are developing agent-based systems that can reason and take action using customized circuit design tools, interact with experienced designers, and learn from a database of human and agent experiences.

NVIDIA experts aren't just building this technology - t
LINK: https://blogs.nvidia.com/blog/hot-chips-2024/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

15/04/2026

Maximum uptime for broadcasters: Rohde & Schwarz launches R&SBroadcastShield at NAB 2026

Maximum uptime for broadcasters: Rohde & Schwarz launches R&S BroadcastShield at...

15/04/2026

WIDOW: The Mission Software Defining Rotary Strike

Image courtesy of MD Helicopters...

15/04/2026

L3Harris Announces Billion Dollar Expansion to Boost Solid Rocket Motor Production in Orange County, Virginia

Virginia Gov. Abigail Spanberger, L3Harris VP Mark Farley, and state and local l...

15/04/2026

Advancing America's Space Defense: L3Harris Completes Critical Milestone on Way to Delivering GBOSS Capability to the Warfighter

U.S. Space Forces Ground-Based Optical Sensor System upgrade at the Maui Space S...

15/04/2026

Winter Olympics, Super Bowl Power NBCU-Versant to Gold Medal Performance in Nielsen's February Gauge Reports

NBCU-Versant notches 13.1% of TV viewing in February, its best since August 2024...

15/04/2026

Nielsen CMI shows New Zealand's over-65s are a growing, cashed-up and still-working audience brands can't ignore

New data reveals older Kiwis are financially resilient, loyal to local products,...

15/04/2026

aconnic launches ACCEED 4430 10 Gigabit system for high volume enterprise and business service aggregation

aconnic AG (ISIN: DE000A0LBKW6), Munich, announces the market launch of the ACCE...

15/04/2026

Autocue to Mark 2026 NAB Show Debut of its New PTZ Prompter

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

Locality Deploys Nielsen's Media Data Engine

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

Viant Announces Agreement to Acquire TVision

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

Evergent introduces Agentic Revenue Orchestration Platfor...

Evergent introduces its Agentic Revenue Orchestration Platform, transforming how subscription businesses across direct-to-consumer streaming, pay-TV, telecommun...

15/04/2026

CentralCast Delivers Breakthrough Efficiencies to Public...

Harmonic's XOS Media Processor Delivers Exceptional Video Quality to More than Half of U.S. Public Media Viewership Harmonic (NASDAQ: HLIT) today announce...

15/04/2026

DPA N Series Wireless System Unlocks Duplex Gap and Guard...

LONGMONT, COLORADO, APRIL 15, 2026 DPA Microphones N Series Digital Wireless System users in North America can now take full advantage of the system's exc...

15/04/2026

Cobalt Iron Launches Compass Tape Gateway Modernizing IBM...

Cobalt Iron, a leading provider of SaaS-based enterprise data protection, today announced the launch of Compass Tape Gateway (CTG), a transformative enhancemen...

15/04/2026

Disguise to Showcase Cutting-Edge Experience Tech for Sports, Broadcast and More at NAB 2026

Disguise to Showcase Cutting-Edge Experience Tech for Sports, Broadcast and More...

15/04/2026

Arooj Aftab Makes the Music She Wants to Hear

Arooj Aftab Makes the Music She Wants to Hear The singular artist explores the juxtaposition of grief and joy, dark and light, in her distinctive sound. Apri...

15/04/2026

Panasonic, NEP Partner on IP-Based Live Production

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

Encompass Digital Media Powers Global Cloud Transformatio...

Interra Systems, a provider of end-to-end quality assurance solutions for the digital media industry, is proud to announce its central role in the digital trans...

15/04/2026

Viaccess-Orca Powers MasOranges Multi-Brand TV Expansion...

VO Integrates Client-Side and Server-Side Ad Technologies with its Secure Video Player and Segmentation Tools, Leveraging Broadpeak's SSAI and BPK SmartLib ...

15/04/2026

TMT Insights Unveils AI at NAB 2026

TMT Insights, a leader in professional services and software development for the media and entertainment (M&E) industry, today announced the launch of TMT AI at...

15/04/2026

Encompass Digital Media and Oracle Cloud Infrastructure E...

Encompass Digital Media, a global leader in managed broadcast and cloud-based media services, today announced an expanded partnership with Oracle Cloud Infrastr...

15/04/2026

Middleman Software Debuts PhaseLock Technology and Expand...

Middleman Software, a leading provider of signaling and synchronization solutions for broadcast and streaming workflows, today announced it will unveil PhaseLoc...

15/04/2026

Deity Announces PR-4 Compact Field Recorder

Deity Microphones today announced the PR-4, a compact six-track field recorder featuring four inputs, 32-bit float recording, advanced routing, and a workflow-f...

15/04/2026

Blackmagic Design Announces Fairlight Live

Blackmagic Design Announces Fairlight Live Brie Clayton April 15, 2026 0 Comments Powerful software-based live audio mixer with support for SMPTE-2110...

15/04/2026

Haivision Launches Falkon X4 5G Transmitters

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

JB&A Spotlights Exhibitors Ahead of Pre-NAB 2026 Technology Event

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

Wave Central, EVS Announce SMPTE ST 2110 Interop Collaboration

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

Top Reason for Subscribing to Pay TV Is Live News and TV, Survey Finds

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

NAB Leadership Foundation Honors Outstanding Broadcasters

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

Wisycom Expands MPR60 With New Multichannel IFB Mode

Share Copy link Facebook X Linkedin Bluesky Email...

15/04/2026

Thomas Riedel Acquires Premium Manufacturer ARRI

Strategic Alignment With the Riedel Group for Innovation and Growth Thomas Riedel, founder and owner of Riedel Communications and the Riedel Group, has acqui...

15/04/2026

Iyuno Deploys SDVI Rally Platform to Accelerate and Scale...

SDVI, the leading platform provider for cloud-native media supply chains, today announced that the company's Rally platform has been deployed by Iyuno Media...

15/04/2026

Frequency Leads the Industry in Live Local News on FAST

Frequency, the engine behind many of the worlds leading streaming television channels, has become the platform of choice for leading U.S. broadcasters bringing ...

15/04/2026

Harmonic Introduces Breakthrough AI Orchestration Service...

New Service Simplifies Integration of AI Applications with Exceptional Reliability and Security SAN JOSE, Calif. April 14, 2026 Harmonic (NASDAQ: HLIT) t...

15/04/2026

VIDI and Media Links Bring Scalable IP Transport to Germa...

During the 2025 off-season, VIDI completed a major upgrade of the broadcast infrastructure across all 36 stadiums in Germany's 1st and 2nd Bundesliga. The p...

15/04/2026

Clear-Com Introduces Transformational Arcadia and Eclipse...

Clear-Com announced significant updates to its award-winning Arcadia Central Station as well as enhancements to the Eclipse HX Digital Matrix System now runn...

15/04/2026

Shotoku Introduces the World to Aura P2 PTZ Prompter Panner at NAB SHOW 2026

Shotoku Introduces the World to Aura P2 PTZ Prompter Panner at NAB SHOW 2026 Brie Clayton April 15, 2026 0 Comments New system removes PTZ pan restric...

15/04/2026

LiveU Announces Expanded Collaboration with Sony at NAB Show, Adding Direct File Workflow Integration

LiveU Announces Expanded Collaboration with Sony at NAB Show, Adding Direct File...

15/04/2026

This 24-Hour Performance Art Piece Needs Your Participation

This 24-Hour Performance Art Piece Needs Your Participation Keefer Glenshaws latest project is about collaborating with the Berklee community and beyond. Apr...

15/04/2026

The Countdown Has Begun! Netflix Drops Trailer and Release Date for Second Season of 'Roosters'

Back to All News The Countdown Has Begun! Netflix Drops Trailer and Release Dat...

15/04/2026

Celebrating BEEF' Season 2 and Storytelling That Connects Cultures

Back to All News Celebrating BEEF' Season 2 and Storytelling That Connects Cultures From left to right: Matthew Kim, Jinny Howe, Lee Sung Jin, Seoyeon Ja...

15/04/2026

Made in New Jersey: Dan Levy's New Comedy Big Mistakes' Makes a Big Impact

Back to All News Made in New Jersey: Dan Levy's New Comedy Big Mistakes...

15/04/2026

LinkedIn's 2026 Grad's Guide shows where opportunity is...

LinkedIn's 2026 Grad's Guide shows where opportunity is growing Published on Apr 15, 2026 Categories: Company News, Data and insights LinkedIn Corp...

15/04/2026

Moving Next Generation Audio Production Workflows into the Cloud

With new broadcast standards evolving all over the world and OTT streaming striving for the pole position in media consumption, both next-gen video and audio co...