Sony Pixel Power calrec Sony

NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency

23/08/2024

A deep technology conference for processor and system architects from industry and academia has become a key forum for the trillion-dollar data center computing market.

At Hot Chips 2024 next week, senior NVIDIA engineers will present the latest advancements powering the NVIDIA Blackwell platform, plus research on liquid cooling for data centers and AI agents for chip design.

They'll share how:

NVIDIA Blackwell brings together multiple chips, systems and NVIDIA CUDA software to power the next generation of AI across use cases, industries and countries.

NVIDIA GB200 NVL72 - a multi-node, liquid-cooled, rack-scale solution that connects 72 Blackwell GPUs and 36 Grace CPUs - raises the bar for AI system design.

NVLink interconnect technology provides all-to-all GPU communication, enabling record high throughput and low-latency inference for generative AI.

The NVIDIA Quasar Quantization System pushes the limits of physics to accelerate AI computing.

NVIDIA researchers are building AI models that help build processors for AI.

An NVIDIA Blackwell talk, taking place Monday, Aug. 26, will also spotlight new architectural details and examples of generative AI models running on Blackwell silicon.

It's preceded by three tutorials on Sunday, Aug. 25, that will cover how hybrid liquid-cooling solutions can help data centers transition to more energy-efficient infrastructure and how AI models, including large language model (LLM)-powered agents, can help engineers design the next generation of processors.

Together, these presentations showcase the ways NVIDIA engineers are innovating across every area of data center computing and design to deliver unprecedented performance, efficiency and optimization.

Be Ready for Blackwell NVIDIA Blackwell is the ultimate full-stack computing challenge. It comprises multiple NVIDIA chips, including the Blackwell GPU, Grace CPU, BlueField data processing unit, ConnectX network interface card, NVLink Switch, Spectrum Ethernet switch and Quantum InfiniBand switch.

Ajay Tirumala and Raymond Wong, directors of architecture at NVIDIA, will provide a first look at the platform and explain how these technologies work together to deliver a new standard for AI and accelerated computing performance while advancing energy efficiency.

The multi-node NVIDIA GB200 NVL72 solution is a perfect example. LLM inference requires low-latency, high-throughput token generation. GB200 NVL72 acts as a unified system to deliver up to 30x faster inference for LLM workloads, unlocking the ability to run trillion-parameter models in real time.

Tirumala and Wong will also discuss how the NVIDIA Quasar Quantization System - which brings together algorithmic innovations, NVIDIA software libraries and tools, and Blackwell's second-generation Transformer Engine - supports high accuracy on low-precision models, highlighting examples using LLMs and visual generative AI.

Keeping Data Centers Cool The traditional hum of air-cooled data centers may become a relic of the past as researchers develop more efficient and sustainable solutions that use hybrid cooling, a combination of air and liquid cooling.

Liquid-cooling techniques move heat away from systems more efficiently than air, making it easier for computing systems to stay cool even while processing large workloads. The equipment for liquid cooling also takes up less space and consumes less power than air-cooling systems, allowing data centers to add more server racks - and therefore more compute power - in their facilities.

Ali Heydari, director of data center cooling and infrastructure at NVIDIA, will present several designs for hybrid-cooled data centers.

Some designs retrofit existing air-cooled data centers with liquid-cooling units, offering a quick and easy solution to add liquid-cooling capabilities to existing racks. Other designs require the installation of piping for direct-to-chip liquid cooling using cooling distribution units or by entirely submerging servers in immersion cooling tanks. Although these options demand a larger upfront investment, they lead to substantial savings in both energy consumption and operational costs.

Heydari will also share his team's work as part of COOLERCHIPS, a U.S. Department of Energy program to develop advanced data center cooling technologies. As part of the project, the team is using the NVIDIA Omniverse platform to create physics-informed digital twins that will help them model energy consumption and cooling efficiency to optimize their data center designs.

AI Agents Chip In for Processor Design Semiconductor design is a mammoth challenge at microscopic scale. Engineers developing cutting-edge processors work to fit as much computing power as they can onto a piece of silicon a few inches across, testing the limits of what's physically possible.

AI models are supporting their work by improving design quality and productivity, boosting the efficiency of manual processes and automating some time-consuming tasks. The models include prediction and optimization tools to help engineers rapidly analyze and improve designs, as well as LLMs that can assist engineers with answering questions, generating code, debugging design problems and more.

Mark Ren, director of design automation research at NVIDIA, will provide an overview of these models and their uses in a tutorial. In a second session, he'll focus on agent-based AI systems for chip design.

AI agents powered by LLMs can be directed to complete tasks autonomously, unlocking broad applications across industries. In microprocessor design, NVIDIA researchers are developing agent-based systems that can reason and take action using customized circuit design tools, interact with experienced designers, and learn from a database of human and agent experiences.

NVIDIA experts aren't just building this technology - t
LINK: https://blogs.nvidia.com/blog/hot-chips-2024/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

14/11/2026

Political Ads Spiked a Week Before Midterm Elections, Nielsen Says

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

14/11/2026

FCC Sends 2027 Upper C-Band Auction Plan Into Motion

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

14/11/2026

ZEISS Showcases Latest Cine Lenses at TorunCAMERIMAGE 202...

Newest Lenses, Horizon Anamorphic Seminar & Guided Lens Character Experience Highlight Creative Possibilities At the 2026 Toru CAMERIMAGE Film Festival, ZEISS...

14/11/2026

Sonnet Announces Black Friday Sale on Select Products

Sonnet Announces Black Friday Sale on Select Products Brie Clayton November 14, 2026 0 Comments WHAT: Sonnet Technologies is having a sale on a select...

14/11/2026

Berklee Alumni Shine at the 2026 Latin Grammy Awards

Berklee Alumni Shine at the 2026 Latin Grammy Awards This year's winners included songwriters, engineers, and performers who contributed to acclaimed reco...

13/11/2026

E1 Series Brings Its Remote-First Broadcast Model to Miami for Season Finale

The UIM E1 Series wraps its third season this week with the Bombay Sapphire E1 Miami GP, Nov. 11-14, on Biscayne Bay at the Miami Seaplane Base on Watson Island...

13/11/2026

SVG GameDay, Ep. 39: Carolina Hurricanes Christine Williams & Jason Danby - Celebrating a Stanley Cup in Raleigh

In-venue and creative video staffers at the professional and collegiate level ha...

13/11/2026

Benson Boone to Headline Entertainment at Discover NHL Winter Classic

Singer-songwriter Benson Boone will headline entertainment for the Discover NHL Winter Classic between the Utah Mammoth and Colorado Avalanche at Rice-Eccles St...

13/11/2026

Blackmagic Design Announces Ambisonic Microphone for Immersive Spatial Audio

Blackmagic Design has announced the Blackmagic Ambisonic Microphone, a 7th order ambisonic microphone array that captures spatial audio for immersive video prod...

13/11/2026

The Studio B&H and Riedel to Power SMPTE MTS Solutions Hub

SMPTE has announced that The Studio B&H and Riedel Communications will provide the video infrastructure and communications technology for the Solutions Hub at t...

13/11/2026

HPA Sets 2027 Tech Retreat Theme Around a Changing Industry

The Hollywood Professional Association (HPA) has announced the theme and program focus for the 2027 HPA Tech Retreat, which takes place Feb. 14-18, 2027, in La ...

13/11/2026

Football Manager 27 Touch Joins Apple Arcade, with Plants vs. Zombies, Prince of Persia Added Dec. 3

Football Manager 27 Touch is available on Apple Arcade starting today. The game ...

13/11/2026

MotoGP and ESPN Announce Two-Year Media Rights Agreement for U.S. and Latin America

MotoGP has announced a two-year media rights agreement with ESPN covering the Un...

13/11/2026

Apple Sports Adds UFC Ahead of UFC 334

Apple Sports, the free iPhone app, has added the Ultimate Fighting Championship (UFC) to its lineup of supported sports, in time for Saturday's UFC 334. The...

13/11/2026

NBA Names Fanatics Studios Multiyear Creative and Event Production Partner for NBA All-Star

The NBA and Fanatics Studios, the joint venture between Fanatics and entertainme...

13/11/2026

From ManningCast to McAfee to Star Wars: ESPN, Disney Pull Back the Curtain on Super Bowl LXI Plans

ESPN held its annual EDGE Innovation Conference last night and offered up an ove...

13/11/2026

Battle in the Bronx: YES Network Presents 2026 Cortaca Jug at Yankee Stadium

Regional sports network gives Ithaca College, SUNY Cortland students a platform to thrive One of the biggest games in Division III college football will be pla...

13/11/2026

HLabs reveal the CL089

Studer-inspired 500-series PWM compressor unveiled The HLabs range already includes a couple of Studer-inspired offerings in the form of the PRE169 and EQ16...

13/11/2026

Freedom of Choice White Paper

Download Now! To view the white paper, please enter the following details: -- First Name* First Name Company* Country* Please select your countryA...

13/11/2026

Cruz Schedules Confirmation Vote for FCC Nominee Thumann-Severs

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Yamaha Acquires Virtual Production Specialist Disguise

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

MyStation App Emulates TV Network' Marketplace

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Blue Lucy integrates with Comcast Technology Solutions Vi...

Blue Lucy, the workflow orchestration and integration platform for broadcasters, rights owners and localisation companies, today announced an integration with c...

13/11/2026

Krotos announces Black Friday offers on Studio Pro and Studio Max

Krotos announces Black Friday offers on Studio Pro and Studio Max Brie Clayton November 12, 2026 0 Comments First-year annual plans start at US$195.99...

13/11/2026

Blackmagic Design Announces Blackmagic Ambisonic Microphone

Blackmagic Design Announces Blackmagic Ambisonic Microphone Brie Clayton November 12, 2026 0 Comments New 7th order ambisonic microphone with 108 MEMS...

13/11/2026

Meet the Berklee Student Setting Planetary Motion to Music

Meet the Berklee Student Setting Planetary Motion to Music With his compositional platform SoniKosmos, Javier Roqueni aims to make the universe the ultimate i...

13/11/2026

Hub: Despite AI, More Viewers Still Rely on Word of Mouth and Trailers to Find New TV Shows

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

13/11/2026

Jack Smith Joins Madhive as Chief Product and Technology Officer

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Operative Names Brian Beirne as Senior VP, Commercial Growth

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Former FCC Chair Tom Wheeler to Advise AI Startup

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

IEEE Broadcast Technology Society Honors Dr. Yiyan Wu with the 2026 Jules Cohen Award

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

13/11/2026

Vizrt Acquires Chyron

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Samsung Ads to Offer 3 New Interactive Formats

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

HPA Retreat to Explore Changing Shape of Industry

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

The Studio B&H, Riedel to Equip SMPTE Media Tech Summit

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Tegna Promotes 3 Sales Executives to President and GM

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

13/11/2026

Amagi and Golden Times Media Technology to Bring Chinese...

Amagi, the media industry cloud company, today announced a partnership with Golden Times Media Technology (stock code 920021.BJ), a Beijing-based media and tech...

13/11/2026

CGI and Cedar Broadcast and Communications deploy advance...

CGI (TSX: GIB.A) (NYSE: GIB), one of the largest independent IT and business consulting services firms in the world, together with its Malaysian partner, Cedar ...

13/11/2026

The Studio BH and Riedel Communications Power the SMPTE...

SMPTE, the home for media professionals, technologists and engineers, today announced that The Studio B&H and Riedel Communications will provide the video infra...

13/11/2026

iWedia Brings Software-First DRAM Optimization to Android...

iWedia, a global leader in connected TV software solutions, will present its software-first approach to DRAM optimization at Android TV APAC Summit 2026 in Bang...

13/11/2026

Apple HomeView available today - UPDATE - Posted on 13 November 2026

Beginning today, November 13, Apple HomeView is available for purchase at Apple Store locations, on the Apple Store online, and in the Apple Store app in select...

13/11/2026

How AI Is Helping Care Teams Get Patients the Right Care, Sooner

From pediatric research to smart hospitals, AI is helping care teams spend less time on routine tasks and more time with patients. Health systems and startups...

12/11/2026

The Software-Defined Shift: A Discussion on the Technologies Reshaping Live Sports Production

Industry leaders examine how Dynamic Media Facility, Media eXchange Layer, and c...

12/11/2026

SVG Students to Watch: Addison Carnow, University of North Carolina

The junior Tar Heel is embracing the technical and creative challenges of live production while emerging as a leader and mentor in the control room...

12/11/2026

Gracenote Survey: 78% of Viewers 18-24 Want a Single Program Guide Across Streaming Services

Gracenote, Nielsen's content intelligence business, has released its fifth a...

12/11/2026

RTL Deutschland and NHL Expand Partnership, Bringing NHL Monday Night Hockey to Free-to-Air TV in Germany

RTL Deutschland will bring the NHL to free-to-air TV in Germany starting Nov. 30...

12/11/2026

Clear-Com Supports Global Student Broadcast On Air 2026 With Station-IC, Eclipse HX and FreeSpeak Cell

Clear-Com supported On Air 2026, a 24-hour student-led broadcast connecting 45 u...

12/11/2026

uniqFEED Opens Remote Operations Center in Madrid for LaLiga Virtual Advertising

uniqFEED has opened a Remote Operations Center (ROC) in Madrid, Spain. It is already operational, delivering virtual advertising for LaLiga matches. The ROC is ...