Sony Pixel Power calrec Sony

NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency

23/08/2024

A deep technology conference for processor and system architects from industry and academia has become a key forum for the trillion-dollar data center computing market.

At Hot Chips 2024 next week, senior NVIDIA engineers will present the latest advancements powering the NVIDIA Blackwell platform, plus research on liquid cooling for data centers and AI agents for chip design.

They'll share how:

NVIDIA Blackwell brings together multiple chips, systems and NVIDIA CUDA software to power the next generation of AI across use cases, industries and countries.

NVIDIA GB200 NVL72 - a multi-node, liquid-cooled, rack-scale solution that connects 72 Blackwell GPUs and 36 Grace CPUs - raises the bar for AI system design.

NVLink interconnect technology provides all-to-all GPU communication, enabling record high throughput and low-latency inference for generative AI.

The NVIDIA Quasar Quantization System pushes the limits of physics to accelerate AI computing.

NVIDIA researchers are building AI models that help build processors for AI.

An NVIDIA Blackwell talk, taking place Monday, Aug. 26, will also spotlight new architectural details and examples of generative AI models running on Blackwell silicon.

It's preceded by three tutorials on Sunday, Aug. 25, that will cover how hybrid liquid-cooling solutions can help data centers transition to more energy-efficient infrastructure and how AI models, including large language model (LLM)-powered agents, can help engineers design the next generation of processors.

Together, these presentations showcase the ways NVIDIA engineers are innovating across every area of data center computing and design to deliver unprecedented performance, efficiency and optimization.

Be Ready for Blackwell NVIDIA Blackwell is the ultimate full-stack computing challenge. It comprises multiple NVIDIA chips, including the Blackwell GPU, Grace CPU, BlueField data processing unit, ConnectX network interface card, NVLink Switch, Spectrum Ethernet switch and Quantum InfiniBand switch.

Ajay Tirumala and Raymond Wong, directors of architecture at NVIDIA, will provide a first look at the platform and explain how these technologies work together to deliver a new standard for AI and accelerated computing performance while advancing energy efficiency.

The multi-node NVIDIA GB200 NVL72 solution is a perfect example. LLM inference requires low-latency, high-throughput token generation. GB200 NVL72 acts as a unified system to deliver up to 30x faster inference for LLM workloads, unlocking the ability to run trillion-parameter models in real time.

Tirumala and Wong will also discuss how the NVIDIA Quasar Quantization System - which brings together algorithmic innovations, NVIDIA software libraries and tools, and Blackwell's second-generation Transformer Engine - supports high accuracy on low-precision models, highlighting examples using LLMs and visual generative AI.

Keeping Data Centers Cool The traditional hum of air-cooled data centers may become a relic of the past as researchers develop more efficient and sustainable solutions that use hybrid cooling, a combination of air and liquid cooling.

Liquid-cooling techniques move heat away from systems more efficiently than air, making it easier for computing systems to stay cool even while processing large workloads. The equipment for liquid cooling also takes up less space and consumes less power than air-cooling systems, allowing data centers to add more server racks - and therefore more compute power - in their facilities.

Ali Heydari, director of data center cooling and infrastructure at NVIDIA, will present several designs for hybrid-cooled data centers.

Some designs retrofit existing air-cooled data centers with liquid-cooling units, offering a quick and easy solution to add liquid-cooling capabilities to existing racks. Other designs require the installation of piping for direct-to-chip liquid cooling using cooling distribution units or by entirely submerging servers in immersion cooling tanks. Although these options demand a larger upfront investment, they lead to substantial savings in both energy consumption and operational costs.

Heydari will also share his team's work as part of COOLERCHIPS, a U.S. Department of Energy program to develop advanced data center cooling technologies. As part of the project, the team is using the NVIDIA Omniverse platform to create physics-informed digital twins that will help them model energy consumption and cooling efficiency to optimize their data center designs.

AI Agents Chip In for Processor Design Semiconductor design is a mammoth challenge at microscopic scale. Engineers developing cutting-edge processors work to fit as much computing power as they can onto a piece of silicon a few inches across, testing the limits of what's physically possible.

AI models are supporting their work by improving design quality and productivity, boosting the efficiency of manual processes and automating some time-consuming tasks. The models include prediction and optimization tools to help engineers rapidly analyze and improve designs, as well as LLMs that can assist engineers with answering questions, generating code, debugging design problems and more.

Mark Ren, director of design automation research at NVIDIA, will provide an overview of these models and their uses in a tutorial. In a second session, he'll focus on agent-based AI systems for chip design.

AI agents powered by LLMs can be directed to complete tasks autonomously, unlocking broad applications across industries. In microprocessor design, NVIDIA researchers are developing agent-based systems that can reason and take action using customized circuit design tools, interact with experienced designers, and learn from a database of human and agent experiences.

NVIDIA experts aren't just building this technology - t
LINK: https://blogs.nvidia.com/blog/hot-chips-2024/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

17/11/2026

Signiant Acquires Media Intelligence Technology

Signiant has acquired the media intelligence technology, Ceivo, developed by Burnlab with founder Aaron Sloman joining the company as Vice President, Product Ma...

17/11/2026

Broadcasters to Conduct EAS Test Today

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Microsoft Taps Haivision Contribution, Video Transport Solutions for Live Events

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

NAB Promotes Broadcast Positioning System Amid Tech Outages

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Colorfront's Color Management Added to RED Camera Feeds

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Berklees 2027 Alumni Grammy Nominees: See the Full List

Berklees 2027 Alumni Grammy Nominees: See the Full List From pop and R&B to jazz, musical theater, and video game scores, Berklee talent is represented across...

17/11/2026

Sinclair's Bill Fanshawe Sets Retirement

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

WCVB Boston Names Michael Murgia Director of Engineering

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Two Scripps Research faculty named inaugural recipients of the Schultz Innovative Investigator Award

LA JOLLA, CA-Two Scripps Research faculty, Assistant Professor Christian Diercks...

17/11/2026

Ian Buck Kicks Off NVIDIA's Week at SC26 as Science Enters the Age of Agents

NVIDIA's Ian Buck kicked off the company's week at SC26 in Chicago on Monday with new tools for AI agents, software that can plan experiments, run code ...

16/11/2026

ESPN Edge Partners Chart a Future Built on Data, AI and a New Generation of Fans

The ESPN Edge Innovation Conference once again gave key ESPN technology partners as a chance to take to the stage and discuss the future of sports fan experienc...

16/11/2026

IMGs Ashley Shaner: How Micro-Dramas Can Build Sports Media Audiences and Why Content Creators Matter

As rights holders rethink who tells their stories and where, IMG is preparing th...

16/11/2026

Heard' at SVG Live!: Audio Needs To Make More Noise

From the sidelines, sonic savants advocate for greater emphasis on sound as sports and entertainment increasingly merge SVG Live!, a one-day event on Nov. 10 i...

16/11/2026

Yamaha To Acquire Disguise, Expanding Into Live Sports, Venue Production, and Immersive Entertainment

Deal combines Yamaha's audio technology with Disguise's visual-productio...

16/11/2026

New plug-in suite from Berry Effects

Creative effects designed to encourage experimentation Berry Effects is the brainchild of Abe and Ralph, a pair of multi-instrumentalists and audio engineer...

16/11/2026

Anukari 1.1 now available

Physics-based synth gets first major update Anukari have just released a new version of their innovative physics-based software synth, marking the instrumen...

16/11/2026

Hit'n'Mix RipX DAW 9 arrives

Both versions kitted out with new tools & improvements Hit'n'Mix have just launched the latest major version of their innovative DAW software, with ...

16/11/2026

Eventide to launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

16/11/2026

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with highperformance oscilloscope

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with high p...

16/11/2026

CNAO and Hitachi launch advanced rotating proton therapy system in Italy

November 16, 2026 Hitachi system enables proton beams to be delivered from 360 degrees around the patient, expanding treatment capacity and supporting more pre...

16/11/2026

NBC Celebrates Centennial

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

16/11/2026

Apple TV Adding Podcasts

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

16/11/2026

Fabric Insights Partners With Fonn Group on Enhancing Media Workflows

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

16/11/2026

SDVI Names Marcy Lefkovitz as VP of Strategic Accounts

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

16/11/2026

Monthly Streaming Costs Up, Internet Fees Down for 2026

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

16/11/2026

Hexagon Introduces Camera-Mounted 3D Capture and Tracking System

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

16/11/2026

Bridge Technologies Adds Apple ProRes Support to VB440 Probe

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

16/11/2026

Rebuilding Broadcast on Air: Inside the 2026 SMPTE Media Technology Summit

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

16/11/2026

Hiltron HMAM Chosen by Major Satcom Service Provider

Hiltron Communications has received a repeat order from one of Europes longest established communications satellite operators. Central to this project is a Hilt...

16/11/2026

Fabric Insights and Fonn Group Partner to Unlock Media Wo...

Fabric Insights and Fonn Group today announce a partnership to connect editorial planning and media operations across their complementary product portfolios. ...

16/11/2026

Density 1.0 brings a complete color grading workflow to Final Cut Pro

Density 1.0 brings a complete color grading workflow to Final Cut Pro Brie Clayton November 16, 2026 0 Comments Filmmaker Pascal Basel's plugin pr...

16/11/2026

Berklee Students to Perform at Boston's CITGO Sign Relighting

Berklee Students to Perform at Boston's CITGO Sign Relighting Kuper Walker, Ollie Mann, and dreamcorp. will perform at the free public celebration in Kenm...

16/11/2026

The Hollywood Reporter Names Berklee Among World's Best Music Schools

The Hollywood Reporter Names Berklee Among World's Best Music Schools The annual list spotlights Berklee's screen scoring programs and new master'...

16/11/2026

Taurus Rooms - A Five-Year Vision Proven In Meeting Rooms

Five years ago, Lightware launched the original Taurus UCX with a clear vision: USB-C would become the central connection in meeting rooms. The goal was simple:...

16/11/2026

Sonniss: bundles over 80% below their libraries' prices, plus up to 60% off over 2,700 sound effects libraries

Sonniss: bundles over 80% below their libraries' prices, plus up to 60% off ...

16/11/2026

Singaporean Comedy Luck My Life Shot with Blackmagic URSA Cine 17K 65

Singaporean Comedy Luck My Life Shot with Blackmagic URSA Cine 17K 65 Brie Clayton November 16, 2026 0 Comments Blackmagic PYXIS 12K and DaVinci Resol...

16/11/2026

SES and ITU Expand Partner2Connect Digital-learning Initiative to 30 African Schools

Initiative in Malawi, Burundi, Zambia and Zimbabwe will leverage SES satellite s...

16/11/2026

NVIDIA DGX Spark Developer Kit Turns a Desk Into a Supercomputing Lab

At SC26, an annual supercomputing conference taking place this week in Chicago, NVIDIA is introducing the DGX Spark HPC Developer Kit for researchers, academics...

16/11/2026

U sees new original drama Fleet Street from the creators of Miss Scarlet

Images available HERE UKTV has announced Fleet Street (6x60'), a new period crime drama from Miss Scarlet creators Rachael New and Ben Edwards, coming to f...

16/11/2026

Tribeca Festival Lisboa Unveils 2026 Film Lineup And Talent Roster For Third Annual Edition, December 9-13

November 16th, 2026 TRIBECA FESTIVAL LISBOA UNVEILS 2026 FILM LINEUP AND TALE...

16/11/2026

Sky and NOW bring some of the UKs biggest video podcasts to the big screen at no extra cost with Platform Media as first partner

From Graham Norton to Olivia Attwood and Joe Marler, a new collection of hit vid...

16/11/2026

Can Digital Product Passports help meet climate goals?

As countries gather to discuss climate targets at COP 31 this week, one question that is at the heart of debates is how to measure the environmental impact of t...

16/11/2026

NVIDIA Announces Rubin HPC - A New GPU to Accelerate Agents for Science, Engineering and Analytics

Announced today at SC26, NVIDIA Rubin HPC is a new GPU in the NVIDIA Vera Rubin ...

16/11/2026

CUDA at 20: How the Platform Transformed Scientific Computing

This week at SC26, NVIDIA is marking two decades of CUDA by honoring the researchers, developers and engineers who helped make GPU computing a foundation for mo...

16/11/2026

NVIDIA CUDA-X Libraries Give Agents the Tools to Accelerate Scientific Discovery

With expanded NVIDIA CUDA-X libraries, including cuPhoton, cuPotential and cuSpa, researchers can sift through vast amounts of data to accelerate research, from...

16/11/2026

NVIDIA Sweeps MLPerf Training and Endpoints as Vera Rubin Debuts With Leading Performance

In its MLPerf benchmarks debut, with results released today, the NVIDIA Vera Rub...

16/11/2026

NVIDIA Expands Slurm to Bring Quantum Computing Into Supercomputing

Quantum processor deployments at supercomputing centers have grown nearly sevenfold over the past five years, with nearly 30 supercomputing centers around the w...

16/11/2026

Lambda Boosts AI Factory Resiliency and Efficiency With NVIDIA Photonics

To train an AI model, thousands of GPUs have to work together, requiring a network that's fast, efficient and resilient. Lambda is tackling the network pie...

15/11/2026

Yamaha launch MGX, URX & CC1 updates

Mixers, interfaces & DAW controller receive new firmware Yamaha have just launched a trio of firmware updates that bring some powerful new functionality to ...