Hot Topics at Hot Chips: Inference, Networking, AI Innovation at Every Scale - All Built on NVIDIA

AI reasoning, inference and networking will be top of mind for attendees of next week's Hot Chips conference.

A key forum for processor and system architects from industry and academia, Hot Chips - running Aug. 24-26 at Stanford University - showcases the latest innovations poised to advance AI factories and drive revenue for the trillion-dollar data center computing market.

At the conference, NVIDIA will join industry leaders including Google and Microsoft in a tutorial session - taking place on Sunday, Aug. 24 - that discusses designing rack-scale architecture for data centers.

In addition, NVIDIA experts will present at four sessions and one tutorial detailing how:

NVIDIA networking, including the NVIDIA ConnectX-8 SuperNIC, delivers AI reasoning at rack- and data-center scale. (Featuring Idan Burstein, principal architect of network adapters and systems-on-a-chip at NVIDIA)

Neural rendering advancements and massive leaps in inference - powered by the NVIDIA Blackwell architecture, including the NVIDIA GeForce RTX 5090 GPU - provide next-level graphics and simulation capabilities. (Featuring Marc Blackstein, senior director of architecture at NVIDIA)

Co-packaged optics (CPO) switches with integrated silicon photonics - built with light-speed fiber rather than copper wiring to send information quicker and using less power - enable efficient, high-performance, gigawatt-scale AI factories. The talk will also highlight NVIDIA Spectrum-XGS Ethernet, a new scale-across technology for unifying distributed data centers into AI super-factories. (Featuring Gilad Shainer, senior vice president of networking at NVIDIA)

The NVIDIA GB10 Superchip serves as the engine within the NVIDIA DGX Spark desktop supercomputer. (Featuring Andi Skende, senior distinguished engineer at NVIDIA)

It's all part of how NVIDIA's latest technologies are accelerating inference to drive AI innovation everywhere, at every scale.

NVIDIA Networking Fosters AI Innovation at Scale AI reasoning - when artificial intelligence systems can analyze and solve complex problems through multiple AI inference passes - requires rack-scale performance to deliver optimal user experiences efficiently.

In data centers powering today's AI workloads, networking acts as the central nervous system, connecting all the components - servers, storage devices and other hardware - into a single, cohesive, powerful computing unit.

NVIDIA ConnectX-8 SuperNIC Burstein's Hot Chips session will dive into how NVIDIA networking technologies - particularly NVIDIA ConnectX-8 SuperNICs - enable high-speed, low-latency, multi-GPU communication to deliver market-leading AI reasoning performance at scale.

As part of the NVIDIA networking platform, NVIDIA NVLink, NVLink Switch and NVLink Fusion deliver scale-up connectivity - linking GPUs and compute elements within and across servers for ultra low-latency, high-bandwidth data exchange.

NVIDIA Spectrum-X Ethernet provides the scale-out fabric to connect entire clusters, rapidly streaming massive datasets into AI models and orchestrating GPU-to-GPU communication across the data center. Spectrum-XGS Ethernet scale-across technology extends the extreme performance and scale of Spectrum-X Ethernet to interconnect multiple, distributed data centers to form AI super-factories capable of giga-scale intelligence.

Connecting distributed AI data centers with NVIDIA Spectrum-XGS Ethernet. At the heart of Spectrum-X Ethernet, CPO switches push the limits of performance and efficiency for AI infrastructure at scale, and will be covered in detail by Shainer in his talk.

NVIDIA GB200 NVL72 - an exascale computer in a single rack - features 36 NVIDIA GB200 Superchips, each containing two NVIDIA B200 GPUs and an NVIDIA Grace CPU, interconnected by the largest NVLink domain ever offered, with NVLink Switch providing 130 terabytes per second of low-latency GPU communications for AI and high-performance computing workloads.

An NVIDIA rack-scale system. Built with the NVIDIA Blackwell architecture, GB200 NVL72 systems deliver massive leaps in reasoning inference performance.

NVIDIA Blackwell and CUDA Bring AI to Millions of Developers The NVIDIA GeForce RTX 5090 GPU - also powered by Blackwell and to be covered in Blackstein's talk - doubles performance in today's games with NVIDIA DLSS 4 technology.

NVIDIA GeForce RTX 5090 GPU It can also add neural rendering features for games to deliver up to 10x performance, 10x footprint amplification and a 10x reduction in design cycles, helping enhance realism in computer graphics and simulation. This offers smooth, responsive visual experiences at low energy consumption and improves the lifelike simulation of characters and effects.

NVIDIA CUDA, the world's most widely available computing infrastructure, lets users deploy and run AI models using NVIDIA Blackwell anywhere.

Hundreds of millions of GPUs run CUDA across the globe, from NVIDIA GB200 NVL72 rack-scale systems to GeForce RTX and NVIDIA RTX PRO-powered PCs and workstations, with NVIDIA DGX Spark powered by NVIDIA GB10 - discussed in Skende's session - coming soon.

From Algorithms to AI Supercomputers - Optimized for LLMs

NVIDIA DGX Spark Delivering powerful performance and capabilities in a compact package, DGX Spark lets developers, researchers, data scientists and students push the boundaries of generative AI right at their desktops, and accelerate workloads across industries.

As part of the NVIDIA Blackwell platform, DGX Spark brings support for NVFP4, a low-precision numerical format to enable efficient agentic AI inference, particularly of large language models (LLMs). Learn more about NVFP4 in this NVIDIA Technical Blog.

Open-Source Collaborations Propel Inference Innovation NVIDIA accelerates several open-source libraries and frameworks to accelerate and optimize AI

LINK:	https://blogs.nvidia.com/blog/hot-chips-inference-networking/...
	See more stories from nvidia

Most recent headlines