Sony Pixel Power calrec Sony

Hot Topics at Hot Chips: Inference, Networking, AI Innovation at Every Scale - All Built on NVIDIA

22/08/2025

AI reasoning, inference and networking will be top of mind for attendees of next week's Hot Chips conference.

A key forum for processor and system architects from industry and academia, Hot Chips - running Aug. 24-26 at Stanford University - showcases the latest innovations poised to advance AI factories and drive revenue for the trillion-dollar data center computing market.

At the conference, NVIDIA will join industry leaders including Google and Microsoft in a tutorial session - taking place on Sunday, Aug. 24 - that discusses designing rack-scale architecture for data centers.

In addition, NVIDIA experts will present at four sessions and one tutorial detailing how:

NVIDIA networking, including the NVIDIA ConnectX-8 SuperNIC, delivers AI reasoning at rack- and data-center scale. (Featuring Idan Burstein, principal architect of network adapters and systems-on-a-chip at NVIDIA)

Neural rendering advancements and massive leaps in inference - powered by the NVIDIA Blackwell architecture, including the NVIDIA GeForce RTX 5090 GPU - provide next-level graphics and simulation capabilities. (Featuring Marc Blackstein, senior director of architecture at NVIDIA)

Co-packaged optics (CPO) switches with integrated silicon photonics - built with light-speed fiber rather than copper wiring to send information quicker and using less power - enable efficient, high-performance, gigawatt-scale AI factories. The talk will also highlight NVIDIA Spectrum-XGS Ethernet, a new scale-across technology for unifying distributed data centers into AI super-factories. (Featuring Gilad Shainer, senior vice president of networking at NVIDIA)

The NVIDIA GB10 Superchip serves as the engine within the NVIDIA DGX Spark desktop supercomputer. (Featuring Andi Skende, senior distinguished engineer at NVIDIA)

It's all part of how NVIDIA's latest technologies are accelerating inference to drive AI innovation everywhere, at every scale.

NVIDIA Networking Fosters AI Innovation at Scale AI reasoning - when artificial intelligence systems can analyze and solve complex problems through multiple AI inference passes - requires rack-scale performance to deliver optimal user experiences efficiently.

In data centers powering today's AI workloads, networking acts as the central nervous system, connecting all the components - servers, storage devices and other hardware - into a single, cohesive, powerful computing unit.

NVIDIA ConnectX-8 SuperNIC Burstein's Hot Chips session will dive into how NVIDIA networking technologies - particularly NVIDIA ConnectX-8 SuperNICs - enable high-speed, low-latency, multi-GPU communication to deliver market-leading AI reasoning performance at scale.

As part of the NVIDIA networking platform, NVIDIA NVLink, NVLink Switch and NVLink Fusion deliver scale-up connectivity - linking GPUs and compute elements within and across servers for ultra low-latency, high-bandwidth data exchange.

NVIDIA Spectrum-X Ethernet provides the scale-out fabric to connect entire clusters, rapidly streaming massive datasets into AI models and orchestrating GPU-to-GPU communication across the data center. Spectrum-XGS Ethernet scale-across technology extends the extreme performance and scale of Spectrum-X Ethernet to interconnect multiple, distributed data centers to form AI super-factories capable of giga-scale intelligence.

Connecting distributed AI data centers with NVIDIA Spectrum-XGS Ethernet. At the heart of Spectrum-X Ethernet, CPO switches push the limits of performance and efficiency for AI infrastructure at scale, and will be covered in detail by Shainer in his talk.

NVIDIA GB200 NVL72 - an exascale computer in a single rack - features 36 NVIDIA GB200 Superchips, each containing two NVIDIA B200 GPUs and an NVIDIA Grace CPU, interconnected by the largest NVLink domain ever offered, with NVLink Switch providing 130 terabytes per second of low-latency GPU communications for AI and high-performance computing workloads.

An NVIDIA rack-scale system. Built with the NVIDIA Blackwell architecture, GB200 NVL72 systems deliver massive leaps in reasoning inference performance.

NVIDIA Blackwell and CUDA Bring AI to Millions of Developers The NVIDIA GeForce RTX 5090 GPU - also powered by Blackwell and to be covered in Blackstein's talk - doubles performance in today's games with NVIDIA DLSS 4 technology.

NVIDIA GeForce RTX 5090 GPU It can also add neural rendering features for games to deliver up to 10x performance, 10x footprint amplification and a 10x reduction in design cycles, helping enhance realism in computer graphics and simulation. This offers smooth, responsive visual experiences at low energy consumption and improves the lifelike simulation of characters and effects.

NVIDIA CUDA, the world's most widely available computing infrastructure, lets users deploy and run AI models using NVIDIA Blackwell anywhere.

Hundreds of millions of GPUs run CUDA across the globe, from NVIDIA GB200 NVL72 rack-scale systems to GeForce RTX and NVIDIA RTX PRO-powered PCs and workstations, with NVIDIA DGX Spark powered by NVIDIA GB10 - discussed in Skende's session - coming soon.

From Algorithms to AI Supercomputers - Optimized for LLMs

NVIDIA DGX Spark Delivering powerful performance and capabilities in a compact package, DGX Spark lets developers, researchers, data scientists and students push the boundaries of generative AI right at their desktops, and accelerate workloads across industries.

As part of the NVIDIA Blackwell platform, DGX Spark brings support for NVFP4, a low-precision numerical format to enable efficient agentic AI inference, particularly of large language models (LLMs). Learn more about NVFP4 in this NVIDIA Technical Blog.

Open-Source Collaborations Propel Inference Innovation NVIDIA accelerates several open-source libraries and frameworks to accelerate and optimize AI
LINK: https://blogs.nvidia.com/blog/hot-chips-inference-networking/...
See more stories from nvidia

Most recent headlines

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

22/08/2025

Lurker Simmers With Tension As Idol Worship Turned Sour

(L-R) Writer-director Alex Russell, Th odore Pellerin, Archie Madekwe, and Havana Rose Liu on stage for the premiere of Lurker at Eccles Theater in Park City....

22/08/2025

Spotify and Stray Kids Celebrate KARMA With An Immersive Spotify STAYdium Experience

The wait is over: Stray Kids return with their fourth full-length album, KARMA. ...

22/08/2025

Spotify and Royel Otis Team Up on a Special hickey' Album Release Show for Top Fans

With their new album, hickey, out now, Aussie indie darlings Royel Otis decided ...

22/08/2025

Studio Upgrade: MixedbyEL on Moving to the Apogee Symphony Studio

We recently spoke with MixedbyEL, a rising force in the world of audio engineering, celebrated for his dynamic work in rap, R&B, and pop. From his early days re...

22/08/2025

BitFire Launches Live Master Control in the Cloud

BitFire (bitfire.tv), a leader in software-defined live production and IP transmission, today announced the addition of cloud-based live master control capabili...

22/08/2025

Utah Scientific Releases NBOSS Software-Based NMOS Contro...

Utah Scientific today announced NBOSS, a new software-based control solution designed to streamline the management of NMOS-compliant devices in hybrid SDI/IP en...

22/08/2025

Amagi 15th Global FAST report reveals how live content is...

Amagi, a cloud-based SaaS technology solutions provider for broadcast and streaming TV, today announced the release of its 15th Global FAST Report, offering ins...

22/08/2025

Hitomi MatchBox Technology Deployed by ORF for Major SMPT...

Hitomi Broadcast, the market leader in audio/video alignment and latency solutions, announces that ORF ( sterreichischer Rundfunk), Austria s national public br...

22/08/2025

This Berklee Program Turns Class Projects into Career Breakthroughs

This Berklee Program Turns Class Projects into Career Breakthroughs Experiential Design Lab students take on creative briefs from Red Bull, Disney, and more, ...

22/08/2025

Report: FAST Channels Need More Live Content to Succeed

NEW YORK Although FAST channels are becoming ever more omnipresent in the streaming universe, the vast majority of them will need to start providing more live c...

22/08/2025

Magnite, Acxiom Announce Integration

NEW YORK Independent sell-side advertising company Magnite today announced an integration with Acxiom, the connected data and technology foundation of global ad...

22/08/2025

Six Scripps Channels Launch on Peacock

CINCINNATI The E.W. Scripps Company has announced that six of its channels are now streaming as part of Peacock's 24/7 channel offering and are available to...

22/08/2025

ESPN Launches ESPN Unlimited Streaming App

ESPN launched today its new direct-to-consumer streaming service and a set of new features on an enhanced ESPN App, making ESPN's full suite of 12 networks ...

22/08/2025

FCC Deletes More Rules

WASHINGTON The Federal Communications Commission is once again pressing the delete button as part of its Delete, Delete, Delete regulatory initiative to remov...

22/08/2025

Solid State Logic to Introduce IP-Native Stagebox at IBC2025

OXFORD, U.K. Solid State Logic will unveil its System T plug-and-play IP-native MPL 16-8 stagebox offering cost-effective connectivity for touring flypack and i...

22/08/2025

Fox Officially Launches Fox One

NEW YORK and LOS ANGELES Fox Corporation has officially launched Fox One, a new streaming service that brings together the full portfolio of Foxs sports, news a...

22/08/2025

Brassic rides out in style as Sky drops trailer for acclaimed Original comedy

Friday 22 August 2025 To view this content, please enable our use of cookies. To do so, click Privacy Options below and Accept All Privacy options The Brassi...

22/08/2025

Starr Parodi and Jeff Fair rebuild studio life with help from Focusrite and ADAM Audio following devastating L.A. wildfire loss

Starr Parodi and Jeff Fair rebuild studio life with help from Focusrite and ADAM...

22/08/2025

Hot Topics at Hot Chips: Inference, Networking, AI Innovation at Every Scale - All Built on NVIDIA

AI reasoning, inference and networking will be top of mind for attendees of next...

22/08/2025

Women's Rugby World Cup 2025 on RT

Join Jacqui Hurley as she leads RT 's television coverage of the Women's Rugby World Cup 2025, with reporting from the Irish camp by Clare MacNamara. Co...

21/08/2025

Amra and Spotify Strike a New Multi-Territorial Direct Licensing Agreement

Spotify and amra, the world's first and only global digital licensing collection society, have entered into a direct multi-territorial, multi-year licensing...

21/08/2025

Spotify Takes Instagram Sharing to the Next Level with Audio Previews and Real-Time Listening Notes

Spotify is making it easier than ever to connect with your friends on Instagram ...

21/08/2025

Spotify Brings Romantasy to Life With Our Dark and Mysterious Forbid-Inn Audiobooks Experience

From enemies-to-lovers banter to star-crossed soulmates battling curses, romanta...

21/08/2025

Statement on Acting Managing Director arrangements at SBS

Statement on Acting Managing Director arrangements at SBS 21 August, 2025 Insights & articles The SBS Board of Directors has today confirmed it will appoin...

21/08/2025

L3Harris Expands Florida Facility to Support America's Golden Dome

L3Harris Technologies Chair and CEO Christopher E. Kubasik speaks at the opening of the 94,000-square-foot satellite integration and test facility. The company ...

21/08/2025

Clear-Com Connects the Desert Across Coachella and Stagecoach 2025

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

21/08/2025

Imagine Communications to Debut SNP-XS at IBC2025

DENVER At IBC2025, Sept. 12-15 at the RAI Amsterdam, Imagine Communications will introduce the SNP-XS, a versatile addition to its Selenio Network Processor (SN...

21/08/2025

BitFire Launches Live Master Control in the Cloud

HUDSON, Mass. BitFire, a provider of software-defined live production and IP transmission, today announced the addition of cloud-based live master control capab...

21/08/2025

Gray Media to Launch New Hyper-Personalized Video Streaming Service

ATLANTA Gray Media has laid out plans for launching a new cutting-edge, hyper-personalized streaming platform that will start going live in Grays markets in Jan...

21/08/2025

Chyron Partners with Asport for Live Sports Production and Distribution

NEW YORK and ZURICH Chyron, a provider of broadcast graphics and live production solutions, has announced a partnership with Asport, a leading sports tech innov...

21/08/2025

swXtch.io to Debut SRTx Gateway at IBC2025

NEW YORK swXtch.io has amplified its support for SRT workflows with a new specialized gateway solution primarily targeted at the live event market. To be introd...

21/08/2025

Rise Academy Revives 4K Charity Run for IBC 2025

AMSTERDAM Rise Academy, the charity dedicated to delivering practical media technology experiences, careers resources and sharing work experience opportunities ...

21/08/2025

Carr Names a New Special Assistant

WASHINGTON FCC Chairman Brendan Carr announced the appointment of Courtney Cowper as a special assistant in his office. As a special assistant in the Office of ...

21/08/2025

Live Media Group Debuts New IP-based REMI Production Truck

COLUMBUS, Ohio Live Media Group has launched its latest mobile production unit, the MU-28, which is a SMPTE 2110-7 IP-based truck built specifically for remote ...

21/08/2025

Sling TV Launches Sling Select

ENGLEWOOD, Colo. Sling TV has launched a new offering called Select that provides a package of cable channels for $19.99 a month....

21/08/2025

Viant and Wurl Partner on Scene-Level CTV Targeting and Measurement

IRVINE, Calif. CTV and programmatic ad provider Viant Technology Inc. has announced a new integration of its DSP with Wurl that provides advertisers with scene...

21/08/2025

Marshall Electronics to Show New PTZ Camera at IBC2025

TORRANCE, Calif. Marshall Electronics will highlight several new products at IBC2025, including the CV612 PTZ camera, RCP Plus camera controller and VMV-402-3GS...

21/08/2025

SVG New Sponsor Spolight: MyCaseBuilder's Steve Holand on Creating Custom Cases for Everything From Cameras to Championship Trophies

SVG New Sponsor Spolight: MyCaseBuilder's Steve Holand on Creating Custom Ca...

21/08/2025

'The Monster of Florence': Official Trailer and New Photos of the Show Directed by Stefano Sollima Coming Only on Netflix October 22

Back to All News The Monster of Florence: Official Trailer and New Photos of th...

21/08/2025

RIKEN, Japan's Leading Science Institute, Taps Fujitsu and NVIDIA for Next Flagship Supercomputer

Japan is once again building a landmark high-performance computing system - not ...

21/08/2025

Telos Alliance Highlights Advanced Dialog Intelligibility and Language Detection Capabilities at IBC2025

Telos Alliance Highlights Advanced Dialog Intelligibility and Language Detectio...

21/08/2025

Building From the Back: Will AI Benefit European Football Production and Distribution?

Building From the Back: Will AI Benefit European Football Production and Distrib...

21/08/2025

From Paris to Milan: How NBC Olympics Continues to Lead the Way in Media Management

From Paris to Milan: How NBC Olympics Continues to Lead the Way in Media Managem...

21/08/2025

FloSports Deploys AI-Driven Virtual Pan and Zoom To Streamline Production of Multi-Event, Single-Camera Sports

FloSports Deploys AI-Driven Virtual Pan and Zoom To Streamline Production of Mul...