Sony Pixel Power calrec Sony

Gearing Up for the Gigawatt Data Center Age

21/08/2025

Across the globe, AI factories are rising - massive new data centers built not to serve up web pages or email, but to train and deploy intelligence itself. Internet giants have invested billions in cloud-scale AI infrastructure for their customers. Companies are racing to build AI foundries that will spawn the next generation of products and services. Governments are investing too, eager to harness AI for personalized medicine and language services tailored to national populations.

Welcome to the age of AI factories - where the rules are being rewritten and the wiring doesn't look anything like the old internet. These aren't typical hyperscale data centers. They're something else entirely. Think of them as high-performance engines stitched together from tens to hundreds of thousands of GPUs - not just built, but orchestrated, operated and activated as a single unit. And that orchestration? It's the whole game.

This giant data center has become the new unit of computing, and the way these GPUs are connected defines what this unit of computing can do. One network architecture won't cut it. What's needed is a layered design with bleeding-edge technologies - like co-packaged optics that once seemed like science fiction.

The complexity isn't a bug; it's the defining feature. AI infrastructure is diverging fast from everything that came before it, and if there isn't rethinking on how the pipes connect, scale breaks down. Get the network layers wrong, and the whole machine grinds to a halt. Get it right, and gain extraordinary performance.

With that shift comes weight - literally. A decade ago, chips were built to be sleek and lightweight. Now, the cutting edge looks like the multi hundred pound copper spine of a server rack. Liquid-cooled manifolds. Custom busbars. Copper spines. AI now demands massive, industrial-scale hardware. And the deeper the models go, the more these machines scale up, and out.

The NVIDIA NVLink spine, for example, is built from over 5,000 coaxial cables - tightly wound and precisely routed. It almost as much data per second as the entire internet. That's 130 TB/s of GPU-to-GPU bandwidth, fully meshed.

This isn't just fast. It's foundational. The AI super-highway now lives inside the rack.

The Data Center Is the Computer

Training the modern large language models (LLMs) behind AI isn't about burning cycles on a single machine. It's about orchestrating the work of tens or even hundreds of thousands of GPUs that are the heavy lifters of AI computation.

These systems rely on distributed computing, splitting massive calculations across nodes (individual servers), where each node handles a slice of the workload. In training, those slices - typically massive matrices of numbers - need to be regularly merged and updated. That merging occurs through collective operations, such as all-reduce (which combines data from all nodes and redistributes the result) and all-to-all (where each node exchanges data with every other node).

These processes are susceptible to the speed and responsiveness of the network - what engineers call latency (delay) and bandwidth (data capacity) - causing stalls in training.

For inference - the process of running trained models to generate answers or predictions - the challenges flip. Retrieval-augmented generation systems, which combine LLMs with search, demand real-time lookups and responses. And in cloud environments, multi-tenant inference means keeping workloads from different customers running smoothly, without interference. That requires lightning-fast, high-throughput networking that can handle massive demand with strict isolation between users.

Traditional Ethernet was designed for single-server workloads - not for the demands of distributed AI. Tolerating jitter and inconsistent delivery were once acceptable. Now, it's a bottleneck. Traditional Ethernet switch architectures were never designed for consistent, predictable performance - and that legacy still shapes their latest generations.

Distributed computing requires a scale-out infrastructure built for zero-jitter operation - one that can handle bursts of extreme throughput, deliver low latency, maintain predictable and consistent RDMA performance, and isolate network noise. This is why InfiniBand networking is the gold standard for high-performance computing supercomputers and AI factories.

With NVIDIA Quantum InfiniBand, collective operations run inside the network itself using Scalable Hierarchical Aggregation and Reduction Protocol technology, doubling data bandwidth for reductions. It uses adaptive routing and telemetry-based congestion control to spread flows across paths, guarantee deterministic bandwidth and isolate noise. These optimizations let InfiniBand scale AI communication with precision. It's why NVIDIA Quantum infrastructure connects the majority of the systems on the TOP500 list of the world's most powerful supercomputers, demonstrating 35% growth in just two years.

For clusters spanning dozens of racks, NVIDIA Quantum X800 Infiniband switches push InfiniBand to new heights. Each switch provides 144 ports of 800 Gbps connectivity, featuring hardware-based SHARPv4, adaptive routing and telemetry-based congestion control. The platform integrates co packaged silicon photonics to minimize the distance between electronics and optics, reducing power consumption and latency. Paired with NVIDIA ConnectX-8 SuperNICs delivering 800 Gb/s per GPU, this fabric links trillion-parameter models and drives in-network compute.

But hyperscalers and enterprises have invested billions in their Ethernet software infrastructure. They need a quick path forward that uses the existing ecosystem for AI workloads. Enter NVIDIA Spectrum X: a new kind of Ethernet purpose-built for distributed AI.

Spectrum X Ethernet:
LINK: https://blogs.nvidia.com/blog/networking-matters-more-than-ever/...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

16/10/2025

Student Spotlight: Alan Villanueva

Student Spotlight: Alan Villanueva The graduate student and saxophonist, who performed on Natalia Lafourcades Latin Grammy-nominated Live at Carnegie Hall alb...

16/10/2025

XR Sports Alliance Announces New Members

The XR Sports Alliance (XRSA) has announced the third cohort of members. The new members include MLSE, Vegas Golden Knights, Pro Climbing League, FansXR, Focal ...

16/10/2025

Broadcasters Foundation of America Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign which seeks to raise donations from tax-deductible personal and c...

16/10/2025

Australia's Nine to Broadcast Live NHL Games

NEW YORK Australias Nine Network and the National Hockey League (NHL) today announced a media partnership that will bring the worlds premier professional ice ho...

16/10/2025

Study: 45% of U.S. Internet Households Now Watch FAST Services

Parks Associates has released new data showing that nearly half (45%) of U.S. internet homes watch free ad-supported streaming TV (FAST) services and 89% of U.S...

16/10/2025

J.D. Power: Wireless Internet Signups Soar Over Last 6 Months

TROY, Mich. -New data from J.D. Power's 2025 U.S. Residential Internet Service Provider Study shows that residential wireless internet providers are growing...

16/10/2025

KATJA MIA ANNOUNCED AS NEW 2FM WEEKEND PRESENTER

This Saturday October 18 Katja Mia will burst onto the radio airwaves for the first time as she joins 2FM. Katja will be standing in for Bl thnaid Treacy on Sat...

16/10/2025

RT is Supporting 39 Arts and Cultural Events across Ireland this October

This October, RT is delighted to support Wexford Festival Opera, Babor International Arts Festival for Children, Open House Dublin and 36 other arts and cultu...

16/10/2025

Ready, Set, Reward - GeForce NOW Membership Rewards Await

GeForce NOW is more than just a platform to stream fresh games every week - it offers celebrations for the gamers who make it epic, with member rewards to sweet...

15/10/2025

Reporting that changes lives: Announcing the Young Journalist finalists 2025

Across the world, early-career reporters are interrogating systems that shape daily life, from mortuaries and classrooms to the corridors of legal education and...

15/10/2025

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open Video

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open VideoThe NHL franchise worked with production firms 2WEI and 4th Floor CreativeBy Mark J Burns,...

15/10/2025

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsorships

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsors...

15/10/2025

The Remaining Native Team on the Sundance Institute Labs, Community and More

By Paige Bethmann Before my grandmother passed away in 2019, I went to visit her in the hospital where she'd been for a few weeks. When I arrived, the nurs...

15/10/2025

Spotify Celebrates Two Years of Audiobooks in Premium, Fueling Growth and Discovery Across the Publishing World

Two years ago, Spotify set out to grow the entire publishing industry by making ...

15/10/2025

DJ Levels Up With Spanish-Language Requests, Text Requests, and Personalized Prompts

People turn to DJ for a listening experience that feels personal, dynamic, and j...

15/10/2025

DJ evoluciona con solicitudes en espaol, peticiones por texto y recomendaciones personalizadas

Las personas recurren a DJ para vivir una experiencia de escucha personal, din m...

15/10/2025

Bruce Springsteen and Jeremy Allen White Unite in London for an Exclusive Spotify Conversation and Film Preview

Rock legend Bruce Springsteen and luminary actor Jeremy Allen White came togethe...

15/10/2025

Meet Spotify's RADAR Creators Global Class of 2025, the Next Wave of Podcast Talent

At Spotify, we're all about supporting rising talent and helping them connec...

15/10/2025

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS On Demand

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS ...

15/10/2025

SBS celebrates the Festivals of Lights with bold, illuminating stories across the network

SBS celebrates the Festivals of Lights with bold, illuminating stories across th...

15/10/2025

Seeking Astrobiological Potential Millions of Miles from Earth

One of humanity's most profound questions continues: Is there any place in our galaxy suitable for life beyond Earth? NASA intends to find out, with the hel...

15/10/2025

Austin PBS Expands Facility-Wide Production Communications with Clear-Com

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

15/10/2025

Scality debuts industry-first AI certifications with more...

Scality, a global leader in cyber-resilient storage software for the AI era, today announced the advancement of its comprehensive AI ecosystem certification pro...

15/10/2025

2026 HPA Tech Retreat to Deliver Insight Innovation and I...

The Hollywood Professional Association (HPA) today unveiled key highlights of the 2026 HPA Tech Retreat, scheduled for Feb. 15 19 at the Westin Rancho Mirage Go...

15/10/2025

Interra Systems Drives Quality Compliance and Monetizatio...

At NAB Show New York 2025 (Stand 244), Interra Systems will showcase the future of media QC, monitoring, and captioning, highlighting its award-winning, AI- and...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transitio...

Grass Valley today announced that RMC BFM, part of the CMA-CGM Group and France's third-largest private media group, has chosen Grass Valley's productio...

15/10/2025

Appear to Showcase Next-Generation Hybrid Live Production...

Appear, the global leader in live production technology, will demonstrate how its powerful hardware and software innovations are shaping the future of hybrid, s...

15/10/2025

Rakim to Join Berklee's Hip-Hop Hall of Fame at Signature Series Concert

Rakim to Join Berklee's Hip-Hop Hall of Fame at Signature Series Concert The rap icon becomes the latest inductee, following luminaries such as Roxanne Sh...

15/10/2025

Berklee Brings Live Music to the Head of the Charles

Berklee Brings Live Music to the Head of the Charles Student artists will perform on multiple riverfront stages during the 60th anniversary of the world's...

15/10/2025

CobbTV Taps Pebble for Playout Automation

CobbTV, the government access television channel for Cobb County, Ga. recently acquired an automated playout system from Pebble, a global provider of automation...

15/10/2025

Appear to Showcase Next-Generation Hybrid Live Production at NAB Show NY

OSLO, Norway Appear, the global leader in live production technology, will demonstrate how its powerful hardware and software innovations are shaping the future...

15/10/2025

NBA Unveils Updated NBA App and Reimagined' NBA TV

NEW YORK The NBA is making major changes to the NBA App and NBA TV as it takes control of them from TNT Sports, which has long managed the league's digital ...

15/10/2025

DirecTV Announces Major Expansion of Interactive AI-Powered Features

SAN MATEO, Calif. In what promises to be a major expansion of interactive features and personalized content on the DirecTV platform, the operator and Glance hav...

15/10/2025

Roku Upgrades User Interface to Showcase Original Content

SAN JOSE, Calif. Roku has launched changes to its user interface (UI) that the streaming platform says will better showcase original programming on the platform...

15/10/2025

OpenDrives Promotes Alex Dunfey to CTO

LOS ANGELES Software-defined data storage and data services provider OpenDrives has elevated Alex Dunfey to chief technology officer, responsible for driving th...

15/10/2025

Space42 and Autonomous A2Z Partner to Advance Smart Mobility Ecosystem in the UAE

Abu Dhabi, UAE October 15, 2025: Space42 (ADX: SPACE42), the UAE-based AI-powe...

15/10/2025

Third series of Dream Car Fixers confirmed for U and U&YESTERDAY

Sheldon Nichols and Will Trickett to find and prepare more classic cars for budget conscious would-be owners from Wiser Films UKTV have recommissioned the clas...

15/10/2025

Sky celebrates Nick Cave in upcoming one-off special, The Veiled World of Nick Cave (w/t)

Wednesday 15 October 2025 Nick Cave JPEG (275 KB) Explore the creative univer...

15/10/2025

The Textorcist: Brits confess their scariest messaging moments

Wednesday 15 October 2025 From breaking up with your partner to quitting your job - new polling shows some messages are just too scary to send Over a fifth (...

15/10/2025

Rohde & Schwarz unveils compact MXO 3 oscilloscopes with 4 and 8 channels: Advanced performance meets affordability

Rohde & Schwarz unveils compact MXO 3 oscilloscopes with 4 and 8 channels: Advan...

15/10/2025

Revenge Series The Resurrected' Captivates Audiences Across Asia

Back to All News Revenge Series The Resurrected' Captivates Audiences Across Asia Entertainment 15 October 2025 GlobalTaiwan Link copied to clipboard ...

15/10/2025

Bringing the Best in VFX and Virtual Production Together as Eyeline

Back to All News Bringing the Best in VFX and Virtual Production Together as Eyeline Jeffrey Shapiro CEO, Eyeline Business 15 October 2025 GlobalCanadaInd...

15/10/2025

NESN Redefines Regional Sports Video Delivery with Harmonic

Deployed by Astound Business Solutions, Harmonic's Primary Distribution Solution Ensures Outstanding Video Quality and Seamless Ad Insertion at the Edge SA...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transition to IP and UHD Production

Collaboration extends a trusted relationship as RMC BFM invests in scalable, fut...

15/10/2025

First look at new RT comedy-drama These Sacred Vows

Series coming in 2026 stars Tom Vaughan-Lawlor, Justine Mitchell and Jason O'Mara released today RT today released first look images of new comedy-drama ...

14/10/2025

SVG Europe Summit 2025: All Sessions Now Available to Watch on SVG PLAY

SVG Europe Summit 2025: All Sessions Now Available to Watch on SVG PLAYNetworking event that preceded IBC2025 shone a light on elite live sports innovation acro...

14/10/2025

SVG Sit-Down: Author Rich Podolsky on Writing Madden & Summerall: How They Revolutionized NFL Broadcasting'

SVG Sit-Down: Author Rich Podolsky on Writing Madden & Summerall: How They Revo...

14/10/2025

SVG All-Stars: Michael Reiners, Coordinating Producer, FloRacing

SVG All-Stars: Michael Reiners, Coordinating Producer, FloRacingThe Illinois State grad steers a vast schedule of motorsports events at tracks across the countr...