Across the globe, AI factories are rising - massive new data centers built not to serve up web pages or email, but to train and deploy intelligence itself. Internet giants have invested billions in cloud-scale AI infrastructure for their customers. Companies are racing to build AI foundries that will spawn the next generation of products and services. Governments are investing too, eager to harness AI for personalized medicine and language services tailored to national populations.
Welcome to the age of AI factories - where the rules are being rewritten and the wiring doesn't look anything like the old internet. These aren't typical hyperscale data centers. They're something else entirely. Think of them as high-performance engines stitched together from tens to hundreds of thousands of GPUs - not just built, but orchestrated, operated and activated as a single unit. And that orchestration? It's the whole game.
This giant data center has become the new unit of computing, and the way these GPUs are connected defines what this unit of computing can do. One network architecture won't cut it. What's needed is a layered design with bleeding-edge technologies - like co-packaged optics that once seemed like science fiction.
The complexity isn't a bug; it's the defining feature. AI infrastructure is diverging fast from everything that came before it, and if there isn't rethinking on how the pipes connect, scale breaks down. Get the network layers wrong, and the whole machine grinds to a halt. Get it right, and gain extraordinary performance.
With that shift comes weight - literally. A decade ago, chips were built to be sleek and lightweight. Now, the cutting edge looks like the multi hundred pound copper spine of a server rack. Liquid-cooled manifolds. Custom busbars. Copper spines. AI now demands massive, industrial-scale hardware. And the deeper the models go, the more these machines scale up, and out.
The NVIDIA NVLink spine, for example, is built from over 5,000 coaxial cables - tightly wound and precisely routed. It almost as much data per second as the entire internet. That's 130 TB/s of GPU-to-GPU bandwidth, fully meshed.
This isn't just fast. It's foundational. The AI super-highway now lives inside the rack.
The Data Center Is the Computer
Training the modern large language models (LLMs) behind AI isn't about burning cycles on a single machine. It's about orchestrating the work of tens or even hundreds of thousands of GPUs that are the heavy lifters of AI computation.
These systems rely on distributed computing, splitting massive calculations across nodes (individual servers), where each node handles a slice of the workload. In training, those slices - typically massive matrices of numbers - need to be regularly merged and updated. That merging occurs through collective operations, such as all-reduce (which combines data from all nodes and redistributes the result) and all-to-all (where each node exchanges data with every other node).
These processes are susceptible to the speed and responsiveness of the network - what engineers call latency (delay) and bandwidth (data capacity) - causing stalls in training.
For inference - the process of running trained models to generate answers or predictions - the challenges flip. Retrieval-augmented generation systems, which combine LLMs with search, demand real-time lookups and responses. And in cloud environments, multi-tenant inference means keeping workloads from different customers running smoothly, without interference. That requires lightning-fast, high-throughput networking that can handle massive demand with strict isolation between users.
Traditional Ethernet was designed for single-server workloads - not for the demands of distributed AI. Tolerating jitter and inconsistent delivery were once acceptable. Now, it's a bottleneck. Traditional Ethernet switch architectures were never designed for consistent, predictable performance - and that legacy still shapes their latest generations.
Distributed computing requires a scale-out infrastructure built for zero-jitter operation - one that can handle bursts of extreme throughput, deliver low latency, maintain predictable and consistent RDMA performance, and isolate network noise. This is why InfiniBand networking is the gold standard for high-performance computing supercomputers and AI factories.
With NVIDIA Quantum InfiniBand, collective operations run inside the network itself using Scalable Hierarchical Aggregation and Reduction Protocol technology, doubling data bandwidth for reductions. It uses adaptive routing and telemetry-based congestion control to spread flows across paths, guarantee deterministic bandwidth and isolate noise. These optimizations let InfiniBand scale AI communication with precision. It's why NVIDIA Quantum infrastructure connects the majority of the systems on the TOP500 list of the world's most powerful supercomputers, demonstrating 35% growth in just two years.
For clusters spanning dozens of racks, NVIDIA Quantum X800 Infiniband switches push InfiniBand to new heights. Each switch provides 144 ports of 800 Gbps connectivity, featuring hardware-based SHARPv4, adaptive routing and telemetry-based congestion control. The platform integrates co packaged silicon photonics to minimize the distance between electronics and optics, reducing power consumption and latency. Paired with NVIDIA ConnectX-8 SuperNICs delivering 800 Gb/s per GPU, this fabric links trillion-parameter models and drives in-network compute.
But hyperscalers and enterprises have invested billions in their Ethernet software infrastructure. They need a quick path forward that uses the existing ecosystem for AI workloads. Enter NVIDIA Spectrum X: a new kind of Ethernet purpose-built for distributed AI.
Spectrum X Ethernet:
North America Stories
23/08/2025
At IBC2025 (12-15 September, RAI Amsterdam, stand 1.B73), Imagine Communications is expanding its Selenio Network Processor (SNP) line with the launch of SNP-X...
23/08/2025
At IBC2025, TSL will introduce a series of workflow-driven enhancements across its control, audio monitoring, and power distribution solutions, engineered for i...
23/08/2025
Budapest, Hungary, August 2025 - Lightware, industry leaders in signal management, have seen growing demand for their Taurus Smart Dock since its launch in Janu...
23/08/2025
PALO ALTO, Calif. The streaming technology solutions provider Wurl has named Dave Bernath as its new chief executive officer....
23/08/2025
WASHINGTON Newsmax founder and CEO Christopher Ruddy has come out against reducing broadcast ownership caps in a filing with the Federal Communications Commissi...
23/08/2025
$2.2 Million Donation Fuels Next Phase of Berklee Bridge The anonymous gift will amplify the impact of the student success initiative built to support student...
22/08/2025
Utah Scientific Releases NBOSS Software-Based NMOS Control Solution for Hybrid S...
22/08/2025
(L-R) Writer-director Alex Russell, Th odore Pellerin, Archie Madekwe, and Havana Rose Liu on stage for the premiere of Lurker at Eccles Theater in Park City....
22/08/2025
We recently spoke with MixedbyEL, a rising force in the world of audio engineering, celebrated for his dynamic work in rap, R&B, and pop. From his early days re...
22/08/2025
BitFire (bitfire.tv), a leader in software-defined live production and IP transmission, today announced the addition of cloud-based live master control capabili...
22/08/2025
Utah Scientific today announced NBOSS, a new software-based control solution designed to streamline the management of NMOS-compliant devices in hybrid SDI/IP en...
22/08/2025
Amagi, a cloud-based SaaS technology solutions provider for broadcast and streaming TV, today announced the release of its 15th Global FAST Report, offering ins...
22/08/2025
Hitomi Broadcast, the market leader in audio/video alignment and latency solutions, announces that ORF ( sterreichischer Rundfunk), Austria s national public br...
22/08/2025
This Berklee Program Turns Class Projects into Career Breakthroughs Experiential Design Lab students take on creative briefs from Red Bull, Disney, and more, ...
22/08/2025
NEW YORK Although FAST channels are becoming ever more omnipresent in the streaming universe, the vast majority of them will need to start providing more live c...
22/08/2025
NEW YORK Independent sell-side advertising company Magnite today announced an integration with Acxiom, the connected data and technology foundation of global ad...
22/08/2025
CINCINNATI The E.W. Scripps Company has announced that six of its channels are now streaming as part of Peacock's 24/7 channel offering and are available to...
22/08/2025
ESPN launched today its new direct-to-consumer streaming service and a set of new features on an enhanced ESPN App, making ESPN's full suite of 12 networks ...
22/08/2025
WASHINGTON The Federal Communications Commission is once again pressing the delete button as part of its Delete, Delete, Delete regulatory initiative to remov...
22/08/2025
OXFORD, U.K. Solid State Logic will unveil its System T plug-and-play IP-native MPL 16-8 stagebox offering cost-effective connectivity for touring flypack and i...
22/08/2025
NEW YORK and LOS ANGELES Fox Corporation has officially launched Fox One, a new streaming service that brings together the full portfolio of Foxs sports, news a...
22/08/2025
As the latest member of the NVIDIA Blackwell architecture family, the NVIDIA Blackwell Ultra GPU builds on core innovations to accelerate training and AI reason...
22/08/2025
Little League Baseball World Series: As Championship Weekend Approaches, ESPN Re...
22/08/2025
AI reasoning, inference and networking will be top of mind for attendees of next...
21/08/2025
L3Harris Technologies Chair and CEO Christopher E. Kubasik speaks at the opening of the 94,000-square-foot satellite integration and test facility. The company ...
21/08/2025
DENVER At IBC2025, Sept. 12-15 at the RAI Amsterdam, Imagine Communications will introduce the SNP-XS, a versatile addition to its Selenio Network Processor (SN...
21/08/2025
HUDSON, Mass. BitFire, a provider of software-defined live production and IP transmission, today announced the addition of cloud-based live master control capab...
21/08/2025
ATLANTA Gray Media has laid out plans for launching a new cutting-edge, hyper-personalized streaming platform that will start going live in Grays markets in Jan...
21/08/2025
NEW YORK and ZURICH Chyron, a provider of broadcast graphics and live production solutions, has announced a partnership with Asport, a leading sports tech innov...
21/08/2025
NEW YORK swXtch.io has amplified its support for SRT workflows with a new specialized gateway solution primarily targeted at the live event market. To be introd...
21/08/2025
AMSTERDAM Rise Academy, the charity dedicated to delivering practical media technology experiences, careers resources and sharing work experience opportunities ...
21/08/2025
WASHINGTON FCC Chairman Brendan Carr announced the appointment of Courtney Cowper as a special assistant in his office. As a special assistant in the Office of ...
21/08/2025
COLUMBUS, Ohio Live Media Group has launched its latest mobile production unit, the MU-28, which is a SMPTE 2110-7 IP-based truck built specifically for remote ...
21/08/2025
ENGLEWOOD, Colo. Sling TV has launched a new offering called Select that provides a package of cable channels for $19.99 a month....
21/08/2025
IRVINE, Calif. CTV and programmatic ad provider Viant Technology Inc. has announced a new integration of its DSP with Wurl that provides advertisers with scene...
21/08/2025
TORRANCE, Calif. Marshall Electronics will highlight several new products at IBC2025, including the CV612 PTZ camera, RCP Plus camera controller and VMV-402-3GS...
21/08/2025
SVG New Sponsor Spolight: MyCaseBuilder's Steve Holand on Creating Custom Ca...
21/08/2025
Back to All News
The Monster of Florence: Official Trailer and New Photos of th...
21/08/2025
Japan is once again building a landmark high-performance computing system - not ...
21/08/2025
Telos Alliance Highlights Advanced Dialog Intelligibility and Language Detectio...
21/08/2025
Building From the Back: Will AI Benefit European Football Production and Distrib...
21/08/2025
Ratings Roundup: NBC Sports Starts EPL Season With Most-Watched Opening Weekend;...
21/08/2025
Behind The Mic: Phil Simms Heads to NBC Sports' Big Ten College Football Boo...
21/08/2025
From Paris to Milan: How NBC Olympics Continues to Lead the Way in Media Managem...
21/08/2025
FloSports Deploys AI-Driven Virtual Pan and Zoom To Streamline Production of Mul...
21/08/2025
SVG New Sponsor Spolight: MyCaseBuilder's Steve Holland on Creating Custom C...
21/08/2025
Global Gaming League Melds Music and Sports Into Its Production Graphics and music create a purposeful emulation of early MTV for an esports hybrid By Dan Dale...
21/08/2025
From AI assistants doing deep research to autonomous vehicles making split-second navigation decisions, AI adoption is exploding across industries.
Behind ever...
21/08/2025
Across the globe, AI factories are rising - massive new data centers built not to serve up web pages or email, but to train and deploy intelligence itself. Inte...
Across the globe, AI factories are rising - massive new data centers built not to serve up web pages or email, but to train and deploy intelligence itself. Internet giants have invested billions in cloud-scale AI infrastructure for their customers. Companies are racing to build AI foundries that will spawn the next generation of products and services. Governments are investing too, eager to harness AI for personalized medicine and language services tailored to national populations.
