Sony Pixel Power calrec Sony

IBM Brings the Speed of Light to the Generative AI Era with Optics Breakthrough

09/12/2024

LONDON, UK, 9 Dec, 2024: IBM (NYSE: IBM) has unveiled breakthrough research in optics technology that could dramatically improve how data centers train and run generative AI models. Researchers have pioneered a new process for co-packaged optics (CPO), the next generation of optics technology, to enable connectivity within data centers at the speed of light through optics to complement existing short reach electrical wires. By designing and assembling the first publicly announced successful polymer optical waveguide (PWG) to power this technology, IBM researchers have shown how CPO will redefine the way the computing industry transmits high-bandwidth data between chips, circuit boards, and servers.

Today, fiber optic technology carries data at high speeds across long distances, managing nearly all the world s commerce and communications traffic with light instead of electricity. Although data centers use fiber optics for their external communications networks, racks in data centers still predominantly run communications on copper-based electrical wires. These wires connect GPU accelerators that may spend more than half of their time idle, waiting for data from other devices in a large, distributed training process which can incur significant expense and energy.

IBM researchers have demonstrated a way to bring optics' speed and capacity inside data centers. In a newly published paper available on arXiv, IBM introduces a new CPO prototype module that can enable high-speed optical connectivity. This technology could significantly increase the bandwidth of data center communications, minimizing GPU downtime while drastically accelerating AI processing. This research innovation, as described, would enable:

Lower costs for scaling generative AI through a more than 5x power reduction in energy consumption compared to mid-range electrical interconnects [1], while extending the length of data center interconnect cables from one to hundreds of meters.

Faster AI model training, enabling developers to train a Large Language Model (LLM) up to five times faster with CPO than with conventional electrical wiring. CPO could reduce the time it takes to train a standard LLM from three months to three weeks, with performance gains increasing by using larger models and more GPUs.[2]

Dramatically increased energy efficiency for data centers, saving the energy equivalent of 5,000 U.S. homes' annual power consumption per AI model trained.[3]

As generative AI demands more energy and processing power, the data center must evolve and co-packaged optics can make these data centers future-proof, said Dario Gil, SVP and Director of Research at IBM. With this breakthrough, tomorrow's chips will communicate much like how fiber optics cables carry data in and out of data centers, ushering in a new era of faster, more sustainable communications that can handle the AI workloads of the future.

Eighty times faster bandwidth than today's chip-to-chip communication

In recent years, advances in chip technology have densely packed transistors onto a chip; IBM's 2 nanometer node chip technology can contain more than 50 billion transistors. CPO technology aims to scale the interconnection density between accelerators by enabling chipmakers to add optical pathways connecting chips on an electronic module beyond the limits of today's electrical pathways. IBM's paper outlines how these new high bandwidth density optical structures, coupled with transmitting multiple wavelengths per optical channel, have the potential to boost bandwidth between chips as much as 80 times compared to electrical connections.

IBM's innovation, as described, would enable chipmakers to add six times as many optical fibers at the edge of a silicon photonics chip, called beachfront density, compared to the current state-of-the-art CPO technology. Each fiber, about three times the width of a human hair, could span centimeters to hundreds of meters in length and transmit terabits of data per second. The IBM team assembled a high-density PWG at 50 micrometer pitch optical channels, adiabatically coupled to silicon photonics waveguides, using standard assembly packaging processes.

The paper additionally indicates that these CPO modules with PWG at 50 micrometer pitch are the first to pass all stress tests required for manufacturing. Components are subjected to high-humidity environments and temperatures ranging from -40 C to 125 C, as well as mechanical durability testing to confirm that optical interconnects can bend without breaking or losing data. Moreover, researchers have demonstrated PWG technology to an 18-micrometer pitch. Stacking four PWGs would allow for up to 128 channels for connectivity at that pitch.

IBM s continued leadership in semiconductor R&D

CPO technology enables a new pathway to meet AI's increasing performance demands, with the potential to replace off-module communications from electrical to optical. It continues IBM's history of leadership in semiconductor innovation, which also includes the first 2 nm node chip technology, the first implementation of 7 nm and 5 nm process technologies, Nanosheet transistors, vertical transistors (VTFET), single cell DRAM, and chemically amplified photoresists.

Researchers completed design, modeling, and simulation work for CPO in Albany, New York, which the U.S. Department of Commerce recently selected as the home of America's first National Semiconductor Technology Center (NSTC), the NSTC EUV Accelerator. Researchers assembled prototypes and tested modules at IBM's facility in Bromont, Quebec, one of North America's largest chip assembly and test sites. Part of the Northeast Semiconductor Corridor between the United States and Canada, IBM's Bromont fab has led the world in chip packaging for decades.

About IBM

IBM is a leadin
LINK: https://uk.newsroom.ibm.com/IBM-Brings-the-Speed-of-Light-to-the-Gener...
See more stories from ibm

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

16/10/2025

SVG Sit-Down: FUJIFILM Execs on GFX ETERNA 55 Camera, Importance of Shallow-Depth-of-Field Production

SVG Sit-Down: FUJIFILM Execs on GFX ETERNA 55 Camera, Importance of Shallow-Dept...

16/10/2025

Squash's Most Ambitious Broadcast Production To Be Deployed at Comcast Business U.S. Open

Squash's Most Ambitious Broadcast Production To Be Deployed at Comcast Busin...

16/10/2025

Main Street Sports Group Inks Deal With Omaha Productions, Launches Original-Content Division

Main Street Sports Group Inks Deal With Omaha Productions, Launches Original-Con...

16/10/2025

A Historic Precursor? FIFA, HBS, DAZN Offer an Inside Look at Production of FIFA Club World Cup 2025

A Historic Precursor? FIFA, HBS, DAZN Offer an Inside Look at Production of FIFA...

16/10/2025

Prime Video Offers Sneak Peak at New NBA on Prime Studio

Prime Video Offers Sneak Peak at New NBA on Prime StudioThe massive 13,000-sq-ft, two-story studio features a LED regulation half court and hoopBy Jason Dachman...

16/10/2025

SVG Remote Production Forum Draws Record Crowd for Visit to PGA TOUR Studios, Deep Dive Into REMI Workflows

SVG Remote Production Forum Draws Record Crowd for Visit to PGA TOUR Studios, De...

16/10/2025

BitFire's Ben Grafchik on How Growing Cloud Workflows Are Impacting the Live-Sports World

BitFire's Ben Grafchik on How Growing Cloud Workflows Are Impacting the Live...

16/10/2025

CultureCon Uncut' Video Podcast Returns for Season 2 With Host Imani Ellis

In 2017, Imani Ellis launched CultureCon, a conference that's become a must-attend event for more than 10,000 diverse creatives and Black professionals to c...

16/10/2025

Fresh Spins on Holiday Standards: The 2025 Spotify Singles Have Arrived

It might still be a little early to break out the tinsel and mistletoe, but Spotify's already queuing up some holiday magic. This year's Spotify Singles...

16/10/2025

Spotify to Publish First Independent Author Releases Through Audiobook Selects, With More Planned Ahead

Earlier this year, our in-house publishing imprint, Spotify Audiobooks, put out ...

16/10/2025

L3Harris Integrates VAMPIRE Aboard GM Defense's Infantry Squad Vehicle

VAMPIRE has been integrated onto GM Defenses Infantry Squad Vehicle (ISV), providing a mobile solution to effectively and affordably counter small drone threat...

16/10/2025

Unseen and Unmatched: L3Harris Marks a First in Infrared Tracking Technology

The AgilePod mounted on the host aircraft....

16/10/2025

Consumer attitudes toward in-car entertainment and media preferences highlighted in new Gracenote automotive report

60% say infotainment systems are a critical purchasing or leasing consideration,...

16/10/2025

Broadcasters Foundation Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign, which seeks to raise donations from tax-deductible personal and ...

16/10/2025

Roku Adds Live Sports Scores, AI-Powered Voice Discovery, New Hardware

Roku has added several new features to its user interface and operating system meant to make it easier to discover and personalize content, the company said....

16/10/2025

CNN to Launch New All Access Subscription Tier Oct. 28

NEW YORK CNN has announced that its All Access subscription tier will launch in the U.S. on Oct. 28, providing audiences with a centralized destination for CNN&...

16/10/2025

Student Spotlight: Alan Villanueva

Student Spotlight: Alan Villanueva The graduate student and saxophonist, who performed on Natalia Lafourcades Latin Grammy-nominated Live at Carnegie Hall alb...

16/10/2025

XR Sports Alliance Announces New Members

The XR Sports Alliance (XRSA) has announced the third cohort of members. The new members include Maple Leafs Sports & Entertainment (MLSE), the Vegas Golden Kni...

16/10/2025

Broadcasters Foundation of America Launches 2025 Year-End Giving Campaign

NEW YORK The Broadcasters Foundation of America has launched its 2025 Year-End Giving Campaign which seeks to raise donations from tax-deductible personal and c...

16/10/2025

Australia's Nine to Broadcast Live NHL Games

NEW YORK Australia's Nine Network and the NHL today announced a media partnership that will bring the world's premier professional ice hockey league to ...

16/10/2025

Study: 45% of U.S. Internet Households Now Watch FAST Services

Parks Associates has released new data showing that nearly half (45%) of U.S. internet homes watch free ad-supported streaming TV (FAST) services and 89% of U.S...

16/10/2025

J.D. Power: Wireless Internet Signups Soar Over Last 6 Months

TROY, Mich. -New data from J.D. Power's 2025 U.S. Residential Internet Service Provider Study shows that residential wireless internet providers are growing...

16/10/2025

Shakespeare & Hathaway: Private Investigators recommissioned for sixth series, as filming gets underway in Stratford-Upon-Avon

TV's most charming detective drama * Shakespeare & Hathaway: Private Investi...

16/10/2025

Thailand's Legendary Outlaw Returns: Tee Yai: Born to be Bad' Premieres November 13

Back to All News Thailand's Legendary Outlaw Returns: Tee Yai: Born to be ...

16/10/2025

Christmas Is Just Around The Corner: 'Home For Christmas' Season 3 is Coming to Netflix on December 12

Back to All News Christmas Is Just Around The Corner: Home For Christmas Season...

16/10/2025

Tristn Ulloa Stars in 'El crimen de Pazos', the New Netflix Series Inspired by a True Story

Back to All News Trist n Ulloa Stars in El crimen de Pazos, the New Netflix Ser...

16/10/2025

ABS Completes Redomiciliation to Dubai Development Authority as Part of Strategic Transformation

ABS Completes Redomiciliation to Dubai Development Authority as Part of Strategi...

16/10/2025

KATJA MIA ANNOUNCED AS NEW 2FM WEEKEND PRESENTER

This Saturday October 18 Katja Mia will burst onto the radio airwaves for the first time as she joins 2FM. Katja will be standing in for Bl thnaid Treacy on Sat...

16/10/2025

RT is Supporting 39 Arts and Cultural Events across Ireland this October

This October, RT is delighted to support Wexford Festival Opera, Babor International Arts Festival for Children, Open House Dublin and 36 other arts and cultu...

16/10/2025

Ready, Set, Reward - GeForce NOW Membership Rewards Await

GeForce NOW is more than just a platform to stream fresh games every week - it offers celebrations for the gamers who make it epic, with member rewards to sweet...

15/10/2025

Reporting that changes lives: Announcing the Young Journalist finalists 2025

Across the world, early-career reporters are interrogating systems that shape daily life, from mortuaries and classrooms to the corridors of legal education and...

15/10/2025

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open Video

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open VideoThe NHL franchise worked with production firms 2WEI and 4th Floor CreativeBy Mark J Burns,...

15/10/2025

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsorships

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsors...

15/10/2025

The Remaining Native Team on the Sundance Institute Labs, Community and More

By Paige Bethmann Before my grandmother passed away in 2019, I went to visit her in the hospital where she'd been for a few weeks. When I arrived, the nurs...

15/10/2025

Spotify Celebrates Two Years of Audiobooks in Premium, Fueling Growth and Discovery Across the Publishing World

Two years ago, Spotify set out to grow the entire publishing industry by making ...

15/10/2025

DJ Levels Up With Spanish-Language Requests, Text Requests, and Personalized Prompts

People turn to DJ for a listening experience that feels personal, dynamic, and j...

15/10/2025

DJ evoluciona con solicitudes en espaol, peticiones por texto y recomendaciones personalizadas

Las personas recurren a DJ para vivir una experiencia de escucha personal, din m...

15/10/2025

Bruce Springsteen and Jeremy Allen White Unite in London for an Exclusive Spotify Conversation and Film Preview

Rock legend Bruce Springsteen and luminary actor Jeremy Allen White came togethe...

15/10/2025

Meet Spotify's RADAR Creators Global Class of 2025, the Next Wave of Podcast Talent

At Spotify, we're all about supporting rising talent and helping them connec...

15/10/2025

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS On Demand

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS ...

15/10/2025

SBS celebrates the Festivals of Lights with bold, illuminating stories across the network

SBS celebrates the Festivals of Lights with bold, illuminating stories across th...

15/10/2025

Seeking Astrobiological Potential Millions of Miles from Earth

One of humanity's most profound questions continues: Is there any place in our galaxy suitable for life beyond Earth? NASA intends to find out, with the hel...

15/10/2025

Austin PBS Expands Facility-Wide Production Communications with Clear-Com

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

15/10/2025

Scality debuts industry-first AI certifications with more...

Scality, a global leader in cyber-resilient storage software for the AI era, today announced the advancement of its comprehensive AI ecosystem certification pro...

15/10/2025

2026 HPA Tech Retreat to Deliver Insight Innovation and I...

The Hollywood Professional Association (HPA) today unveiled key highlights of the 2026 HPA Tech Retreat, scheduled for Feb. 15 19 at the Westin Rancho Mirage Go...

15/10/2025

Interra Systems Drives Quality Compliance and Monetizatio...

At NAB Show New York 2025 (Stand 244), Interra Systems will showcase the future of media QC, monitoring, and captioning, highlighting its award-winning, AI- and...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transitio...

Grass Valley today announced that RMC BFM, part of the CMA-CGM Group and France's third-largest private media group, has chosen Grass Valley's productio...