Of GTC's 900+ sessions, the most wildly popular was a conversation hosted by NVIDIA founder and CEO Jensen Huang with seven of the authors of the legendary research paper that introduced the aptly named transformer - a neural network architecture that went on to change the deep learning landscape and enable today's era of generative AI.
Everything that we're enjoying today can be traced back to that moment, Huang said to a packed room with hundreds of attendees, who heard him speak with the authors of Attention Is All You Need.
Sharing the stage for the first time, the research luminaries reflected on the factors that led to their original paper, which has been cited more than 100,000 times since it was first published and presented at the NeurIPS AI conference. They also discussed their latest projects and offered insights into future directions for the field of generative AI.
While they started as Google researchers, the collaborators are now spread across the industry, most as founders of their own AI companies.
We have a whole industry that is grateful for the work that you guys did, Huang said.
From L to R: Lukasz Kaiser, Noam Shazeer, Aidan Gomez, Jensen Huang, Llion Jones, Jakob Uszkoreit, Ashish Vaswani and Illia Polosukhin. Origins of the Transformer Model The research team initially sought to overcome the limitations of recurrent neural networks, or RNNs, which were then the state of the art for processing language data.
Noam Shazeer, cofounder and CEO of Character.AI, compared RNNs to the steam engine and transformers to the improved efficiency of internal combustion.
We could have done the industrial revolution on the steam engine, but it would just have been a pain, he said. Things went way, way better with internal combustion.
Now we're just waiting for the fusion, quipped Illia Polosukhin, cofounder of blockchain company NEAR Protocol.
The paper's title came from a realization that attention mechanisms - an element of neural networks that enable them to determine the relationship between different parts of input data - were the most critical component of their model's performance.
We had very recently started throwing bits of the model away, just to see how much worse it would get. And to our surprise it started getting better, said Llion Jones, cofounder and chief technology officer at Sakana AI.
Having a name as general as transformers spoke to the team's ambitions to build AI models that could process and transform every data type - including text, images, audio, tensors and biological data.
That North Star, it was there on day zero, and so it's been really exciting and gratifying to watch that come to fruition, said Aidan Gomez, cofounder and CEO of Cohere. We're actually seeing it happen now.
Packed house at the San Jose Convention Center. Envisioning the Road Ahead Adaptive computation, where a model adjusts how much computing power is used based on the complexity of a given problem, is a key factor the researchers see improving in future AI models.
It's really about spending the right amount of effort and ultimately energy on a given problem, said Jakob Uszkoreit, cofounder and CEO of biological software company Inceptive. You don't want to spend too much on a problem that's easy or too little on a problem that's hard.
A math problem like two plus two, for example, shouldn't be run through a trillion-parameter transformer model - it should run on a basic calculator, the group agreed.
They're also looking forward to the next generation of AI models.
I think the world needs something better than the transformer, said Gomez. I think all of us here hope it gets succeeded by something that will carry us to a new plateau of performance.
You don't want to miss these next 10 years, Huang said. Unbelievable new capabilities will be invented.
The conversation concluded with Huang presenting each researcher with a framed cover plate of the NVIDIA DGX-1 AI supercomputer, signed with the message, You transformed the world.
Jensen presents lead author Ashish Vaswani with a signed DGX-1 cover. There's still time to catch the session replay by registering for a virtual GTC pass - it's free.
To discover the latest in generative AI, watch Huang's GTC keynote address:
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
09/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/10/2026
September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026
New Sports Intelligence helps providers better unders...
08/10/2026
Modern venues have come a long way since the tinny, echoing audio of the mid 20t...
08/10/2026
ESPN's first Super Bowl production will stream in English and Spanish on Disney+, while the ESPN App carries the full slate of game, ManningCast, studio, an...
08/10/2026
From high-school videoboards to War Eagle Productions, the Opelika native is learning how to lead shows and capture big moments
The future of live sports produ...
08/10/2026
The Television Academy and Prime Video have announced a six-year agreement making Prime Video the exclusive global home of the Emmy Awards beginning with the 20...
08/10/2026
Techex will exhibit at NAB Show New York 2026 (Booth 623, Javits Center, October...
08/10/2026
X Games has announced the appointment of Steve Rogers as Chief Operating Officer. Rogers previously served as COO of World Supercross and spent nearly a decade ...
08/10/2026
Fonn Group has appointed Trevor Spielmann as Sales Director for Germany, Austria, and Switzerland. Spielmann joins from EVS, where he held sales and business de...
08/10/2026
The flagship program will originate from major PG events with a four-camera production, live distribution across PGTV, social platforms
Perfect Game is bringin...
08/10/2026
Innovation rarely happens in a vacuum. More often, it happens at the point of collision: when worlds that have run on separate tracks begin to converge. That is...
08/10/2026
For decades, the production and broadcast services business has run on a familia...
08/10/2026
Uplynk, Zixi, BroadView Software, and Grass Valley have published The IP Converg...
08/10/2026
The NFL has announced the return of the Big Data Bowl, the league's analytics competition, now in its ninth year and again powered by AWS. Registration is o...
08/10/2026
Eutelsat has renewed its partnership with T l diffusion d'Alg rie (TDA), Algeria's national broadcasting network operator, for continued distribution of...
08/10/2026
Disney will livestream Super Bowl LXI on February 14, 2027, alongside the game's broadcast on ESPN and ABC. All Disney subscribers in the United States wi...
08/10/2026
RHStv and Red House Streaming have announced an expansion of their partnership w...
08/10/2026
Gray Media has announced a distribution agreement with TEGNA and DAZN to simulca...
08/10/2026
SVG readers can save 10% on registration and receive a complimentary Solutions H...
08/10/2026
PROTON Camera Innovations GmbH has been named a recipient of a 2026 Technology a...
08/10/2026
Industry leaders discuss real-world cloud workflows for live game production, pl...
08/10/2026
The next-gen audio technology joins Dolby Vision as part of Apple TV's immersive F1 experience...
08/10/2026
David France, Jesse Short Bull, Mato Wayuhi, N. Bird Runningwater, Jodi Archambau, Jhane Myers, Paul McGuire, Amber Morning Star Byars, Holly Macarro, Nick Tils...
08/10/2026
Dynamic panning plug-ins get an upgrade
Sound Particles have just announced major updates for two of their popular dynamic panning plug-ins. Energy Panner 2...
08/10/2026
New expandable instrument boasts full DMNO engine
UDO Audio have just announced the upcoming release of a new, expandable synth that packs the power of the ...
08/10/2026
Two new subwoofers added to monitoring line-up
ADAM Audio's monitoring range has just been expanded with two new DSP-equipped subwoofers, the Sub8 PRO a...
08/10/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
08/10/2026
Calrec gives broadcasters freedom of choice at NAB Show New York We're looking forward to meeting up with you all at NAB New York on 21st-22nd October.
Cal...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Globecast, a leading provider of broadcast, media and entertainment managed services, will showcase its next generation of media orchestration services at NAB S...
08/10/2026
Clear-Com played a critical role in the production communications infrastructure for Rock in Rio 2026, one of the world's largest and most recognized music...
08/10/2026
Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Crea...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Ikegami announces a major expansion to its range of broadcast-quality live production cameras. Scheduled for introduction on Ikegami booth 708 at NAB New York, ...
08/10/2026
Calrec will be located at Booth 444.
Freedom to choose
The media landscape is evolving quickly, and the broadcasters best placed for what comes next will be...
08/10/2026
LiveU has announced that CRD Audiovisuel relied on LiveUs LU900Q intelligent production unit, with built-in native LiveU IQ (LIQ ) connectivity, to deliver live...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/10/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
Of GTC's 900+ sessions, the most wildly popular was a conversation hosted by NVIDIA founder and CEO Jensen Huang with seven of the authors of the legendary research paper that introduced the aptly named transformer - a neural network architecture that went on to change the deep learning landscape and enable today's era of generative AI.
