
Of GTC's 900+ sessions, the most wildly popular was a conversation hosted by NVIDIA founder and CEO Jensen Huang with seven of the authors of the legendary research paper that introduced the aptly named transformer - a neural network architecture that went on to change the deep learning landscape and enable today's era of generative AI.
Everything that we're enjoying today can be traced back to that moment, Huang said to a packed room with hundreds of attendees, who heard him speak with the authors of Attention Is All You Need.
Sharing the stage for the first time, the research luminaries reflected on the factors that led to their original paper, which has been cited more than 100,000 times since it was first published and presented at the NeurIPS AI conference. They also discussed their latest projects and offered insights into future directions for the field of generative AI.
While they started as Google researchers, the collaborators are now spread across the industry, most as founders of their own AI companies.
We have a whole industry that is grateful for the work that you guys did, Huang said.
From L to R: Lukasz Kaiser, Noam Shazeer, Aidan Gomez, Jensen Huang, Llion Jones, Jakob Uszkoreit, Ashish Vaswani and Illia Polosukhin. Origins of the Transformer Model The research team initially sought to overcome the limitations of recurrent neural networks, or RNNs, which were then the state of the art for processing language data.
Noam Shazeer, cofounder and CEO of Character.AI, compared RNNs to the steam engine and transformers to the improved efficiency of internal combustion.
We could have done the industrial revolution on the steam engine, but it would just have been a pain, he said. Things went way, way better with internal combustion.
Now we're just waiting for the fusion, quipped Illia Polosukhin, cofounder of blockchain company NEAR Protocol.
The paper's title came from a realization that attention mechanisms - an element of neural networks that enable them to determine the relationship between different parts of input data - were the most critical component of their model's performance.
We had very recently started throwing bits of the model away, just to see how much worse it would get. And to our surprise it started getting better, said Llion Jones, cofounder and chief technology officer at Sakana AI.
Having a name as general as transformers spoke to the team's ambitions to build AI models that could process and transform every data type - including text, images, audio, tensors and biological data.
That North Star, it was there on day zero, and so it's been really exciting and gratifying to watch that come to fruition, said Aidan Gomez, cofounder and CEO of Cohere. We're actually seeing it happen now.
Packed house at the San Jose Convention Center. Envisioning the Road Ahead Adaptive computation, where a model adjusts how much computing power is used based on the complexity of a given problem, is a key factor the researchers see improving in future AI models.
It's really about spending the right amount of effort and ultimately energy on a given problem, said Jakob Uszkoreit, cofounder and CEO of biological software company Inceptive. You don't want to spend too much on a problem that's easy or too little on a problem that's hard.
A math problem like two plus two, for example, shouldn't be run through a trillion-parameter transformer model - it should run on a basic calculator, the group agreed.
They're also looking forward to the next generation of AI models.
I think the world needs something better than the transformer, said Gomez. I think all of us here hope it gets succeeded by something that will carry us to a new plateau of performance.
You don't want to miss these next 10 years, Huang said. Unbelievable new capabilities will be invented.
The conversation concluded with Huang presenting each researcher with a framed cover plate of the NVIDIA DGX-1 AI supercomputer, signed with the message, You transformed the world.
Jensen presents lead author Ashish Vaswani with a signed DGX-1 cover. There's still time to catch the session replay by registering for a virtual GTC pass - it's free.
To discover the latest in generative AI, watch Huang's GTC keynote address:
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
02/05/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
17/04/2026
The World Fencing League (WFL) has announced DAZN as its primary global streamin...
17/04/2026
ARRI Releases ALEXA 35 SUP 6.0 and LPS-1 SUP 1.3 Software Updates
ARRI has announced software updates for its ALEXA 35 Live camera and Live Production System L...
17/04/2026
Sennheiser has announced Spectera Studio, an offline system planner for its Spec...
17/04/2026
Deltatre and the German Football Association (DFB) have announced DFB.TV+, a DFB-owned direct-to-consumer streaming service developed and operated by Deltatre. ...
17/04/2026
Global sports marketing agency IMG has announced new senior leadership roles, designed to strengthen how it supports rightsholders and partners in the midst of ...
17/04/2026
NAGRAVISION and Harmonic have announced a watermarking-as-a-service solution for...
17/04/2026
NETGEAR and EVS Broadcast Equipment have announced a global technology partnersh...
17/04/2026
America's broadcasters are launching the NEXTGEN TV Converter Box Program, a new initiative designed to provide millions of American viewers with a low-cost...
17/04/2026
Quantum Corp. will exhibit at NAB Show 2026 (Booth N1726), presenting what it ca...
17/04/2026
Leadership and Staff Announce '20/20 Vision' Playbook...
17/04/2026
TNT Sports has announced a multi-year agreement for U.S. media rights to the FIA World Endurance Championship (WEC). Three events will air on truTV - the 24 Hou...
17/04/2026
Scripps Sports has announced a multi-year broadcast partnership with PBR (Profes...
17/04/2026
Adder Technology, a specialist in connectivity solutions and high performance IP KVM, today announced the latest release of AIM, its IP KVM matrix management so...
17/04/2026
Victory , a free sports streaming platform from A Parent Media Co. Inc. (APMC), has announced a multi-year content distribution partnership with the Dallas Cowb...
17/04/2026
In-venue and creative video staffers at the professional and collegiate level have one major thing in common: the intensity and attention to detail ramps up dur...
17/04/2026
Quickplay has announced the full-scale deployment of Gray Media's streaming ...
17/04/2026
Clear-Com has introduced the FreeSpeak Cell cellular-based wireless intercom system that uses LTE and 5G infrastructure to support large-scale production commun...
17/04/2026
The 2026 NAB Show kicks off Saturday, April 18, with the show floor and exhibits opening April 19-22 at the Las Vegas Convention Center. The show features more ...
17/04/2026
Ratings Roundup is a rundown of recent rating news and is derived from press rel...
17/04/2026
Versatile ribbon mic kit revealed
The latest arrival to the AEA line-up brings together three contrasting models from their Nuvo range, delivering a versati...
17/04/2026
Revealed following sold-out MPG Awards ceremony
Following another sold-out MPG Awards ceremony at The Troxy in London, the MPG have released a full list of ...
17/04/2026
L3Harris towed array systems provide U.S. Navy submarines with extended acoustic...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Cobalt Digital and SineSix Media Partner to Transform Accessibility Compliance into a More Engaging Viewer Experience at NAB Show 2026
Collaboration integrates...
17/04/2026
Strengthening Appear's North America team with a new Vice President of Business Development
Appear ASA (Appear, OSE: APR), a global leader in live producti...
17/04/2026
New framework helps broadcasters, streaming platforms, and sports organizations apply AI to live video for monetization, metadata, highlights, and downstream wo...
17/04/2026
New whitepaper gives broadcasters and OTT operators independent, codec-by-codec evidence that the VisualOn Optimizer transforms viewer quality of experience.
V...
17/04/2026
Blackmagic Design Announces New Blackmagic URSA Cine Immersive 100G
Brie Clayton April 17, 2026
0 Comments
World's first immersive cinema camera f...
17/04/2026
NAB 2026: Vubiquity and Eluvio Showcase Streaming Solution that Significantly Re...
17/04/2026
What Makes a Good Marathon Running Playlist? We asked Xander Dawson, an eighth-semester saxophone major at Boston Conservatory running the Boston Marathon thi...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
At NAB Show 2026, PTZOptics (Booth N1902) will showcase a live sports streaming demo created in collaboration with Moondream, offering a new look at how Visual ...
17/04/2026
The Eindhoven University of Technology is a research university in the Netherlands spanning 25 buildings, specialising in engineering, science and technology. D...
17/04/2026
Documentary Editor - US, Remote
Brie Clayton April 17, 2026
0 Comments
Documentary Editor
April 13, 2026Freelance Video Cameraman - Los......
17/04/2026
Blackmagic Design Announces New Blackmagic URSA Cine 12K LF 100G
Brie Clayton April 17, 2026
0 Comments
Revolutionary digital film camera brings cinem...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
17/04/2026
Dubformer, the AI-powered dubbing platform, and Adapt, a global leader in AI-driven localization and dubbing solutions, have enabled Goalcast, the inspirational...