
Of GTC's 900+ sessions, the most wildly popular was a conversation hosted by NVIDIA founder and CEO Jensen Huang with seven of the authors of the legendary research paper that introduced the aptly named transformer - a neural network architecture that went on to change the deep learning landscape and enable today's era of generative AI.
Everything that we're enjoying today can be traced back to that moment, Huang said to a packed room with hundreds of attendees, who heard him speak with the authors of Attention Is All You Need.
Sharing the stage for the first time, the research luminaries reflected on the factors that led to their original paper, which has been cited more than 100,000 times since it was first published and presented at the NeurIPS AI conference. They also discussed their latest projects and offered insights into future directions for the field of generative AI.
While they started as Google researchers, the collaborators are now spread across the industry, most as founders of their own AI companies.
We have a whole industry that is grateful for the work that you guys did, Huang said.
From L to R: Lukasz Kaiser, Noam Shazeer, Aidan Gomez, Jensen Huang, Llion Jones, Jakob Uszkoreit, Ashish Vaswani and Illia Polosukhin. Origins of the Transformer Model The research team initially sought to overcome the limitations of recurrent neural networks, or RNNs, which were then the state of the art for processing language data.
Noam Shazeer, cofounder and CEO of Character.AI, compared RNNs to the steam engine and transformers to the improved efficiency of internal combustion.
We could have done the industrial revolution on the steam engine, but it would just have been a pain, he said. Things went way, way better with internal combustion.
Now we're just waiting for the fusion, quipped Illia Polosukhin, cofounder of blockchain company NEAR Protocol.
The paper's title came from a realization that attention mechanisms - an element of neural networks that enable them to determine the relationship between different parts of input data - were the most critical component of their model's performance.
We had very recently started throwing bits of the model away, just to see how much worse it would get. And to our surprise it started getting better, said Llion Jones, cofounder and chief technology officer at Sakana AI.
Having a name as general as transformers spoke to the team's ambitions to build AI models that could process and transform every data type - including text, images, audio, tensors and biological data.
That North Star, it was there on day zero, and so it's been really exciting and gratifying to watch that come to fruition, said Aidan Gomez, cofounder and CEO of Cohere. We're actually seeing it happen now.
Packed house at the San Jose Convention Center. Envisioning the Road Ahead Adaptive computation, where a model adjusts how much computing power is used based on the complexity of a given problem, is a key factor the researchers see improving in future AI models.
It's really about spending the right amount of effort and ultimately energy on a given problem, said Jakob Uszkoreit, cofounder and CEO of biological software company Inceptive. You don't want to spend too much on a problem that's easy or too little on a problem that's hard.
A math problem like two plus two, for example, shouldn't be run through a trillion-parameter transformer model - it should run on a basic calculator, the group agreed.
They're also looking forward to the next generation of AI models.
I think the world needs something better than the transformer, said Gomez. I think all of us here hope it gets succeeded by something that will carry us to a new plateau of performance.
You don't want to miss these next 10 years, Huang said. Unbelievable new capabilities will be invented.
The conversation concluded with Huang presenting each researcher with a framed cover plate of the NVIDIA DGX-1 AI supercomputer, signed with the message, You transformed the world.
Jensen presents lead author Ashish Vaswani with a signed DGX-1 cover. There's still time to catch the session replay by registering for a virtual GTC pass - it's free.
To discover the latest in generative AI, watch Huang's GTC keynote address:
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
27/05/2026
Telestream has announced that its Board of Directors has appointed Benjamin Desbois as Chief Executive Officer, effective July 1, 2026. Desbois, currently Teles...
27/05/2026
ESPN garnered 10 awards; NBC's Sunday Night Football received the Outstandin...
27/05/2026
Matrox Video is celebrating its 50th anniversary, marking five decades of operations from its headquarters in Montreal, Canada. Founded in 1976, the company has...
27/05/2026
Major League Baseball has announced a series of initiatives tied to America's Semiquincentennial, including a national marketing campaign, Fourth of July br...
27/05/2026
Advanced Systems Group (ASG) has announced that Brian Gross has joined the company as an Account Manager on its Audio team, based in the Burbank office. He will...
27/05/2026
Nielsen has released new research on soccer fandom ahead of the FIFA World Cup 2...
27/05/2026
ESL FACEIT Group (EFG) has unveiled a new partnership with TikTok to bring broad...
27/05/2026
FIFA's Oscar Sanchez gives a deeper look to how this tournament will be cove...
27/05/2026
The soon-to-be senior from Charlottesville is building her skills in replay, TD, and even creative content for HokieVision and its ACC Network productions
In t...
27/05/2026
FOX Sports' Mike Davies breaks down the vision for this summer's showcas...
27/05/2026
HBS's Paul King, FIFA's Oscar Sanchez preview how the masses at home wil...
27/05/2026
FOX's MLB coverage dominated the night at the 47th Annual Sports Emmy Awards...
27/05/2026
One of the most memorable Postseasons in baseball history would have had no memo...
27/05/2026
NBC's Sunday Night Football is among the most decorated and most watched programs in the history of television. It added to its jam-packed trophy case on Tu...
27/05/2026
The 2026 Sports Emmys marked a watershed moment for Prime Video Sports. After bu...
27/05/2026
With the Opening Match just over two weeks away, the entire sports-production-te...
27/05/2026
Spotify already brings together listeners' favorite music, podcasts, and audiobooks in one place. Now, we're trialing a new format that expands the cont...
27/05/2026
The best podcast moments deserve more than just a mental note. That's why today, we're making those moments easier to save and share with clips.
Whethe...
27/05/2026
On Purpose is one of the most popular podcasts in the world, known for conversat...
27/05/2026
On May 8, 1,500 of Olivia Rodrigo's top fans gathered in Barcelona's Tea...
27/05/2026
Hybrid design combines large-diaphragm capsule & ribbon
JZ Microphones have teamed up with Grammy-winning producer and engineer Marc Urselli to develop a ne...
27/05/2026
Three new plug-ins inspired by classic tape effects
AIR Music Tech's latest release delivers a set of plug-ins that aim to capture the character, moveme...
27/05/2026
Piano played on the edge of silence
The Crow Hill Company's Vaults collection offers a continual rotation of instruments that are given away for free fo...
27/05/2026
Recreates Moog's iconic Memorymoog polysynth
Arturia's vast software instrument range offers a combination of new and old, with innovative modern so...
27/05/2026
Offers loudness levelling for speech and dialogue
Accentize have built up a solid reputation with their audio-restoration tools, and their latest plug-in is...
27/05/2026
10,000 units strong - The Rohde & Schwarz R&S M3SR Radio 4400 Rohde & Schwarz celebrates a major manufacturing milestone, producing its 10,000th R&S M3SR Radi...
27/05/2026
The XL Converge 300P radio system emerges with a groundbreaking feature set enhancing the mission-critical communications of public safety, federal and critica...
27/05/2026
Pairing Two47 MCX software with existing LTE networks means tailored system upgrades that can save time, money and lives....
27/05/2026
PAC-3 MSE offers improved range, speed, and maneuverability, making it an effect...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Star Trek VFX: Recreating John Knoll's Iconic Warp Stars without a Slitscan ...
27/05/2026
Adventure World Uses Blackmagic Replay for Marine Live
Brie Clayton May 27, 2026
0 Comments
Large screen displays and slow motion replays dynamically ...
27/05/2026
Berklee Alumna and Assistant Professor Olivia P rez-Collellmir to Premiere Origi...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Co-founder Dan Castles to transition to Executive Chair; internal promotion reinforces continuity and long-term growth
Telestream, a global leader in media wor...
27/05/2026
Big Blue Marble today announced that its Nakolos platform is the first end-to-end 5G Broadcast solution worldwide to implement the complete feature set introduc...
27/05/2026
Lightware recently hosted the Girls' Day event in April at its headquarters in Budapest, welcoming students for an interactive introduction to engineering a...
27/05/2026
27 May 2026
VEON's Kyivstar and Uklon Launch Ukraine's First Live Testi...
27/05/2026
May 27th, 2026 May 27, 2026
Press Materials Available Here
TRIBECA X Announc...
26/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
26/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
26/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...