Like old friends catching up over coffee, two industry icons reflected on how modern AI got its start, where it's at today and where it needs to go next.
Jensen Huang, founder and CEO of NVIDIA, interviewed AI pioneer Ilya Sutskever in a fireside chat at GTC. The talk was recorded a day after the launch of GPT-4, the most powerful AI model to date from OpenAI, the research company Sutskever co-founded.
They talked at length about GPT-4 and its forerunners, including ChatGPT. That generative AI model, though only a few months old, is already the most popular computer application in history.
Their conversation touched on the capabilities, limits and inner workings of the deep neural networks that are capturing the imaginations of hundreds of millions of users.
Compared to ChatGPT, GPT-4 marks a pretty substantial improvement across many dimensions, said Sutskever, noting the new model can read images as well as text.
In some future version, [users] might get a diagram back in response to a query, he said.
Under the Hood With GPT There's a misunderstanding that ChatGPT is one large language model, but there's a system around it, said Huang.
In a sign of that complexity, Sutskever said OpenAI uses two levels of training.
The first stage focuses on accurately predicting the next word in a series. Here, what the neural net learns is some representation of the process that produced the text, and that's a projection of the world, he said.
The second is where we communicate to the neural network what we want, including guardrails so it becomes more reliable and precise, he added.
Present at the Creation While he's at the swirling center of modern AI today, Sutskever was also present at its creation.
In 2012, he was among the first to show the power of deep neural networks trained on massive datasets. In an academic contest, the AlexNet model he demonstrated with AI pioneers Geoff Hinton and Alex Krizhevsky recognized images faster than a human could.
Huang referred to their work as the Big Bang of AI.
The results broke the record by such a large margin, it was clear there was a discontinuity here, Huang said.
The Power of Parallel Processing Part of that breakthrough came from the parallel processing the team applied to its model with GPUs.
The ImageNet dataset and a convolutional neural network were a great fit for GPUs that made it unbelievably fast to train something unprecedented, Sutskever said.
That early work ran on a few GeForce GTX 580 GPUs in a University of Toronto lab. Today, tens of thousands of the latest NVIDIA A100 and H100 Tensor Core GPUs in the Microsoft Azure cloud service handle training and inference on models like ChatGPT.
In the 10 years we've known each other, the models you've trained [have grown by] about a million times, Huang said. No one in computer science would have believed the computation done in that time would be a million times larger.
I had a very strong belief that bigger is better, and a goal at OpenAI was to scale, said Sutskever.
A Billion Words Along the way, the two shared a laugh.
Humans hear a billion words in a lifetime, Sutskever said.
Does that include the words in my own head, Huang shot back.
Make it 2 billion, Sutskever deadpanned.
The Future of AI They ended their nearly hour-long talk discussing the outlook for AI.
Asked if GPT-4 has reasoning capabilities, Sutskever suggested the term is hard to define and the capability may still be on the horizon.
We'll keep seeing systems that astound us with what they can do, he said. The frontier is in reliability, getting to a point where we can trust what it can do, and that if it doesn't know something, it says so, he added.
Your body of work is incredible truly remarkable, said Huang in closing the session. This has been one of the best beyond Ph.D. descriptions of the state of the art of large language models, he said.
To get all the news from GTC, watch the keynote below.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
30/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/05/2026
Zero in on one that says yes (and no)
Andy Marken May 29, 2026
0 Comments
Hero image courtesy of Deposit Photos
For content creators the most difficu...
29/05/2026
With InfoComm 2026 just weeks away, NDI is giving attendees plenty of reasons to...
29/05/2026
Reaffirming a partnership that has defined Canadian sports broadcasting since 19...
29/05/2026
Mobile/tablet is No. 2 device for watching TV, suggesting that the sports-production industry needs to take another look at the format
Ring Digital's Sprin...
29/05/2026
Berliner Ensemble, one of Berlin's five major theater companies, has expande...
29/05/2026
Solid State Logic will showcase its new compact, fly-away TCA Tour audio product...
29/05/2026
Gerald (Jerry) Pierce, a pioneering technologist who helped shape the digital transformation of the motion picture industry, passed away last month on April 12 ...
29/05/2026
Paramount+ will be the English-language U.S. home for Barclays Women's Super...
29/05/2026
Further strengthening its virtualisation strategy to fully support broadcasters ...
29/05/2026
Swiss broadcaster Canal Alpha has deployed Harmonic's award-winning, software-based XOS Advanced Media Processor to modernize playout operations across cant...
29/05/2026
PTZOptics will showcase a new generation of intelligent video workflows at InfoComm 2026, June 17-19, Las Vegas. Visitors to booth N8227 will see how PTZOptics ...
29/05/2026
Arizona's Family has launched the Arizona's Family Sports (AZFS) streaming app, a new direct-to-consumer destination for live, local sports. The app is ...
29/05/2026
Starting in 2027, DAZN will be the exclusive home of The Canadian Football Leagu...
29/05/2026
Comcast Business has detailed the advanced network infrastructure it has deploye...
29/05/2026
In two-day event, leaders from academia and industry explored solutions to chall...
29/05/2026
The Basketball Tournament (TBT), now entering their 13th year of competition, ha...
29/05/2026
Roku has launched FOX One as a Premium Subscription on The Roku Channel in the U.S. Roku customers can now subscribe to FOX One using their Roku account for liv...
29/05/2026
In its sixth year, the broadcaster's coverage has become a global brand and ...
29/05/2026
Ratings Roundup is a rundown of recent ratings news and is derived from press re...
29/05/2026
The days are getting longer, the temperatures are rising, and playlists are filling up for the season. With summer around the corner, Spotify's global edito...
29/05/2026
New retro-inspired MPC announced
There are few devices that have gained the status held by Akai Pro's MPC range, and in recent years, the company have s...
29/05/2026
Save up to 30 on acclaimed titles
Following a successful launch at Superbooth 2026, Bjooks have revealed that they will be continuing the Kickstarter campa...
29/05/2026
Binaural monitoring application improved
Genelec have just released an update that brings some powerful new features to their HRTF-based binaural headphone ...
29/05/2026
6 June 2026 at SAE Institute, London, UK
IMSTA FESTA 2026 is almost upon us, with some of the biggest names in pro-audio set to descend upon SAE Institute i...
29/05/2026
Gerald (Jerry) Pierce, a pioneering technologist who helped shape the digital transformation of the motion picture industry, died April 12, 2026, at his home in...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Comparing 5 AI Video Enhancers for Restoring Old Video Quality
Kate Luvis May 29, 2026
0 Comments
Digitizing VHS, MiniDV, and other legacy formats doe...
29/05/2026
Studio Hamburg Builds New Post Pipeline with DaVinci Resolve Studio
Brie Clayton May 29, 2026
0 Comments
Workflow replaces a patchwork of legacy tools...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/05/2026
At the Intersection of Music and Dance, an Epic Collaboration Boston Conservatory musicians and dancers found creative parallels in their recent performance o...
29/05/2026
May 29 2026, 09:00 (PDT) Dolby and rednote Bring More Immersive Storytelling to...
29/05/2026
Something fundamental has shifted in how people consume media. Audiences aren't abandoning television or radio content; they're just expanding how, wher...
29/05/2026
Youtube exclusive special drops today
Watch now
UKTV today announces another e...
29/05/2026
Back to All News
The Official Trailer of Physical 100 Italy, on Netflix From Se...
29/05/2026
Genelec announces V2.1 for Aural ID binaural headphone monitoring application posted: 29/05/2026
Aural ID 2.1 enhances binaural monitoring for stereo and ...
29/05/2026
At just 20 years old, Sean Melia from Summerhill Co. Meath has been revealed as the winner of Super Garden 2026. Sean is the youngest ever contestant and winner...
Like old friends catching up over coffee, two industry icons reflected on how modern AI got its start, where it's at today and where it needs to go next.
