It could only happen in NVIDIA Omniverse - the company's virtual world simulation and collaboration platform for 3D workflows.
And it happened during an interview with a virtual toy model of NVIDIA's CEO, Jensen Huang.
What are the greatest one of Toy Jensen's creators asked, stumbling, then stopping before completing his scripted question.
Unfazed, the tiny Toy Jensen paused for a moment, considering the answer carefully.
The greatest are those, Toy Jensen replied, who are kind to others.
Leading-edge computer graphics, physics simulation, a live CEO, and a supporting cast of AI-powered avatars came together to make NVIDIA's GTC keynote - delivered using Omniverse - possible.
Along the way, a little soul got into the mix, too.
The AI-driven comments, added to the keynote as a stinger, provided an unexpected peek at the depth of Omniverse's technology.
Omniverse is the hub in which all the various research domains converge and align and work in unison, says Kevin Margo, a member of NVIDIA's creative team who put the presentation together. Omniverse facilitates the convergence of all of them.
Toy Jensen's ad-lib capped a presentation that seamlessly mixed a real CEO with virtual and real environments as Huang took viewers on a tour of how NVIDIA technologies are weaving AI, graphics and robotics together with humans in real and virtual worlds.
Real CEO, Digital Kitchen While the CEO viewers saw was all real, the environment around him morphed as he spoke to support the story he was telling.
Viewers saw Huang deliver a keynote that seemed to begin, like so many during the global COVID pandemic, in Huang's kitchen.
Then, with a flourish, Huang's kitchen - modeled down to the screws holding its cabinets together - slid away from sight as Huang strolled toward a virtual recreation of Endeavor's gleaming lobby.
One of our goals is to find a way to elevate our keynote events, Margo says. We're always looking for those special moments when we can do something novel and fantastical, and that showcase NVIDIA's latest technological innovations.
It was the start of a visual journey that would take Huang from that lobby to Shannon's, a gathering spot inside Endeavor, through a holodeck, and a data center with stops inside a real robotics lab and the exterior of Endeavor.
Virtual environments such as Huang's kitchen were created by a team using familiar tools supported by Omniverse such as Autodesk Maya and 3ds Max, and Adobe Substance Painter.
Omniverse served to connect them all in real-time - so each team member could see changes made by colleagues using different tools simultaneously, accelerating their work.
That was critical, Margo says.
The virtual and the real came together quickly once live filming began.
A small on-site video team recorded Huang's speech in just four days, starting October 30, in a spare pair of conference rooms at NVIDIA's Silicon Valley headquarters.
Omniverse allowed NVIDIA's team to project the dynamic virtual environments their colleagues had created on a screen behind Huang.
As a result, the light spill onto Huang changed as the scene around him changed, better integrating him into the virtual environment.
And as Huang moved through the scene, or as the camera shifted, the environment changed around Huang.
As the camera moves, the perspective and parallax of the world on the video wall responds accordingly, Mago says.
And because Huang could see the environment projected on the screens around him, he was better able to navigate each scene.
At the Speed of Omniverse All of this accelerated the work of NVIDIA's production team, which had most of what they needed in-camera after each shot rather than adding elaborate digital sets in post-production.
As a result, the video team quickly created a presentation seamlessly blending a real CEO with virtual and real-world settings.
However, Omniverse was more than just a way to speed collaboration between creatives working with real and digital elements hustling to hit a deadline. It also served as the platform that knit the string of demos featured in the keynote together.
To help developers create intelligent, interactive agents with Omniverse that can see, speak, converse on a wide range of subjects and understand naturally spoken intent, Huang announced Omniverse Avatar.
Omniverse brings together a deep stack of technologies - from ray-tracing to recommender systems - that were mixed and matched throughout the keynote to drive a series of stunning demos.
In a demo that swiftly made headlines, Huang showed how Project Tokkio for Omniverse Avatar connects Metropolis computer vision, Riva speech AI, avatar animation and graphics into a real-time conversational AI robot - the Toy Jensen Omniverse Avatar.
The conversation between three of NVIDIA's engineers and a tiny toy model of Huang was more than just a technological tour de force, demonstrating expert, natural Q&A.
It showed how photorealistic modeling of Toy Jensen and his environment - right down to the glint on Toy Jensen's glasses as he moved his head - and NVIDIA's Riva speech synthesis technology powered by the Megatron 530B large language model could support natural, fluid conversations.
To create the demo, NVIDIA's creative team created the digital model in Maya Substance, and Omniverse did the rest.
None of it was manual, you just load up the animation assets and talk to it, he said.
Huang also showed a second demo of Project Tokkio, a customer-service avatar in a restaurant kiosk that was able to see, converse with and understand two customers.
Rather than relying on Megatron, however, this model relied on a model that integrated the restaurant's menu, allowing the avatar to smoothly guide customers through their op
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
06/05/2024
OAKVILLE, Ontario As part of Emergency Preparedness Week, Alert Ready, Canadas national public alerting system, will be distributing a test alert to Canadians i...
06/05/2024
NEW ROCHELLE, N.Y. Horowitz Research has released a new study on the viewing and media habits of U.S. Hispanic/Latine audiences that shows a dramatic decline in...
06/05/2024
RE:Vision Effects Autograph 2024.4 released! 50% Off Through May 9th
Brie Clayton May 6, 2024
0 Comments
New game-changing motion graphics & VFX featu...
06/05/2024
NBC has renewed Night Court for a third season. The courtroom comedy was on the network from 1984 to 1992, and NBC rebooted it in early 2023....
06/05/2024
ABC has revealed its summer schedule. The Bachelorette gets going Monday, July 8, with Jenn Tran the star in season 21. Celebrity Family Feud starts up Tuesday,...
06/05/2024
It's almost go-time for the Holly Springs Salamanders! The season opener is ...
06/05/2024
Tyngsboro, Mass. - May 6, 2024 - Join us at InfoComm 2024 to experience the latest advancements in live production technology. From June 12-14, 2024, at the Las...
06/05/2024
To champion global movements to protect and advance equality for LGBTQ+ communities, Apple is introducing a new Apple Watch Pride Edition Braided Solo Loop, ava...
06/05/2024
Actress Matseliso Mohale has joined Muvhango'Talented actress Matseliso Mohale has joined SABC2's soapie Muvhango' as Vhangani's lover and a c...
06/05/2024
Tonight on Smoke and Mirrors: Leroy refuses to give up fighting to bury MthethoDon't miss Monday, 6 May's riveting episode of South African soapie Smoke...
06/05/2024
Intrinsic, a software and AI robotics company at Alphabet, has integrated NVIDIA AI and Isaac platform technologies to advance the complex field of autonomous r...
06/05/2024
Cybersecurity experts at the RSA Conference this week will be on the hunt for ways to secure their operations in the era of generative AI.
They'll find man...
06/05/2024
1) What is the rationale of the transaction? What is the benefit for SES shareholders?
This combination creates a stronger and more competitive multi-orbit ope...
05/05/2024
A special evening performance by multiplatinum singer Becky G will provide a memorable conclusion to TeievisaUnivision's Casa Cultura upfront event on May 1...
05/05/2024
Giant media buyer Publicis is telling network sales executives that it does not think Nielsen's new panel-plus-big-data currency is ready for this upfront....
05/05/2024
WASHINGTON Glenn Kirschner, legal analyst at NBC News, blasted the media for referring to the New York trial of former President Donald Trump as a hush-money ...
05/05/2024
Catchy Comedy's weekend marathon sees The Beverly Hillbillies on the weekend of May 4-5. The event kicks off Saturday, May 4 at 11 a.m. ET, and runs through...
05/05/2024
NBC Sports has the 150th Kentucky Derby Saturday, May 4. The coverage begins at 2:30 p.m. ET on NBC and Peacock and the feature race at Churchill Downs in Louis...
04/05/2024
NEW YORK As the Asian Pacific American Heritage Month kicks off in May, Nielsen has released an extensive new report diving into their media habits with data sh...
04/05/2024
PHILADELPHIA As National Military Appreciation Month gets underway, Comcast has announced several new initiatives to help veterans, service members, and their f...
04/05/2024
WASHINGTON, D.C. Federal Communications Commission chairwoman Jessica Rosenworcel has announced a tentative agenda for the May Open Commission Meeting scheduled...
04/05/2024
The Broadband Forum has announced major enhancements to key 5G convergence standards that the group said will help advance next-generation applications, improve...
04/05/2024
Spotify Wrapped Campaign Spot Graded With DaVinci Resolve Studio
Brie Clayton May 3, 2024
0 Comments
Blackmagic Design today announced that Colorist M...
04/05/2024
Three Boston Conservatory at Berklee Alums Nominated for Tony Awards An additional eight alums and two current students performed in nominated productions.
...
04/05/2024
New faces and new storylines': What to expect on Izingane ZeS'thembu...
03/05/2024
An innovative learning tool to help media and civil society better understand ho...
03/05/2024
PARK CITY, UTAH - JANUARY 21: (L-R) Actors K stutis Cic nas and Greta Grinevi i t , Director Marija Kavtaradze and Producer Marija Razgute attend the 2023 Sunda...
03/05/2024
If you aren't familiar with Danny Ocean's music, it's only a matter ...
03/05/2024
Spotify has an unwavering commitment to supporting emerging artists across all genres, to helping them launch and thrive in their careers, and to connecting the...
03/05/2024
Como uno de los sonidos de mayor expansi n en el mundo, la M sica Mexicana va m ...
03/05/2024
As one of the fastest-growing sounds worldwide, M sica Mexicana is more than jus...
03/05/2024
NEW YORK FuboTV reported that it lost 110,000 subs in Q1 2024 but it exceeded its guidance for the quarter with double digit year-over-year increases across key...
03/05/2024
Only 3 Weeks Left To Enter The Creative Industries Most Award
Brie Clayton May 3, 2024
0 Comments
Creativepool is giving a last call to the creative i...
03/05/2024
WePlay Studios Transforms the Future of Live Event Storytelling with AJA Gear
Brie Clayton May 3, 2024
0 Comments
By 2032, the esports market is expec...
03/05/2024
WASHINGTON Shannon Bream, Fox News Sunday anchor and chief legal correspondent, sat for a keynote chat at The Business of TV News, with Tom Umstead, senior co...
03/05/2024
WASHINGTON Asked how important is local news, Martha Raddatz, who has covered foreign conflicts for decades and moderated presidential debates for ABC News, s...
03/05/2024
Sony Pictures and Apollo Global Management have made a $26 billion cash offer fo...
03/05/2024
CBS announced its 2024-2025 primetime schedule, which features the new dramas NCIS: Origins, Matlock and Watson, and new comedies Poppa's House and Georgie ...
03/05/2024
Sports-focused streaming service Fubo said it reduced its red ink in the first quarter, despite losing 110,000 subscribers since the end of the year....
03/05/2024
Walmart is reportedly about to release a new 4K streaming box/smart speaker hybrid device for Google TV that could retail for as low as $50, according to a repo...
03/05/2024
Enhancements to its Delivery Workspace solution provide increased content delivery robustness and security
By Matthew Corrigan
Published: May 3, 2024
Enha...
03/05/2024
According to reports, if the bid is successful, Sony would be the significant majority shareholder of the new private company
By Jenny Priestley
Published: M...
03/05/2024
Located in Manchesters Spinningfields district, the course aims to equip students with the skills, knowledge and industry insight for a career in the creative s...
03/05/2024
Lightbridge has created a new Cine Reflect Lighting System kit, dedicated to enabling artistic lighting with consideration of today's productivity practical...
03/05/2024
Broadcast media systems integrator BeckTV and Lawo worked together on a large-scale AES67 build of radio control rooms at KPBS, San Diego's NPR and PBS memb...
03/05/2024
Raleigh, NC, April 12, 2024 SmallHD announces PageOS 6, a powerful software update free for owners of SmallHD monitors, featuring increased functionality, exp...
03/05/2024
SmallHD announces the Quantum 32 a new 31.5 OLED monitor designed to provide reference HDR/SDR images for post-production final color grading, as well as cri...
It could only happen in NVIDIA Omniverse - the company's virtual world simulation and collaboration platform for 3D workflows.
