
Fasten your seatbelts. NVIDIA Research is revving up a new deep learning engine that creates 3D object models from standard 2D images - and can bring iconic cars like the Knight Rider's AI-powered KITT to life - in NVIDIA Omniverse.
Developed by the NVIDIA AI Research Lab in Toronto, the GANverse3D application inflates flat images into realistic 3D models that can be visualized and controlled in virtual environments. This capability could help architects, creators, game developers and designers easily add new objects to their mockups without needing expertise in 3D modeling, or a large budget to spend on renderings.
A single photo of a car, for example, could be turned into a 3D model that can drive around a virtual scene, complete with realistic headlights, tail lights and blinkers.
To generate a dataset for training, the researchers harnessed a generative adversarial network, or GAN, to synthesize images depicting the same object from multiple viewpoints - like a photographer who walks around a parked vehicle, taking shots from different angles. These multi-view images were plugged into a rendering framework for inverse graphics, the process of inferring 3D mesh models from 2D images.
Once trained on multi-view images, GANverse3D needs only a single 2D image to predict a 3D mesh model. This model can be used with a 3D neural renderer that gives developers control to customize objects and swap out backgrounds.
When imported as an extension in the NVIDIA Omniverse platform and run on NVIDIA RTX GPUs, GANverse3D can be used to recreate any 2D image into 3D - like the beloved crime-fighting car KITT, from the popular 1980s Knight Rider TV show.
Previous models for inverse graphics have relied on 3D shapes as training data.
Instead, with no aid from 3D assets, We turned a GAN model into a very efficient data generator so we can create 3D objects from any 2D image on the web, said Wenzheng Chen, research scientist at NVIDIA and lead author on the project.
Because we trained on real images instead of the typical pipeline, which relies on synthetic data, the AI model generalizes better to real-world applications, said NVIDIA researcher Jun Gao, an author on the project.
The research behind GANverse3D will be presented at two upcoming conferences: the International Conference on Learning Representations in May, and the Conference on Computer Vision and Pattern Recognition, in June.
From Flat Tire to Racing KITT Creators in gaming, architecture and design rely on virtual environments like the NVIDIA Omniverse simulation and collaboration platform to test out new ideas and visualize prototypes before creating their final products. With Omniverse Connectors, developers can use their preferred 3D applications in Omniverse to simulate complex virtual worlds with real-time ray tracing.
But not every creator has the time and resources to create 3D models of every object they sketch. The cost of capturing the number of multi-view images necessary to render a showroom's worth of cars, or a street's worth of buildings, can be prohibitive.
That's where a trained GANverse3D application can be used to convert standard images of a car, a building or even a horse into a 3D figure that can be customized and animated in Omniverse.
To recreate KITT, the researchers simply fed the trained model an image of the car, letting GANverse3D predict a corresponding 3D textured mesh, as well as different parts of the vehicle such as wheels and headlights. They then used NVIDIA Omniverse Kit and NVIDIA PhysX tools to convert the predicted texture into high-quality materials that give KITT a more realistic look and feel, and placed it in a dynamic driving sequence.
Omniverse allows researchers to bring exciting, cutting-edge research directly to creators and end users, said Jean-Francois Lafleche, deep learning engineer at NVIDIA. Offering GANverse3D as an extension in Omniverse will help artists create richer virtual worlds for game development, city planning or even training new machine learning models.
GANs Power a Dimensional Shift Because real-world datasets that capture the same object from different angles are rare, most AI tools that convert images from 2D to 3D are trained using synthetic 3D datasets like ShapeNet.
To obtain multi-view images from real-world data - like images of cars available publicly on the web - the NVIDIA researchers instead turned to a GAN model, manipulating its neural network layers to turn it into a data generator.
The team found that opening the first four layers of the neural network and freezing the remaining 12 caused the GAN to render images of the same object from different viewpoints.
Keeping the first four layers frozen and the other 12 layers variable caused the neural network to generate different images from the same viewpoint. By manually assigning standard viewpoints, with vehicles pictured at a specific elevation and camera distance, the researchers could rapidly generate a multi-view dataset from individual 2D images.
The final model, trained on 55,000 car images generated by the GAN, outperformed an inverse graphics network trained on the popular Pascal3D dataset.
Read the full ICLR paper, authored by Wenzheng Chen, fellow NVIDIA researchers Jun Gao and Huan Ling, Sanja Fidler, director of NVIDIA's Toronto research lab, University of Waterloo student Yuxuan Zhang, Stanford student Yinan Zhang and MIT professor Antonio Torralba. Additional collaborators on the CVPR paper include Jean-Francois Lafleche, NVIDIA researcher Kangxue Yin and Adela Barriuso.
The NVIDIA Research team consists of more than 200 scientists around the globe, focusing on areas such as AI, computer vision, self-driving cars, robotics and graphics. Learn more about the company's latest research and industry breakthroughs in NVIDIA CEO Jensen Huang's k
North America Stories
10/09/2026
Duff Foreman is an AI-generated announcer who will add color to this month's New Mexico Open...
10/09/2026
Bitmovin is rolling out Encoder Version 3, the next major release of the technology behind its VOD and Live Encoders. Version 3 is built on a premise every stre...
10/09/2026
At IBC2026, on booth 1.B47, Net Insight will showcase Open Live Media, its architecture for delivering resilient live media services across networks, partners, ...
10/09/2026
The Professional Women's Hockey League (PWHL) and Scripps Sports have announced a national broadcast rights agreement for the 2026-27 season, a landmark par...
10/09/2026
The Trusted Partner Network (TPN), the global content security initiative powere...
10/09/2026
The NFL is launching its most expansive creator programming yet, bringing togeth...
10/09/2026
Sportsnet is set to deliver its biggest hockey season ever with a national sched...
10/09/2026
LiveU is now a Clarus Integrated Reseller, bringing Starlink's fast, reliabl...
10/09/2026
Mimir is the cloud-native media production platform built for teams that need to move media fast across live, archive, web, social, and broadcast workflows. At ...
10/09/2026
ATSC is being honored with a 2026 Technology & Engineering Emmy Award by the Nat...
10/09/2026
Audio-Technica has introduced the BP880R Contact Transducer, a specialized micro...
10/09/2026
TMRW Sports in partnership with the LPGA, today announced multiyear U.S. media rights agreements with ESPN and Scripps Sports/ION to bring WTGL, the new women...
10/09/2026
SportsNet Pittsburgh (SNP) in partnership with Major League Baseball and the Pit...
10/09/2026
Tennis Channel announced today its launch as a Premium Subscription on The Roku Channel.
Tennis Channel offers viewers a single home for Tennis Channel and Ten...
10/09/2026
Dolby has announced major updates to Dolby OptiView, its live sports platform, ahead of IBC 2026. The updates include new AI-powered intelligence to better unde...
10/09/2026
Dalet has appointed Brian Doheny as CEO. Doheny joined Dalet as President and Chief Revenue Officer in April 2026. Since joining Dalet, Doheny has led the compa...
10/09/2026
Sony, as well as its partner company Nevion, is starting IBC 2026 with a handful of announcements for attendees to see on the show floor.
Sony Announces the 4t...
10/09/2026
The six-year-old venue is expanding capabilities for NFL action, Super Bowl LXI, 2028 Summer Olympics
SoFi Stadium, as well as the surrounding area known as Ho...
10/09/2026
France launch follows UK and Germany as Nielsen expands product across EMEA
Paris, France, September 10, 2026 - Nielsen, a global leader in audience measuremen...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Leading professional audio manufacturers NUGEN Audio, RTW, Steinberg and Telos Alliance have joined forces with Fraunhofer IDMT to establish a common approach t...
10/09/2026
Built Into Setplex's Zapflex Platform, AI Insider Turns Video Service Data Into Actionable Insights
Setplex today introduced AI Insider, a breakthrough new...
10/09/2026
Managed service changes dialogue without actor-specific training or facial rigging while preserving the original performance and fitting established post-produc...
10/09/2026
The ACT Entertainment tvONE and Green Hippo Pixel Academy has released its autumn course schedule, with hands-on training dates in September, October and Novemb...
10/09/2026
Orange Polska continues to Rely on Viaccess-Orca for Secure TV Services and the Next Phase of its Technology Evolution
Viaccess-Orca (VO), a global leader in T...
10/09/2026
Generate and create directly in your timeline with new AI-powered innovations in...
10/09/2026
Tedial is introducing Media Business Hub (MBH) at IBC 2026, a new business enablement platform designed to help media organizations unlock the full value of the...
10/09/2026
Globecast, a leading provider of broadcast, media and entertainment managed services, will unveil the next phase of its transformation at IBC2026 with a preview...
10/09/2026
Fabric Data and TMT Insights today announced that the two companies are combining to create Fabric Insights, uniting authoritative data, purpose-built software,...
10/09/2026
Operative, the preferred advertising and broadcast management provider for the world's leading media brands, today announced a comprehensive slate of new pr...
10/09/2026
Test & measurement innovator, Leader Electronics of Europe, has announced the launch of its latest range of handheld signal generation, analysis and monitoring ...
10/09/2026
The partnership begins with native Zixi protocol support on the Kiloview D350 and will extend to deeper product integration and joint go-to-market initiatives
...
10/09/2026
Avid and FilmLight announce strategic partnership to reimagine the color pipelin...
10/09/2026
Maxon Brings Exclusive Preview of Fall Innovations to IBC2026
Brie Clayton September 10, 2026
0 Comments
IBC attendees will get the first look at new ...
10/09/2026
Puget Systems Launches Built Different by Puget Systems, A New Podcast That Go...
10/09/2026
Three Boston Conservatory Dance Alums Honored for Their Early-Career Promise India Hobbs and Demetrius Lee received Princess Grace Awards, while Lilly David t...
10/09/2026
MonoNeon Returns to Berklee to Kick Off Signature Series The Grammy-winning bassist and alumnus performs with students and faculty from the Planet MicroJam In...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Gear up: The latest PC games and major updates are ready to play on GeForce NOW ...
10/09/2026
AI inference chipmaker d-Matrix today announced it will use NVIDIA NVLink Fusion to connect its next-generation Raptor XPUs to NVIDIA's AI infrastructure pl...
09/09/2026
Sony Electronics has announced the SEL814G, the company's first fisheye zoom G Lens for full-frame Alpha E-mount cameras. The lens will be available in Octo...
09/09/2026
Telestream has announced an expansion of its Practical AI capabilities across th...
09/09/2026
Haivision and Chyron have announced a technology partnership integrating Haivisi...
09/09/2026
Omaha Productions has released ManningCast: Heist, a short film featuring Peyton and Eli Manning attempting to break into NFL Commissioner Roger Goodell's o...
09/09/2026
Imagine Communications will demonstrate the next evolution of XVR at IBC2026 (Stand 1.B73, RAI Amsterdam, September 11-14).
XVR is Imagine's channel-in-a-b...
09/09/2026
swXtch.io has announced abbe, an AI-based orchestration layer for live media workflows, making its world premiere at IBC2026 (Meeting Room 5.MR13, Hall 5, Septe...