
The massive virtual worlds created by growing numbers of companies and creators could be more easily populated with a diverse array of 3D buildings, vehicles, characters and more - thanks to a new AI model from NVIDIA Research.
Trained using only 2D images, NVIDIA GET3D generates 3D shapes with high-fidelity textures and complex geometric details. These 3D objects are created in the same format used by popular graphics software applications, allowing users to immediately import their shapes into 3D renderers and game engines for further editing.
The generated objects could be used in 3D representations of buildings, outdoor spaces or entire cities, designed for industries including gaming, robotics, architecture and social media.
GET3D can generate a virtually unlimited number of 3D shapes based on the data it's trained on. Like an artist who turns a lump of clay into a detailed sculpture, the model transforms numbers into complex 3D shapes.
With a training dataset of 2D car images, for example, it creates a collection of sedans, trucks, race cars and vans. When trained on animal images, it comes up with creatures such as foxes, rhinos, horses and bears. Given chairs, the model generates assorted swivel chairs, dining chairs and cozy recliners.
GET3D brings us a step closer to democratizing AI-powered 3D content creation, said Sanja Fidler, vice president of AI research at NVIDIA, who leads the Toronto-based AI lab that created the tool. Its ability to instantly generate textured 3D shapes could be a game-changer for developers, helping them rapidly populate virtual worlds with varied and interesting objects.
GET3D is one of more than 20 NVIDIA-authored papers and workshops accepted to the NeurIPS AI conference, taking place in New Orleans and virtually, Nov. 26-Dec. 4.
It Takes AI Kinds to Make a Virtual World The real world is full of variety: streets are lined with unique buildings, with different vehicles whizzing by and diverse crowds passing through. Manually modeling a 3D virtual world that reflects this is incredibly time consuming, making it difficult to fill out a detailed digital environment.
Though quicker than manual methods, prior 3D generative AI models were limited in the level of detail they could produce. Even recent inverse rendering methods can only generate 3D objects based on 2D images taken from various angles, requiring developers to build one 3D shape at a time.
GET3D can instead churn out some 20 shapes a second when running inference on a single NVIDIA GPU - working like a generative adversarial network for 2D images, while generating 3D objects. The larger, more diverse the training dataset it's learned from, the more varied and detailed the output.
NVIDIA researchers trained GET3D on synthetic data consisting of 2D images of 3D shapes captured from different camera angles. It took the team just two days to train the model on around 1 million images using NVIDIA A100 Tensor Core GPUs.
Enabling Creators to Modify Shape, Texture, Material GET3D gets its name from its ability to Generate Explicit Textured 3D meshes - meaning that the shapes it creates are in the form of a triangle mesh, like a papier-m ch model, covered with a textured material. This lets users easily import the objects into game engines, 3D modelers and film renderers - and edit them.
Once creators export GET3D-generated shapes to a graphics application, they can apply realistic lighting effects as the object moves or rotates in a scene. By incorporating another AI tool from NVIDIA Research, StyleGAN-NADA, developers can use text prompts to add a specific style to an image, such as modifying a rendered car to become a burned car or a taxi, or turning a regular house into a haunted one.
The researchers note that a future version of GET3D could use camera pose estimation techniques to allow developers to train the model on real-world data instead of synthetic datasets. It could also be improved to support universal generation - meaning developers could train GET3D on all kinds of 3D shapes at once, rather than needing to train it on one object category at a time.
For the latest news from NVIDIA AI research, watch the replay of NVIDIA founder and CEO Jensen Huang's keynote address at GTC:
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
02/05/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
01/04/2026
January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION
Douyin Users Can Now Create And Share Videos With Stun...
19/03/2026
Live sports production increases complexity, with dynamic audio levels and an overall philosophy that encourages transient volume spikes
Fourteen years ago, Am...
19/03/2026
Advanced Systems Group, a technology and services provider for media creatives and content owners, announced the appointment of Peter Thordarson to the newly cr...
19/03/2026
For this senior from the Bay Area, the speed and pressure of live sports production play right into her strengths
In the live-sports-video industry, the future...
19/03/2026
Grass Valley has expanded its long-term partnership with University of Pittsburg...
19/03/2026
Audio-Technica has released the ATV-SG1 and ATV-SG1LE On-Camera Shotgun Microphones, designed for use with DSLR, mirrorless SLR, and other cameras.
The ATV-SG1...
19/03/2026
Harmonic (booth W2831) announces updates to its XOS Advanced Media Processor aim...
19/03/2026
DAZN and Top Rank have announced a multi-year partnership that will bring Top Ra...
19/03/2026
IHSE, a provider of KVM systems, has announced a partnership with Cyviz AS, a provider of technology solutions for collaboration and mission-critical operations...
19/03/2026
Net Insight has appointed Larissa G rner-Meeus as Chief Product Officer. She joins the company's executive management team.
G rner-Meeus holds a Dipl-Ing. ...
19/03/2026
Leader Electronics of Europe has appointed Rob Stanley as Regional Sales Manager for the UK and Northern Europe. In the role, he will manage key accounts and ha...
19/03/2026
FIFA has announced that YouTube will be a Preferred Platform for the FIFA World Cup 2026.
Under the agreement, FIFA's Media Partners will be able to publis...
19/03/2026
New features across mobile, connected devices, and automotive platforms undersco...
19/03/2026
PSSI Global Services has appointed Ben Bradshaw as Director of Product and Netwo...
19/03/2026
Cobalt Digital has announced its NAB 2026 product lineup, which includes additio...
19/03/2026
Sportradar has released a new report, Innovation in Sports Media: The Next Era of Sports Viewing, examining how the sports viewing experience in the U.S. is evo...
19/03/2026
Matrox Video has been awarded a three-year framework agreement to supply its Con...
19/03/2026
CBS Sports' Jason Cohen and TNT Sports' Chris Brown lead the charge on n...
19/03/2026
A1 Dave Grundtvig and his team deploy plenty of mics to capture the sounds and energy from the stands as well the court
March Madness is a tournament in which ...
19/03/2026
In 2021, we launched EQUAL, a program designed to address an industry reality that persists: Women artists, songwriters, and producers too often face fewer oppo...
19/03/2026
Latest EZKeys 2 expansion arrives
Toontrack's staggering collection of EZKeys 2 expansions has grown once again, and the latest instalment delivers a on...
19/03/2026
New generative AI plug-in due in May 2026
Roland have announced the upcoming launch of a new generative AI tool created in collaboration with Sony Computer ...
19/03/2026
Nick Williams updates users on insolvency process
Nick Williams, the CEO of Native Instruments, has released the following official statement regarding thei...
19/03/2026
Iconic Swedish mic manufacturer back in action
Legendary Swedish microphone manufacturer Milab have announced that production is now fully underway, and mic...
19/03/2026
Acclaimed saturation unit goes virtual
Freqport's Freqtube FT1 (reviewed here in SOS February 2023) offers a convenient way to integrate real valve-base...
19/03/2026
The discontinuation of loss-making business activities as part of the restructur...
19/03/2026
Silicon Valley satire The Audacity premieres 15 April on SBS and SBS On Demand
19 March, 2026
Media releases
From one of the writer/producers of Succession...
19/03/2026
SBS brings communities together at Bondi Pavilion for Harmony Week multilingual ...
19/03/2026
Clarification from SBS regarding Western Sydney expansion
19 March, 2026
Media releases
From an SBS spokesperson:
SBS wishes to clarify some media coverag...
19/03/2026
Test & measurement innovator, Leader Electronics of Europe, is pleased to announce the appointment of Rob Stanley as Regional Sales Manager - UK & Northern Euro...
19/03/2026
The recently announced joint venture between Accedo One and Magine Pro has been officially launched as Leyra. The new company will combine the two complementary...
19/03/2026
Budapest, Hungary, March 2026 - Demand for traditional matrix switching remains strong across live events, rental and staging markets. With a reputation for rel...
19/03/2026
DPA Microphones adds to its CORE microphone selection with the 4097 CORE Micro Shotgun, which delivers a new level of clarity, headroom and sonic transparency...
19/03/2026
Starfish Technologies will present the latest releases of its TS Splicer (Win) and TS Splicer (K8) at NAB Show 2026, together with a new Monitoring Dashboard de...
19/03/2026
Bitmovin, a leading provider of video streaming solutions, has announced that TrueVisions NOW, a leading streaming platform in Thailand, and part of the TrueVis...
19/03/2026
Harmonic (NASDAQ: HLIT) today announced significant enhancements to its XOS Advanced Media Processor that lower the cost of broadcast distribution while enablin...
19/03/2026
Cobalt Digital, the leading designer and manufacturer of award-winning signal processing products, and a founding partner in the openGear initiative has announ...
19/03/2026
Magewell a developer of innovative, high-performance video I/O and IP workflow solutions will be at the 2026 NAB Show on booth C6113. In addition to several...
19/03/2026
Triveni Digital, a trusted leader in ATSC 1.0 and ATSC 3.0 service delivery, data broadcasting and quality assurance solutions, today announced it will showcase...
19/03/2026
2026 NAB Show Exhibitor Preview
April 19 22
Las Vegas
Booth N.1328
Summary:
At the 2026 NAB Show in Las Vegas, Imagine Communications will showcase the lat...
19/03/2026
Broadcast playout leader highlights innovation and industry collaboration
Pebble, the leading automation, content management and integrated channel specialist...
19/03/2026
Tuxera, a leading provider of quality-assured file systems and networking technologies, is highlighting remarkable advances in performance at NAB Show (booth N1...
19/03/2026
Intinor will showcase several new developments to the Direkt platform at NAB 2026, including enhanced SRT monitoring, expanded HDR transport capabilities and su...
19/03/2026
Broadcasters are rebuilding live operations workflows around IP delivery as satellite and dedicated fibre distribution decline, according to new research from C...
19/03/2026
Berklee Popular Music Institute's 24th Showcase Channels '80s Prom Nosta...
19/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...