
The massive virtual worlds created by growing numbers of companies and creators could be more easily populated with a diverse array of 3D buildings, vehicles, characters and more - thanks to a new AI model from NVIDIA Research.
Trained using only 2D images, NVIDIA GET3D generates 3D shapes with high-fidelity textures and complex geometric details. These 3D objects are created in the same format used by popular graphics software applications, allowing users to immediately import their shapes into 3D renderers and game engines for further editing.
The generated objects could be used in 3D representations of buildings, outdoor spaces or entire cities, designed for industries including gaming, robotics, architecture and social media.
GET3D can generate a virtually unlimited number of 3D shapes based on the data it's trained on. Like an artist who turns a lump of clay into a detailed sculpture, the model transforms numbers into complex 3D shapes.
With a training dataset of 2D car images, for example, it creates a collection of sedans, trucks, race cars and vans. When trained on animal images, it comes up with creatures such as foxes, rhinos, horses and bears. Given chairs, the model generates assorted swivel chairs, dining chairs and cozy recliners.
GET3D brings us a step closer to democratizing AI-powered 3D content creation, said Sanja Fidler, vice president of AI research at NVIDIA, who leads the Toronto-based AI lab that created the tool. Its ability to instantly generate textured 3D shapes could be a game-changer for developers, helping them rapidly populate virtual worlds with varied and interesting objects.
GET3D is one of more than 20 NVIDIA-authored papers and workshops accepted to the NeurIPS AI conference, taking place in New Orleans and virtually, Nov. 26-Dec. 4.
It Takes AI Kinds to Make a Virtual World The real world is full of variety: streets are lined with unique buildings, with different vehicles whizzing by and diverse crowds passing through. Manually modeling a 3D virtual world that reflects this is incredibly time consuming, making it difficult to fill out a detailed digital environment.
Though quicker than manual methods, prior 3D generative AI models were limited in the level of detail they could produce. Even recent inverse rendering methods can only generate 3D objects based on 2D images taken from various angles, requiring developers to build one 3D shape at a time.
GET3D can instead churn out some 20 shapes a second when running inference on a single NVIDIA GPU - working like a generative adversarial network for 2D images, while generating 3D objects. The larger, more diverse the training dataset it's learned from, the more varied and detailed the output.
NVIDIA researchers trained GET3D on synthetic data consisting of 2D images of 3D shapes captured from different camera angles. It took the team just two days to train the model on around 1 million images using NVIDIA A100 Tensor Core GPUs.
Enabling Creators to Modify Shape, Texture, Material GET3D gets its name from its ability to Generate Explicit Textured 3D meshes - meaning that the shapes it creates are in the form of a triangle mesh, like a papier-m ch model, covered with a textured material. This lets users easily import the objects into game engines, 3D modelers and film renderers - and edit them.
Once creators export GET3D-generated shapes to a graphics application, they can apply realistic lighting effects as the object moves or rotates in a scene. By incorporating another AI tool from NVIDIA Research, StyleGAN-NADA, developers can use text prompts to add a specific style to an image, such as modifying a rendered car to become a burned car or a taxi, or turning a regular house into a haunted one.
The researchers note that a future version of GET3D could use camera pose estimation techniques to allow developers to train the model on real-world data instead of synthetic datasets. It could also be improved to support universal generation - meaning developers could train GET3D on all kinds of 3D shapes at once, rather than needing to train it on one object category at a time.
For the latest news from NVIDIA AI research, watch the replay of NVIDIA founder and CEO Jensen Huang's keynote address at GTC:
Most recent headlines
06/10/2025
France T l visions, France's leading broadcaster, has received the 2025 EBU ...
06/09/2025
(L-R) Dylan O'Brien and James Sweeney attend the 2025 Sundance Film Festival Twinless premiere at Eccles Theatre. (Photo by George Pimentel/Shutterstock f...
06/09/2025
LONDON Vizrt has introduced Viz Arena 6, the newest version of its all-in-one live augmented reality (AR) graphics and virtual advertising sports solution. The ...
06/09/2025
SEATTLE Amazon Web Services (AWS) will feature 56 AWS Partners making various demos that showcase the technologies and use cases shaping the future of the Media...
06/09/2025
In news that highlights the ongoing importance of video games, PBS Kids is making its first foray into gameplay content with the September 5 launch of Odd Squa...
06/09/2025
PBS chief executive Paula Kerger has sent an email to staff outlining plans to cut about 100 positions or 15% of its staff, following the loss of Federal fundin...
06/09/2025
A new era of recognition as IABM honors the people, projects and innovations driving real impact
IABM has confirmed the shortlist for the new IABM Impact Award...
06/09/2025
Vizrt, the leader in live production technology revolutionizing viewer experiences, announces new capabilities to help customers create once, adapt automaticall...
06/09/2025
Studio Technologies, a leading manufacturer of high-quality audio, video, and fiber-optic solutions, will spotlight four of its innovative audio solutions at th...
06/09/2025
DigitalGlue, creator of the award-winning creative.space managed storage platform, today announced a technology preview of Creative Intelligence (CI) powered by...
06/09/2025
Eye Filmmuseum is the Netherlands leading film museum, offering a rich variety of experiences from screenings of classic films to cultural exhibitions. With fou...
06/09/2025
The latest innovations in Grass Valley's AMPP applications will be on full display at IBC 2025, as the company brings significant updates to Playout X, its ...
06/09/2025
Disguise has announced the launch of the GX 3 , its most powerful media server ever. Built on NVIDIA's cutting-edge Blackwell GPU architecture and including...
06/09/2025
Autoscript and Autocue have announced the launch of a new advanced PTZ prompter system shared by both brands and designed to provide seamless, professional prom...
06/09/2025
Sachtler has added four new models to its award-winning aktiv and FSB Mk II fluid head ranges. The aktiv16T and aktiv18T, plus the FSB 16T Mk II and FSB 18T Mk...
06/09/2025
CGI (TSX: GIB.A) (NYSE: GIB), one of the largest independent IT and business consulting services firms in the world, will present its bold new vision for the fu...
06/09/2025
DHD has chosen IBC 2025 (Amsterdam, 12-15 September) as the launch venue for the latest version of its RM1 all-in-one portable audio production and broadcast sy...
06/09/2025
AJA Video Systems debuted IP25-R, a Mini-Converter for connecting SMPTE ST 2110 networks with 4K SDI/HDMI infrastructures. IP25-R lets broadcast, production, an...
06/09/2025
AJA Video Systems today introduced new products and updates ahead of the International Broadcasting Convention (IBC) 2025 that streamline signal flow management...
06/09/2025
Researchers map key human proteins that power coronavirus replication, pointing to new treatment strategies Findings from Scripps Research reveal promising drug...
05/09/2025
Your listening habits are as unique as you are-and this year, Spotify has introduced a wave of new features to help you personalize your experience. From playli...
05/09/2025
SBS kicks off a confident slate with the 2026 FIFA World Cup 2026 , premium dram...
05/09/2025
Today's Historic Settlement Underscores SBS's Powerful New Series The Pe...
05/09/2025
L3Harris Chief Financial Officer and Aerojet Rocketdyne President Ken Bedingfiel...
05/09/2025
PHILADELPHIA NBC Sports will present tonight's NFL Kickoff Game between the '25 Super Bowl champion Philadelphia Eagles and Dallas Cowboys on Peacock in...
05/09/2025
Warner Bros. Discovery filed a lawsuit against Gen AI company Midjourney this week, claiming that the company violated the studio's copyright....
05/09/2025
Alum Esin Ayd ng z Pens Nevermore Alma Mater' for Netflix's Wednesday The Grammy-nominated composer appears on this season's soundtrack alongside...
05/09/2025
C-SPAN and YouTube this week announced an agreement in which YouTube will sponsor C-SPAN's America 250 programming and expand access to C-SPAN's politic...
05/09/2025
LONDON Live broadcast infrastructure solutions provider Techex has added Peter Dawidzik as senior director, sales and business development....
05/09/2025
As news organizations and broadcasters face more pressure than ever to capture, verify, and distribute real-time access to breaking news, Reuters and Amazon Web...
05/09/2025
LOS ANGELES The Hollywood Professional Association (HPA) today said it has begun accepting submissions for its expanded HPA Engineering Excellence Awards, which...
05/09/2025
Sage has released an update to its most recent firmware for its Digital ENDEC model 3644....
05/09/2025
LONDON and LOS ANGELES ThinkAnalytics will debut ThinkMetadataAI, the company's latest step in recommendations, search and discovery services....
05/09/2025
WASHINGTON The Federal Communications Commissions Media Bureau has announced that the agency is initiating a phased process to lift the current freeze on major ...
05/09/2025
TORONTO Quickplay will feature its newly unveiled AI Studio that assists broadcasters and streamers in transforming their content libraries into short-form asse...
05/09/2025
Boston Conservatory at Berklee Announces Five-Year Partnership with The Verdon F...
05/09/2025
Alum Esin Ayding z Pens Nevermore Alma Mater' for Netflix's Wednesday The Grammy-nominated composer appears on this season's soundtrack alongside...
05/09/2025
Rohde & Schwarz UK awarded Silver Award under Defence Employer Recognition Schem...
05/09/2025
Back to All News
Two Desperate Souls and One Desperate Choice: As You Stood By...
05/09/2025
Back to All News
Netflix Unveils New BAKI-DOU' Anime and First Look at BE...
05/09/2025
This weekend sees another feast in store for all sport fans as RT airs a jam-packed schedule of live, free-to-air sport.
The Amgen Irish Open continues all we...
04/09/2025
(Joel Edgerton and Felicity Jones appear in Train Dreams by Clint Bentley, an of...
04/09/2025
SBS kicks off a confident slate with the 2026 FIFA World Cup2026 , premium drama...
04/09/2025
Watch the Record-breaking Koori Knockout 2025 LIVE and EXCLUSIVE on NITV and SBS...
04/09/2025
WALTHAM, Mass. Zixi, a provider of video-delivery-over-IP technology, has named Sue Mitchell as director of account management, EMEA....
04/09/2025
NEW YORK In news that highlights the importance of the NFL and sports for the TV and streaming industry, NBCUniversal is reporting record revenue for its 20th s...
04/09/2025
OTTAWA Ross Video has acquired LAMA, a Dutch-based developer of advanced audio production software known for its innovative live mixing solutions. The acquisiti...
04/09/2025
CINCINNATI GatesAir will bring its 5G passthrough demo to IBC audiences once again as interest in the technology's value for broadcast-to-mobile delivery gr...
04/09/2025
BURY ST. EDMUNDS, England Autoscript and Autocue will showcase their newly launched PTZ prompter system during IBC2025, Sept. 12-15 at the RAI Amsterdam Convent...
04/09/2025
Watch the Benn Family Band Perform I Wont Give Up on Americas Got Talent Assistant Professor Loren Benn and her family gave an emotional live performance of t...