![](//www.4rfv.com/images/no_image.jpg)
NVIDIA researchers have pumped a double shot of acceleration into their latest text-to-3D generative AI model, dubbed LATTE3D.
Like a virtual 3D printer, LATTE3D turns text prompts into 3D representations of objects and animals within a second.
Crafted in a popular format used for standard rendering applications, the generated shapes can be easily served up in virtual environments for developing video games, ad campaigns, design projects or virtual training grounds for robotics.
A year ago, it took an hour for AI models to generate 3D visuals of this quality - and the current state of the art is now around 10 to 12 seconds, said Sanja Fidler, vice president of AI research at NVIDIA, whose Toronto-based AI lab team developed LATTE3D. We can now produce results an order of magnitude faster, putting near-real-time text-to-3D generation within reach for creators across industries.
This advancement means that LATTE3D can produce 3D shapes near instantly when running inference on a single GPU, such as the NVIDIA RTX A6000, which was used for the NVIDIA Research demo.
Ideate, Generate, Iterate: Shortening the Cycle Instead of starting a design from scratch or combing through a 3D asset library, a creator could use LATTE3D to generate detailed objects as quickly as ideas pop into their head.
The model generates a few different 3D shape options based on each text prompt, giving a creator options. Selected objects can be optimized for higher quality within a few minutes. Then, users can export the shape into graphics software applications or platforms such as NVIDIA Omniverse, which enables Universal Scene Description (OpenUSD)-based 3D workflows and applications.
While the researchers trained LATTE3D on two specific datasets - animals and everyday objects - developers could use the same model architecture to train the AI on other data types.
If trained on a dataset of 3D plants, for example, a version of LATTE3D could help a landscape designer quickly fill out a garden rendering with trees, flowering bushes and succulents while brainstorming with a client. If trained on household objects, the model could generate items to fill in 3D simulations of homes, which developers could use to train personal assistant robots before they're tested and deployed in the real world.
LATTE3D was trained using NVIDIA A100 Tensor Core GPUs. In addition to 3D shapes, the model was trained on diverse text prompts generated using ChatGPT to improve the model's ability to handle the various phrases a user might come up with to describe a particular 3D object - for example, understanding that prompts featuring various canine species should all generate doglike shapes.
NVIDIA Research comprises hundreds of scientists and engineers worldwide, with teams focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
Researchers shared work at NVIDIA GTC this week that advances the state of the art for training diffusion models. Read more on the NVIDIA Technical Blog, and see the full list of NVIDIA Research sessions at GTC, running in San Jose, Calif., and online through March 21.
For the latest NVIDIA AI news, watch the replay of NVIDIA founder and CEO Jensen Huang's keynote address at GTC:
More from Nvidia
25/07/2024
Hey, you. You're finally awake.
It's the summer of Elder Scrolls - whe...
24/07/2024
AI is set to transform the workforce - and the Georgia Institute of Technology's new AI Makerspace is helping tens of thousands of students get ahead of the...
24/07/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
23/07/2024
Generative AI applications have little, or sometimes negative, value without acc...
23/07/2024
Businesses seeking to harness the power of AI need customized models tailored to their specific industry needs.
NVIDIA AI Foundry is a service that enables ent...
22/07/2024
AI and accelerated computing - twin engines NVIDIA continuously improves - are d...
22/07/2024
Team NVIDIA has triumphed at the Amazon KDD Cup 2024, securing first place Friday across all five competition tracks.
The team - consisting of NVIDIANs Ahmet E...
19/07/2024
Research published earlier this month in the science journal Nature used NVIDIA-powered supercomputers to validate a pathway toward the commercialization of qua...
19/07/2024
Research published earlier this month in the science journal Nature used NVIDIA-powered supercomputers to validate a pathway toward the commercialization of qua...
19/07/2024
AI has seen unprecedented growth - spurring the need for new training and educat...
19/07/2024
Research published earlier this month in the science journal Nature used NVIDIA-powered supercomputers to validate a pathway toward the commercialization of qua...
18/07/2024
Mistral AI and NVIDIA today released a new state-of-the-art language model, Mist...
18/07/2024
It's time for a sweet treat - the GeForce NOW Summer Sale offers high-perfor...
17/07/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
16/07/2024
Editor's note: This post is part of our In the NVIDIA Studio series, which c...
15/07/2024
NVIDIA founder and CEO Jensen Huang and Meta founder and CEO Mark Zuckerberg wil...
12/07/2024
NVIDIA is taking an array of advancements in rendering, simulation and generativ...
11/07/2024
Unlock new experiences every GFN Thursday. Whether post-apocalyptic survival adventures, narrative-driven games or vast, open worlds, GeForce NOW always has som...
11/07/2024
Enhancing Japan's AI sovereignty and strengthening its research and development capabilities, Japan's National Institute of Advanced Industrial Science ...
10/07/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible and showcases new hardware, softwar...
10/07/2024
Improved cancer diagnostics - and improved patient outcomes - could be among the...
09/07/2024
Sphere, a new kind of entertainment medium in Las Vegas, is joining the ranks of legendary circular performance spaces such as the Roman Colosseum and Shakespea...
08/07/2024
Artificial intelligence is transforming the transportation industry, helping dri...
04/07/2024
GeForce NOW is bringing 22 new games to members this month.
Dive into the four titles available to stream on the cloud gaming service this week to stay cool an...
03/07/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
28/06/2024
On a weekday afternoon, Ashwini Ashtankar sat on the bank of the Doodhpathri River, in a valley nestled in the Himalayas. Taking a deep breath, she noticed that...
27/06/2024
Editor's note: This post is part of Into the Omniverse, a series focused on ...
27/06/2024
Get ready to feel some chills, even amid the summer heat. Capcom's award-winning Resident Evil Village brings a touch of horror to the cloud this GFN Thursd...
26/06/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
26/06/2024
Roblox is a colorful online platform that aims to reimagine the way that people ...
25/06/2024
Generative AI has revolutionized software development with prompt-based code generation - protein design is next.
EvolutionaryScale today announced the release...
24/06/2024
Multi-die chips, known as three-dimensional integrated circuits, or 3D-ICs, represent a revolutionary step in semiconductor design. The chips are vertically sta...
20/06/2024
Sit back and settle in for some epic storytelling. Tell Me Why and As Dusk Falls - award-winning, narrative-driven games from Xbox Studios - add to the 1,900+ g...
19/06/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible and showcases new hardware, softwar...
18/06/2024
The electric grid and the utilities managing it have an important role to play in the next industrial revolution that's being driven by AI and accelerated c...
17/06/2024
NVIDIA contributed the largest ever indoor synthetic dataset to the Computer Vision and Pattern Recognition (CVPR) conference's annual AI City Challenge - h...
17/06/2024
Making moves to accelerate self-driving car development, NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Vision and Pattern Recognit...
17/06/2024
NVIDIA researchers are at the forefront of the rapidly advancing field of visual...
15/06/2024
NVIDIA founder and CEO Jensen Huang on Friday encouraged Caltech graduates to pu...
14/06/2024
When she was five years old, Veronica Miller (n e Teklai) and her family left their homeland of Eritrea, in the Horn of Africa, to escape an ongoing war with Et...
14/06/2024
NVIDIA today announced Nemotron-4 340B, a family of open models that developers ...
13/06/2024
Set sail for adventure, pirates. Sea of Thieves makes waves in the cloud this week. It's an adventure-filled GFN Thursday with four new games joining the Ge...
12/06/2024
Accelerated computing is transforming data processing and analytics for enterpri...
12/06/2024
The full-stack NVIDIA accelerated computing platform has once again demonstrated...
12/06/2024
Let's talk about NeRFs - no, not the neon-colored foam dart blasters, but ne...
12/06/2024
Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible, and showcases new hardware, softwa...
07/06/2024
Across industries, AI is supercharging innovation with machine-powered computation. In finance, bankers are using AI to detect fraud more quickly and keep accou...
06/06/2024
Capcom's latest entry in the iconic Street Fighter series, Street Fighter 6, punches its way into the cloud this GFN Thursday. The game, along with Ubisoft&...
05/06/2024
India's AI market is expected to be massive. Yotta Data Services is setting its sights on supercharging it. In this episode of NVIDIA's AI Podcast, Suni...
05/06/2024
NVIDIA launched NVIDIA Studio at COMPUTEX in 2019. Five years and more than 500 ...