Instant Latte: NVIDIA Gen AI Research Brews 3D Shapes in Under a Second
27/03/2024
Isha Salian March 27, 2024
0 Comments
The LATTE3D model rapidly transforms text prompts into high-quality 3D shapes that could help populate virtual worlds.
Some contents or functionalities here are not available due to your cookie preferences!
This happens because the functionality/content marked as Vimeo framework uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.
NVIDIA researchers have pumped a double shot of acceleration into their latest text-to-3D generative AI model, dubbed LATTE3D.
Like a virtual 3D printer, LATTE3D turns text prompts into 3D representations of objects and animals within a second.
Crafted in a popular format used for standard rendering applications, the generated shapes can be easily served up in virtual environments for developing video games, ad campaigns, design projects or virtual training grounds for robotics.
A year ago, it took an hour for AI models to generate 3D visuals of this quality - and the current state of the art is now around 10 to 12 seconds, said Sanja Fidler, vice president of AI research at NVIDIA, whose Toronto-based AI lab team developed LATTE3D. We can now produce results an order of magnitude faster, putting near-real-time text-to-3D generation within reach for creators across industries.
This advancement means that LATTE3D can produce 3D shapes near instantly when running inference on a single GPU, such as the NVIDIA RTX A6000, which was used for the NVIDIA Research demo.
Some contents or functionalities here are not available due to your cookie preferences!
This happens because the functionality/content marked as Google Youtube uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.
Ideate, Generate, Iterate: Shortening the Cycle Instead of starting a design from scratch or combing through a 3D asset library, a creator could use LATTE3D to generate detailed objects as quickly as ideas pop into their head.
The model generates a few different 3D shape options based on each text prompt, giving a creator options. Selected objects can be optimized for higher quality within a few minutes. Then, users can export the shape into graphics software applications or platforms such as NVIDIA Omniverse, which enables Universal Scene Description (OpenUSD)-based 3D workflows and applications.
While the researchers trained LATTE3D on two specific datasets - animals and everyday objects - developers could use the same model architecture to train the AI on other data types.
If trained on a dataset of 3D plants, for example, a version of LATTE3D could help a landscape designer quickly fill out a garden rendering with trees, flowering bushes and succulents while brainstorming with a client. If trained on household objects, the model could generate items to fill in 3D simulations of homes, which developers could use to train personal assistant robots before they're tested and deployed in the real world.
LATTE3D was trained using NVIDIA A100 Tensor Core GPUs. In addition to 3D shapes, the model was trained on diverse text prompts generated using ChatGPT to improve the model's ability to handle the various phrases a user might come up with to describe a particular 3D object - for example, understanding that prompts featuring various canine species should all generate doglike shapes.
NVIDIA Research comprises hundreds of scientists and engineers worldwide, with teams focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
Researchers shared work at NVIDIA GTC this week that advances the state of the art for training diffusion models. Read more on the NVIDIA Technical Blog, and see the full list of NVIDIA Research sessions at GTC, running in San Jose, Calif., and online through March 21.
For the latest NVIDIA AI news, watch the replay of NVIDIA founder and CEO Jensen Huang's keynote address at GTC:
Some contents or functionalities here are not available due to your cookie preferences!
This happens because the functionality/content marked as Google Youtube uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.
March 7, 2024HP Announces New AI PCs with NVIDIA RTX Ada GPU TechnologyComing to Z by HP AI Studio, NVIDIA CUDA-X Data Processing Libraries
February 27, 2024NVIDIA RTX 500 and 1000 Professional Ada Generation Laptop GPUs Drive AI-Enhanced Workflows From AnywhereThin and light designs deliver advanced AI, compute and graphics horsepower for
Enjoying the news? Sign up for the Creative COW Newsletter! Sign up for the Creative COW newsletter and get weekly updates on industry news, forum highlights, jobs, inspirational tutorials, tips, burning questions, and more! Receive bulletins from the largest, longest-running community dedicated to supporting professionals working in film, video, and audio.
Enter your email address, and your first and last name below!
-- Sign up: * indicates required
Email Address *
Name
--
LINK: | https://creativecow.net/instant-latte-nvidia-gen-ai-research-brews-3d-... |
See more stories from creativecow |
More from Creative COW
27/04/2024
Participate in the Survey - The Impact of AI on Media and the Creative Industry
Participate in the Survey - The Impact of AI on Media and the Creative Industry Pascal Wagner April 26, 2024 0 Comments By participating in this surve...
27/04/2024
SDVI Rally Access Workstation Earns Two Top Awards at 2024 NAB Show
SDVI Rally Access Workstation Earns Two Top Awards at 2024 NAB Show Brie Clayton April 26, 2024 0 Comments SDVI, the leading platform provider for clo...
26/04/2024
Quantum to Offer Advanced Filesharing Technology and Performance in StorNext and Myriad Solutions
Quantum to Offer Advanced Filesharing Technology and Performance in StorNext and...
26/04/2024
FilmLight Colour Awards welcomes 2024 entries and introduces new Emerging Talent' award
FilmLight Colour Awards welcomes 2024 entries and introduces new Emerging Talen...
26/04/2024
Picture Shop Announces Chris Evans as Head of Unscripted
Picture Shop Announces Chris Evans as Head of Unscripted Brie Clayton April 26, 2024 0 Comments Picture Shop announced Chris Evans will lead Unscripte...
26/04/2024
Participate in a Survey - The Impact of AI on Media and the Creative Industry
Participate in a Survey - The Impact of AI on Media and the Creative Industry Pascal Wagner April 26, 2024 0 Comments By participating in this survey,...
26/04/2024
New Adobe Photoshop with Advanced Generative Fill and Generate Image Brings New Superpowers to All
New Adobe Photoshop with Advanced Generative Fill and Generate Image Brings New ...
26/04/2024
Trends And Takeaways From NAB Show 2024
Trends And Takeaways From NAB Show 2024 Melanie Ciotti April 25, 2024 0 Comments NAB's Eric Trabb (right) awards SNS with two NAB Show Product of ...
26/04/2024
Sony's Ci Media Cloud Keeps NHRA Moving
Sony's Ci Media Cloud Keeps NHRA Moving Brie Clayton April 25, 2024 0 Comments Cloud-Based Media Asset Management and Collaboration Platform Accel...
25/04/2024
Cintel Scanner G3 HDR+ Restores Egypt's Cinema Treasures to Their Former Glory
Cintel Scanner G3 HDR Restores Egypt's Cinema Treasures to Their Former Glo...
25/04/2024
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam for Android, and more
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam f...
25/04/2024
Content Creation, Production, Distribution Is In a State of Flux
Content Creation, Production, Distribution Is In a State of Flux Andy Marken April 24, 2024 0 Comments My empathy is creeping towards what I would de...
24/04/2024
Adobe Charts the Future of Creativity and AI at MAX London
Adobe Charts the Future of Creativity and AI at MAX London Brie Clayton April 24, 2024 0 Comments Adobe is taking MAX, the world's largest creativ...
23/04/2024
Particles emitting from a 3D rotating shape's edge
Particles emitting from a 3D rotating shape's edge Graham Quince April 22, 2024 0 Comments In Fixin' FX, people send me their problematic proj...
23/04/2024
Hollyland Technology Announces a New Line of Video Transmitters: Introducing the Pyro Series
Hollyland Technology Announces a New Line of Video Transmitters: Introducing the...
22/04/2024
Digital Domain Unveils Masquerade3: Revolutionary Markerless Facial Motion Capture System
Digital Domain Unveils Masquerade3 : Revolutionary Markerless Facial Motion Cap...
22/04/2024
Pixotope brings the power of Unreal Engine to automated and news broadcast graphics
Pixotope brings the power of Unreal Engine to automated and news broadcast graph...
22/04/2024
Brand New Color Slice tool in DaVinci Resolve 19!
Brand New Color Slice tool in DaVinci Resolve 19! Kasia Jarco April 22, 2024 0 Comments In this video i would like to show you the newest Color Slice ...
22/04/2024
Apple Motion's Best-Kept Secret
Apple Motion's Best-Kept Secret Simon Ubsdell April 22, 2024 0 Comments A seriously useful technique that I have employed in many of my tutorials ...
20/04/2024
Video Games Round Out the Entertainment Package
Video Games Round Out the Entertainment Package Andy Marken April 19, 2024 0 Comments By this, I take it you think everybody is who they say they are...
19/04/2024
OpenDrives New Software-Defined Platform Atlas Wins 2024 NAB Show Product of the Year Award
OpenDrives New Software-Defined Platform Atlas Wins 2024 NAB Show Product of the...
19/04/2024
Grass Valley Showcases Next-Generation T3 Series 4K/HD Digital Recording and Playback for Venues and Stadiums
Grass Valley Showcases Next-Generation T3 Series 4K/HD Digital Recording and Pla...
19/04/2024
NiTRo's M-CUBE Studio Levels Up Esports Productions with AJA Gear
NiTRo's M-CUBE Studio Levels Up Esports Productions with AJA Gear Brie Clayton April 19, 2024 0 Comments Esports' rapid rise to popularity can...
19/04/2024
Blackmagic Design Announces DaVinci Resolve 19
Blackmagic Design Announces DaVinci Resolve 19 Brie Clayton April 19, 2024 0 Comments Major update adds new DaVinci Neural Engine AI tools, new color ...
19/04/2024
The Current State of the Industry and the Future Impact of AI
The Current State of the Industry and the Future Impact of AI Hillary Lewis April 18, 2024 0 Comments The Entertainment Industry: How did we get here ...
19/04/2024
After Effects Tutorial Text Blur Reveal
After Effects Tutorial Text Blur Reveal Andy Ford April 18, 2024 0 Comments Here's a way to do a quick blur reveal for your text layer. Start by...
19/04/2024
Hollyland Mars M1 Enhanced Wireless Transmitter / Receiver
Hollyland Mars M1 Enhanced Wireless Transmitter / Receiver Colin Smith April 18, 2024 0 Comments This tutorial shows the new wireless transmitter rece...
19/04/2024
Resolve Fusion: Writing Expressions with Lua
Resolve Fusion: Writing Expressions with Lua Simon Ubsdell April 18, 2024 0 Comments The answer to the very frequently-asked question: what is the pro...
18/04/2024
Vislink's DragonFly V - The Company's Smallest-Ever Transmitter Debuted at NAB 2024
Vislink's DragonFly V - The Company's Smallest-Ever Transmitter Debuted ...
18/04/2024
MediaSilo to Offer Camera to Cloud with Atomos
MediaSilo to Offer Camera to Cloud with Atomos Brie Clayton April 17, 2024 0 Comments Integration between MediaSilo and Atomos Cloud Studio unlocking ...
18/04/2024
MultiDyne Updates its SilverBULLET Series to Serve More Fiber-Optic Links
MultiDyne Updates its SilverBULLET Series to Serve More Fiber-Optic Links Brie Clayton April 17, 2024 0 Comments MultiDyne Fiber Optic Solutions intro...
18/04/2024
Cinedeck Partners with Paramount to Revolutionize Content Delivery Process
Cinedeck Partners with Paramount to Revolutionize Content Delivery Process Brie Clayton April 17, 2024 0 Comments Cinedeck, a pioneer in integrated de...
18/04/2024
Unreal for video adding rocks and foliage
Unreal for video adding rocks and foliage Graham Quince April 17, 2024 0 Comments Welcome to my series on learning Unreal Engine for After Effects u...
18/04/2024
Best Budget Beginner-Friendly 4k Drone
Best Budget Beginner-Friendly 4k Drone Sean Alami April 17, 2024 0 Comments Potensic Atom 4k 3 axis Gimbal Drone, ideal drone for beginners. Some con...
17/04/2024
New NVIDIA RTX A400 and A1000 GPUs Enhance AI-Powered Design and Productivity Workflows
New NVIDIA RTX A400 and A1000 GPUs Enhance AI-Powered Design and Productivity Wo...
17/04/2024
Frezzi Unveils SunLight 2: The Ultimate High-Output Lighting Companion for ENG and Broadcast Production
Frezzi Unveils SunLight 2: The Ultimate High-Output Lighting Companion for ENG a...
17/04/2024
Peakto Search for Lightroom - Find at a glance among thousands of photos AND videos
Peakto Search for Lightroom - Find at a glance among thousands of photos AND vid...
17/04/2024
Blackmagic Design Announces New Blackmagic URSA Cine 12K
Blackmagic Design Announces New Blackmagic URSA Cine 12K Brie Clayton April 16, 2024 0 Comments Revolutionary large format digital film camera with RG...
17/04/2024
Sony Electronics Announces a Compact Wide-Angle FE 16-25mm F2.8 G Zoom Lens
Sony Electronics Announces a Compact Wide-Angle FE 16-25mm F2.8 G Zoom Lens Brie Clayton April 16, 2024 0 Comments A constant F2.8 full-frame E-mount ...
17/04/2024
Ikegami Announces New HDK-X500 3-CMOS HD Camera, OCP-500 Operation Control Panel and Video Monitors
Ikegami Announces New HDK-X500 3-CMOS HD Camera, OCP-500 Operation Control Panel...
17/04/2024
Welcome to the Sennheiser Group's Experience Booth at NAB 2024
Welcome to the Sennheiser Group's Experience Booth at NAB 2024 Brie Clayton April 16, 2024 0 Comments Sennheiser, Neumann, Dear Reality and Mergin...
16/04/2024
Brompton Technology unveils world's most powerful 8K LED video processor, Tessera SQ200, at NAB2024
Brompton Technology unveils world's most powerful 8K LED video processor, Te...
16/04/2024
Motion Picture Connectivity Company Bit Part Debuts bitbox Remote Camera Control Radio at Annual NAB Show
Motion Picture Connectivity Company Bit Part Debuts bitbox Remote Camera Control...
16/04/2024
The Prismatic Company Debuts Strategy for New LightWeave Platform for the Creator Community at NAB 2024
The Prismatic Company Debuts Strategy for New LightWeave Platform for the Creato...
16/04/2024
Avid to Demonstrate Latest Stream of Innovation at NAB Show 2024 to Drive the Open and Collaborative Future of Media Production
Avid to Demonstrate Latest Stream of Innovation at NAB Show 2024 to Drive the Op...
15/04/2024
Adobe Previews Breakthrough AI Innovations to Advance Professional Video Workflows within Adobe Premiere Pro
Adobe Previews Breakthrough AI Innovations to Advance Professional Video Workflo...
15/04/2024
Zaxcom NAB Preview - Zaxcom's ZaxConvert Software is Now More Versatile & 10x Faster
Zaxcom NAB Preview - Zaxcom's ZaxConvert Software is Now More Versatile & 10...
15/04/2024
Blackmagic Design Announces New Blackmagic PYXIS 6K
Blackmagic Design Announces New Blackmagic PYXIS 6K Brie Clayton April 15, 2024 0 Comments Advanced digital film camera in an incredibly versatile des...
15/04/2024
SmallHD's Free PageOS 6 Update Adds Powerful New Capabilities to All Current Monitors
SmallHD's Free PageOS 6 Update Adds Powerful New Capabilities to All Current...
15/04/2024
Digital Anarchy Debuts Major Update to its AI-Driven Digital Makeup and Skin Retouching Tools at NAB 2024
Digital Anarchy Debuts Major Update to its AI-Driven Digital Makeup and Skin Ret...