Sony Pixel Power calrec Sony

Digital Renaissance: NVIDIA Neuralangelo Research Reconstructs 3D Scenes

01/06/2023

Neuralangelo, a new AI model by NVIDIA Research for 3D reconstruction using neural networks, turns 2D video clips into detailed 3D structures - generating lifelike virtual replicas of buildings, sculptures and other real-world objects.

Like Michelangelo sculpting stunning, life-like visions from blocks of marble, Neuralangelo generates 3D structures with intricate details and textures. Creative professionals can then import these 3D objects into design applications, editing them further for use in art, video game development, robotics and industrial digital twins.

Neuralangelo's ability to translate the textures of complex materials - including roof shingles, panes of glass and smooth marble - from 2D videos to 3D assets significantly surpasses prior methods. The high fidelity makes its 3D reconstructions easier for developers and creative professionals to rapidly create usable virtual objects for their projects using footage captured by smartphones.

The 3D reconstruction capabilities Neuralangelo offers will be a huge benefit to creators, helping them recreate the real world in the digital world, said Ming-Yu Liu, senior director of research and co-author on the paper. This tool will eventually enable developers to import detailed objects - whether small statues or massive buildings - into virtual environments for video games or industrial digital twins.

In a demo, NVIDIA researchers showcased how the model could recreate objects as iconic as Michelangelo's David and as commonplace as a flatbed truck. Neuralangelo can also reconstruct building interiors and exteriors - demonstrated with a detailed 3D model of the park at NVIDIA's Bay Area campus.

Neural Rendering Model Sees in 3D Prior AI models to reconstruct 3D scenes have struggled to accurately capture repetitive texture patterns, homogenous colors and strong color variations. Neuralangelo adopts instant neural graphics primitives, the technology behind NVIDIA Instant NeRF, to help capture these finer details.

Using a 2D video of an object or scene filmed from various angles, the model selects several frames that capture different viewpoints - like an artist considering a subject from multiple sides to get a sense of depth, size and shape.

Once it's determined the camera position of each frame, Neuralangelo's AI creates a rough 3D representation of the scene, like a sculptor starting to chisel the subject's shape.

The model then optimizes the render to sharpen the details, just as a sculptor painstakingly hews stone to mimic the texture of fabric or a human figure.

The final result is a 3D object or large-scale scene that can be used in virtual reality applications, digital twins or robotics development.

Find NVIDIA Research at CVPR, June 18-22 Neuralangelo is one of nearly 30 projects by NVIDIA Research to be presented at the Conference on Computer Vision and Pattern Recognition (CVPR), taking place June 18-22 in Vancouver. The papers span topics including pose estimation, 3D reconstruction and video generation.

One of these projects, DiffCollage, is a diffusion method that creates large-scale content - including long landscape orientation, 360-degree panorama and looped-motion images. When fed a training dataset of images with a standard aspect ratio, DiffCollage treats these smaller images as sections of a larger visual - like pieces of a collage. This enables diffusion models to generate cohesive-looking large content without being trained on images of the same scale.

The technique can also transform text prompts into video sequences, demonstrated using a pretrained diffusion model that captures human motion:



Learn more about NVIDIA Research at CVPR.
LINK: https://blogs.nvidia.com/blog/2023/06/01/neuralangelo-ai-research-3d-r...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

29/09/2026

First Baptist Nashville Drastically Upgrades Production Communications with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

29/09/2026

Fubo TV Launches My Local Sports'

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

ARRI Targets Content Creators with New HONOR Smartphone

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Asian News International Enhances Workflow with Grass Valley AMPP, FramelightX

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

SABC Chooses Ikegami UHK-X600 Cameras to Support IP Studio Transition

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

SABC Upgrades to IP-Based Production with Ikegami UHK-X60...

Ikegami announces that the South African Broadcasting Corporation, SABC, has chosen Ikegami UHK-X600 camera systems as part of an advance to IP-based operation ...

29/09/2026

Blendkit Offers 20% Discount to Celebrate Crossing 150K Asset Milestone

Blendkit Offers 20% Discount to Celebrate Crossing 150K Asset Milestone Brie Clayton September 29, 2026 0 Comments Blendkit, the largest 3D asset libr...

29/09/2026

Ease Live Reports over 75 Million Interactive Sessions Du...

Interactive streaming specialist Ease Live supported more than 76.5 million fan sessions across three major European media operators during this summers FIFA Wo...

29/09/2026

Ease Live to monetise key moments in live sports

Ease Live has added support for VAST (Video Ad Serving Template) to its graphical overlay technology, opening up new ways for broadcasters, streamers and rights...

29/09/2026

Rise AV launches awards celebrating the women advocates a...

Rise AV has announced the launch of the inaugural Rise AV Awards, a new global awards programme celebrating the women, advocates and organisations across the AV...

29/09/2026

Netflix Deploys Advanced Sony PTZ Cameras For Wonka's The Golden Ticket' Production

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Massachusetts Broadcasters Association Names Gene Lavanchy 2026 Broadcaster of the Year

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

ESPN Reports Its Most-Watched WNBA Regular Season

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Scripps Taps Digital News Veteran Sean McGarvy to Lead News Strategy

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Gray Raises Political Ad Revenue Estimates

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

Edward Czarnecki Uses Game Theory to Assess ATSC 3.0 Transition Policies

Share Copy link Facebook X Linkedin Bluesky Email...

29/09/2026

First Baptist Nashville Drastically Upgrades Production C...

Clear-Com announced that First Baptist Nashville has upgraded its production communications with a Clear-Com intercom solution as part of a comprehensive sanct...

29/09/2026

Blackmagic Cinema Camera 6K Captured Action Shots for Sketch

Blackmagic Cinema Camera 6K Captured Action Shots for Sketch Brie Clayton September 28, 2026 0 Comments Camera's portable design and dynamic range...

29/09/2026

Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Color Across In-venue Displays at Live Events

Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Co...

29/09/2026

Berklee Alumni and Faculty Nominated for the 2026 Latin Grammy Awards

Berklee Alumni and Faculty Nominated for the 2026 Latin Grammy Awards A total of 28 Berklee alumni and faculty earned nominations across 20 categories this ye...

29/09/2026

Berklee's K-Pop & Beyond Explores Connections Between K-Pop and Hip-Hop

Berklee's K-Pop & Beyond Explores Connections Between K-Pop and Hip-Hop Now in its fifth year, the series brings together artists, industry leaders, and s...

29/09/2026

The energy transition will only succeed if it lasts

We tend to think we live in a digital world, with hopes and fears around artificial intelligence (AI), quantum computing, data centres and the next big technolo...

29/09/2026

Apple releases new guide to help families build healthy digital habits - UPDATE - Posted on 29 September 2026

Today, in partnership with the American Academy of Pediatrics (AAP), Apple relea...

29/09/2026

Final Cut Camera now supports variable aperture on iPhone\u00A018\u00A0Pro - UPDATE - Posted on 29 September 2026

Final Cut Camera, the professional filming app for iPhone, receives a major upda...

29/09/2026

RT lyric fm launch the hunt for Choirs for Christmas

RT lyric fm is proud to announce the annual Choirs for Christmas competition callout. Warm up those vocal chords and join us on RT lyric fm for a celebration ...

28/09/2026

NHL Names Adobe as an Official Creative, Marketing and AI Partner

The NHL has announced Adobe as an Official Creative, Marketing and AI Partner beginning with the 2026-27 season. The partnership will provide the league and its...

28/09/2026

MultiDyne to Showcase Expanded Portfolio Including MRMC Robotics at CABSAT 2026

MultiDyne will exhibit at CABSAT 2026 (October 5-7, Dubai Exhibition Centre), showcasing an expanded technology portfolio following its June 2026 acquisition of...

28/09/2026

ARRI and HONOR Launch Co-Branded HONOR Magic9 Pro Max

ARRI and HONOR have announced the HONOR Magic9 Pro Max, a flagship smartphone carrying ARRI branding on the device and packaging as the first product-level expr...

28/09/2026

Net Insight Adds Nimbra 1020G to Pan-Asian Live Media Trial Network

Net Insight has added the Nimbra 1020G to its pan-Asian live media trial network, giving customers and partners in the region a way to evaluate ST 2110 and JPEG...

28/09/2026

Vindral Named Recipient of 2026 Technology and Engineering Emmy Award

Vindral has been named a recipient of a 2026 Technology and Engineering Emmy Award by the National Academy of Television Arts and Sciences in the category of We...

28/09/2026

Interra Systems to Demonstrate QC and Monitoring Portfolio at CABSAT 2026

Interra Systems will exhibit at CABSAT 2026 (Stand B2-37, Dubai Exhibition Centre, October 5-7), demonstrating its BATON QC platform, ORION monitoring solutions...

28/09/2026

PGA TOUR's Michael Raimondo on Agentic Production, ShotLink Automation, and the Evolution of PGA TOUR Studios

Two years into its new production facility, the TOUR is expanding centralized wo...

28/09/2026

Game Creek Videos Epic Building Run Continues With ESPNs Countdown Unit, Upgrades to Four Others

In addition to rolling out a new mobile unit for ESPN's Monday Night Countd...

28/09/2026

Bleacher Report and WWE Reach Multi-Year Global Content Partnership

Bleacher Report and WWE have announced a multi-year content partnership giving Bleacher Report global highlight rights across WWE's programming slate, inclu...

28/09/2026

Behind The Mic: NBC Sports Shares MLB Wild Card Series Announcing Booth; ESPN Reveals NHL 26-27 Season Talent

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

28/09/2026

Fubo Adds Four NHL Regional Sports Networks for 2026-27 Season

FuboTV has announced a multi-year distribution agreement with the NHL to carry four regional sports networks covering the Carolina Hurricanes, Columbus Blue Jac...

28/09/2026

Program Productions Names Alan Ostfield President and CEO

Program Productions (PPI) has announced the appointment of Alan Ostfield as President and Chief Executive Officer, effective September 28, 2026. Ostfield succee...

28/09/2026

Ha-chan, Shake Your Booty! Encourages Us to Keep Dancing

Director Josef Kubota Wladyka attends the premiere of Ha-Chan, Shake Your Booty! with the film's cast and crew at Eccles Theatre on January 22, 2026, in P...

28/09/2026

Scaler Music introduce Scaler EQ Pro

EQ plug-in can now be played via MIDI Scaler Music have recently released a new and improved version of their patented musical EQ plug-in, kitting it out wi...

28/09/2026

The Asura from Animal Factory Amps

New synth developed in collaboration with philterSoup Boutique effects pedal and Eurorack manufacturer Animal Factory Amps have announced that the new compa...

28/09/2026

Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FSWX signal and spectrum analyzer

Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FS...

28/09/2026

SBE Announces 2026 Ennes Scholarship Recipients

Share Copy link Facebook X Linkedin Bluesky Email...

28/09/2026

Spectrum to Demo AI Computing at the Network's Edge at SCTE TechExpo 26

Share Copy link Facebook X Linkedin Bluesky Email...

28/09/2026

Autoscript launches new Voice Controller prompting soluti...

Autoscript, the leading global provider of professional teleprompting solutions, today announced Voice Controller for WinPlus-IP, a new voice-controlled prompti...

28/09/2026

IBC 2026 Technical Conference Highlights

IBC 2026 Technical Conference Highlights David Kirk September 28, 2026 0 Comments Hero image courtesy Deposit Photos David Kirk reports from the 11-1...

28/09/2026

First Baptist Nashville Taps Clear-Com for Production Coms

Share Copy link Facebook X Linkedin Bluesky Email...