Sony Pixel Power calrec Sony

Digital Renaissance: NVIDIA Neuralangelo Research Reconstructs 3D Scenes

01/06/2023

Neuralangelo, a new AI model by NVIDIA Research for 3D reconstruction using neural networks, turns 2D video clips into detailed 3D structures - generating lifelike virtual replicas of buildings, sculptures and other real-world objects.

Like Michelangelo sculpting stunning, life-like visions from blocks of marble, Neuralangelo generates 3D structures with intricate details and textures. Creative professionals can then import these 3D objects into design applications, editing them further for use in art, video game development, robotics and industrial digital twins.

Neuralangelo's ability to translate the textures of complex materials - including roof shingles, panes of glass and smooth marble - from 2D videos to 3D assets significantly surpasses prior methods. The high fidelity makes its 3D reconstructions easier for developers and creative professionals to rapidly create usable virtual objects for their projects using footage captured by smartphones.

The 3D reconstruction capabilities Neuralangelo offers will be a huge benefit to creators, helping them recreate the real world in the digital world, said Ming-Yu Liu, senior director of research and co-author on the paper. This tool will eventually enable developers to import detailed objects - whether small statues or massive buildings - into virtual environments for video games or industrial digital twins.

In a demo, NVIDIA researchers showcased how the model could recreate objects as iconic as Michelangelo's David and as commonplace as a flatbed truck. Neuralangelo can also reconstruct building interiors and exteriors - demonstrated with a detailed 3D model of the park at NVIDIA's Bay Area campus.

Neural Rendering Model Sees in 3D Prior AI models to reconstruct 3D scenes have struggled to accurately capture repetitive texture patterns, homogenous colors and strong color variations. Neuralangelo adopts instant neural graphics primitives, the technology behind NVIDIA Instant NeRF, to help capture these finer details.

Using a 2D video of an object or scene filmed from various angles, the model selects several frames that capture different viewpoints - like an artist considering a subject from multiple sides to get a sense of depth, size and shape.

Once it's determined the camera position of each frame, Neuralangelo's AI creates a rough 3D representation of the scene, like a sculptor starting to chisel the subject's shape.

The model then optimizes the render to sharpen the details, just as a sculptor painstakingly hews stone to mimic the texture of fabric or a human figure.

The final result is a 3D object or large-scale scene that can be used in virtual reality applications, digital twins or robotics development.

Find NVIDIA Research at CVPR, June 18-22 Neuralangelo is one of nearly 30 projects by NVIDIA Research to be presented at the Conference on Computer Vision and Pattern Recognition (CVPR), taking place June 18-22 in Vancouver. The papers span topics including pose estimation, 3D reconstruction and video generation.

One of these projects, DiffCollage, is a diffusion method that creates large-scale content - including long landscape orientation, 360-degree panorama and looped-motion images. When fed a training dataset of images with a standard aspect ratio, DiffCollage treats these smaller images as sections of a larger visual - like pieces of a collage. This enables diffusion models to generate cohesive-looking large content without being trained on images of the same scale.

The technique can also transform text prompts into video sequences, demonstrated using a pretrained diffusion model that captures human motion:



Learn more about NVIDIA Research at CVPR.
LINK: https://blogs.nvidia.com/blog/2023/06/01/neuralangelo-ai-research-3d-r...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

21/01/2026

Netflix Amends Warner Bros Discovery Bid to Offer All Cash

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

21/01/2026

Advanced Systems Group Inks Exclusive Partnership With Nu-Studio

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

21/01/2026

SWIT Ships New Powercell Camera Battery Series

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

21/01/2026

Netflix Q4 Earnings Exceed Expectations as Subs Top 325 Million

Share Share by: Copy link Facebook X Linkedin Pinterest Bluesky Email...

20/01/2026

SVG Sit-Down: BitFire's Jim Akimchuk on the Future of Cloud, Remote, Software-Defined Live Production

SVG Sit-Down: BitFire's Jim Akimchuk on the Future of Cloud, Remote, Softwar...

20/01/2026

From Architecture to Reality: What CBC's Milano Cortina 2026 Workflows Tell Us About DMF and MXL in Live Sport

From architecture to reality: What CBC's Milano Cortina 2026 workflows tell ...

20/01/2026

Milano Cortina 2026: Making the Winter Olympics and Paralympics Workflow Work for France Tlvisions

Milano Cortina 2026: Making the Winter Olympics and Paralympics workflow work fo...

20/01/2026

Countdown to Milano Cortina 2026: SVG Launches SportsTechLive Blog in Lead-up to Winter Games

Countdown to Milano Cortina 2026: SVG Launches SportsTechLive Blog in Lead-up to...

20/01/2026

Grand Finale: Rally Saudi Arabia Pushes WRC to Make the Most of Cameras and Drones for Sandy Spectacle

Grand finale: Rally Saudi Arabia pushes WRC to make the most of cameras and dron...

20/01/2026

State of Change: What's Happening in the Remote-Production Business?

State of Change: What's Happening in the Remote-Production Business?NEP Group, Game Creek Video, Dome Productions, Mobile TV Group, Program Productions exec...

20/01/2026

CFP National Championship 2026: A Look Back at SVG's Complete Coverage

CFP National Championship 2026: A Look Back at SVG's Complete CoverageGo behind the scenes with ESPN, Game Creek Video, Van Wagner, and the champion Indiana...

20/01/2026

Centering the Artist: Why We're Launching the AI Literacy Initiative

The Gotham, Film Independent, and Creators Coalition on AI Join Alliance by Michelle Satter, Founding Senior Director, Sundance Institute's Artist Programs...

20/01/2026

19th Annual South African Film and Television Awards (SAFTAs) open the call for Discretionary Award Nominations

The National Film and Video Foundation (NFVF), an agency of the Department of Sp...

20/01/2026

The Gauge: Poland | December 2025

December, the first month of winter and the holiday season, has traditionally encouraged families to spend time together in front of the television. During this...

20/01/2026

The Gauge: Mexico December 2025

During December, streaming's share of TV viewing in Mexico settled at 24.3%, an increase of 0.1 share points from the previous month. Disclaimer: YUMI TV,...

20/01/2026

Streaming Shatters Multiple Records in December 2025 with 47.5% of TV Viewing, according to Nielsen's The Gauge

Christmas Day is Most-Streamed Day Ever with 55 Billion Viewing Minutes, led by...

20/01/2026

Nielsen: Streaming Shatters Multiple Records in December 2025

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

20/01/2026

Disguise and ASB GlassFloor Announce Official Partnership...

Disguise and ASB GlassFloor today announced a strategic partnership that turns the arena floor into a fully customizable interactive digital surface. This will ...

20/01/2026

LiveU Enables Cloud Production Workflow for First Ever IT...

Last summer, ITV celebrated the tenth anniversary of its popular reality dating show, Love Island. To ramp up the excitement of series 12 (launched in the UK on...

20/01/2026

Berklee's Mark Ethier Named One of SPIN's Most Influential People in Music for 2026

Berklee's Mark Ethier Named One of SPIN's Most Influential People in Mus...

20/01/2026

Sports Illustrated Launches New Streaming Channel SI TV

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

20/01/2026

S&P: Funding for GenAI Applications Nearly Tripled in 2025

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

20/01/2026

Emergent to Showcase AI-First Broadcast Graphics Platform...

Emergent, a provider of AI-powered media production solutions, today announced its presence at ISE 2026 in Barcelona, taking place February 3 6, where it will u...

20/01/2026

Netflix and Warner Bros. Discovery Amend Agreement to All-Cash Transaction

Back to All News Netflix and Warner Bros. Discovery Amend Agreement to All-Cash Transaction Business 20 January 2026 Global Link copied to clipboard All-C...

20/01/2026

Now You Can Play a Role in Our Live Events With Real-Time Voting

Back to All News Now You Can Play a Role in Our Live Events With Real-Time Voting Elmar Nubbemeyer VP, Member Product Product 20 January 2026 Global Link...

19/01/2026

CFP National Championship 2026: Indiana Football's Digital Crew Generate Hype Around Undefeated Run to Miami

CFP National Championship 2026: Indiana Football's Digital Crew Generate Hyp...

19/01/2026

CFP National Championship 2026: Van Wagner Relies on Experience for Indiana-Miami Matchup at Hard Rock Stadium

CFP National Championship 2026: Van Wagner Relies on Experience for Indiana-Miam...

19/01/2026

CFP National Championship 2026: Game Creek Video Fields Premiere IP Compound for ESPN Game, Studio Coverage

CFP National Championship 2026: Game Creek Video Fields Premiere IP Compound for...

19/01/2026

CFP National Championship 2026: For a Slew of Studio Shows, ESPN Turns Hard Rock Stadium Into a Production Campus

CFP National Championship 2026: For a Slew of Studio Shows, ESPN Turns Hard Rock...

19/01/2026

CFP National Championship 2026: ESPN's Sweeping Live Game Production Leverages Deep Specialty Camera Lineup, IP-Connected Compound

CFP National Championship 2026: ESPN's Sweeping Live Game Production Leverag...

19/01/2026

The NOVA Binocular System: The Future of Night Vision

The new L3Harris NOVA binocular system is the every-soldier goggle' - and the beginning of a new era for night-vison capability....

19/01/2026

Nielsen: Two-Thirds of Black Consumers Pay More Attention To Ads That Reflect Their Culture

The Majority of Those Surveyed Prefer to Buy Brands Who Advertise in Content Tha...

19/01/2026

Straight to Hell' Sets April 27 Premiere: Teaser Trailer, Art, and Additional Cast Revealed

Back to All News Straight to Hell' Sets April 27 Premiere: Teaser Trailer,...

19/01/2026

Broadcast Pix Releases Version 10.3 Software

New Workflow Enhancements for All Broadcast Pix Systems, Plus 4-Channel ISO Recording for Hybrid and Roadie Tyngsboro, Mass. - January 2025 - Broadcast Pix ann...

19/01/2026

Sky News reinvents News at Ten for the modern audience with The Wrap

Monday 19 January 2026 Sky News reinvents News at Ten for the modern audience with The Wrap Sky News today announces The Wrap, a bold evolution of its 10pm ou...

19/01/2026

Netflix Announces the Series 'Nights & Days,' Directed by Kamila Tarabura

Back to All News Netflix Announces the Series Nights & Days, Directed by Kamila...

19/01/2026

Redefining piano miking with the new DPK2015 Piano Stereo Kit

DPA Microphones is striking a new chord in piano miking with the debut of its DPK2015 Piano Stereo Kit, an out-of-the-box, plug-and-play miking solution that ta...

19/01/2026

Showcasing the enhanced 4099 CORE+ instrument mic and clip system at the 2026 NAMM Show

DPA Microphones will present its 4099 CORE Instrument Microphone and redesigned...

19/01/2026

Trianel relies on Arvato Systems for future-proof data center operation

Trianel relies on Arvato Systems for future-proof data center operations Moving to the cloud: Arvato Systems implements extensive IT migration project Migrat...

19/01/2026

RT Choice Music Prize Irish Album of the Year 2025 Shortlist Announcement

Celebrating 21 Years of the RT Choice Music Prize RT Choice Music Prize In association with IMRO and IRMA Irish Album of the Year 2025 - Shortlist Announce...

18/01/2026

Dolby Cinema Arrives in Bengaluru: Dolby Laboratories and AMB Cinemas Bring a Truly Unique and Transformative Experie...

January 18 2026, 21:30 (PST) Dolby Cinema Arrives in Bengaluru: Dolby Laborator...

17/01/2026

Lightware and Google enhance meeting room flexibility wit...

Lightware, an industry leader in signal management, is helping to elevate the Google Meet experience with the introduction of an integration with Taurus UCX. Th...

17/01/2026

Clear-Com Partners with NETGEAR to Deliver OEM Networking...

Clear-Com announced a strategic partnership with NETGEAR AV to offer four high-performance networking switches as original equipment manufacturer (OEM) solutio...

17/01/2026

QuickLink Expands US Reach With Midwich Distribution

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, today announced a new U.S. distribution partnership wit...

17/01/2026

NUGEN Audio Launches the Next Evolution of MasterCheck

NUGEN Audio announces the latest evolution of MasterCheck, its industry-trusted optimization plug-in for cross-platform mastering and loudness verification. Des...