Sony Pixel Power calrec Sony

NVIDIA Instant NeRF Wins Best Paper at SIGGRAPH, Inspires Creative Wave Amid Tens of Thousands of Downloads

05/08/2022

3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.

Since its debut earlier this year, tens of thousands of developers around the world have downloaded the source code and used it to render spectacular scenes, sharing eye-catching results on social media.

The research behind Instant NeRF is being honored as a best paper at SIGGRAPH - which runs Aug. 8-11 in Vancouver and online - for its contribution to the future of computer graphics research. One of just five papers selected for this award, it's among 17 papers and workshops with NVIDIA authors that are being presented at the conference, covering topics spanning neural rendering, 3D simulation, holography and more.

NVIDIA recently held an Instant NeRF sweepstakes, asking developers to share 3D scenes created with the software for a chance to win a high-end NVIDIA GPU. Hundreds participated, posting 3D scenes of landmarks like Stonehenge, their backyards and even their pets.

Among the creators using Instant NeRF are:

Through the Looking Glass: Karen X. Cheng and James Perlman San Francisco-based creative director Karen X. Cheng is working with software engineer James Perlman to render 3D scenes that test the boundaries of what Instant NeRF can create.

The duo has used Instant NeRF to create scenes that explore reflections within a mirror (shown above) and handle complex environments with multiple people - like a group enjoying ramen at a restaurant.

The algorithm itself is groundbreaking - the fact that you can render a physical scene with higher fidelity than normal photogrammetry techniques is just astounding, Perlman said. It's incredible how accurately you can reconstruct lighting, color differences or other tiny details.

It even makes mistakes look artistic, said Cheng. We really lean into that, and play with training a scene less sometimes, experimenting with 1,000, or 5,000 or 50,000 iterations. Sometimes I'll prefer the ones trained less because the edges are softer and you get an oil-painting effect.

Using prior tools, it would take them three or four days to train a decent-quality scene. With Instant NeRF, the pair can churn out about 20 a day, using an NVIDIA RTX A6000 GPU to render, train and preview their 3D scenes.

With rapid rendering comes faster iteration.

Being able to render quickly is very necessary for the creative process. We'd meet up and shoot 15 or 20 different versions, run them overnight and then see what's working, said Cheng. Everything we've published has been shot and reshot a dozen times, which is only possible when you can run several scenes a day.

Preserving Moments in Time: Hugues Bruy re Hugues Bruy re, partner and chief of innovation at Dpt., a Montreal-based creative studio, uses Instant NeRF daily.

3D captures have always been of strong interest to me because I can go back to those volumetric reconstructions and move in them, adding an extra dimension of meaning to them, he said.

Bruy re rendered 3D scenes with Instant NeRF using the data he'd previously captured for traditional photogrammetry relying on mirrorless digital cameras, smartphones, 360 cameras and drones. He uses an NVIDIA GeForce RTX 3090 GPU to render his Instant NeRF scenes.

Bruy re believes Instant NeRF could be a powerful tool to help preserve and share cultural artifacts through online libraries, museums, virtual-reality experiences and heritage-conservation projects.

The aspect of capturing itself is being democratized, as camera and software solutions become cheaper, he said. In a few months or years, people will be able to capture objects, places, moments and memories and have them volumetrically rendered in real time, shareable and preserved forever.

Using pictures taken with a smartphone, Bruy re created an Instant NeRF render of an ancient marble statue of Zeus from an exhibition at Toronto's Royal Ontario Museum.

Stepping Into Remote Scenes: Jonathan Stephens Jonathan Stephens, chief evangelist for spatial computing company EveryPoint, has been exploring Instant NeRF for both creative and practical applications.

EveryPoint reconstructs 3D scenes such as stockpiles, railyards and quarries to help businesses manage their resources. With Instant NeRF, Stephens can capture a scene more completely, allowing clients to freely explore a scene. He uses an NVIDIA GeForce RTX 3080 GPU to run scenes rendered with Instant NeRF.

What I really like about Instant NeRF is that you quickly know if your render is working, Stephens said. With a large photogrammetry set, you could be waiting hours or days. Here, I can test out a bunch of different datasets and know within minutes.

He's also experimented with making NeRFs using footage from lightweight devices like smart glasses. Instant NeRF could turn the low-resolution, bumpy footage from Stephens walking down the street into a smooth 3D scene.

Find NVIDIA at SIGGRAPH Tune in for a special address by NVIDIA CEO Jensen Huang and other senior leaders on Tuesday, Aug. 9, at 9 a.m. PT to hear about the research and technology behind AI-powered virtual worlds.

NVIDIA is also presenting a score of in-person and virtual sessions for SIGGRAPH attendees, including:

The Next Evolution of Universal Scene Description (USD) for Building Virtual Worlds

Real-Time Collaboration in Ray-Traced VR

Meet the Researchers: How to Use NVIDIA Kaolin in Your 3D Deep Learning Workflows

The Future of Extended Reality: How Immersion Will Change Everything

Learn how to create with Instant NeRF in the hands-on demo, NVIDIA Instant NeRF - Getting Started With Neural Radiance Fields. Instant NeRF will also be part of SIGGRAPH's Real-Time Live showcase - where in-person attendees can vote for a winning project.

For more interactive sessions
LINK: https://blogs.nvidia.com/blog/2022/08/05/instant-nerf-creators-siggrap...
See more stories from nvidia

Most recent headlines

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

15/06/2025

Music Production for Women free in-person workshops

July 2025 in Dublin, Berlin, Amsterdam & London Photo: Thea Martre Music Production for Women (MPW) have announced that they will be running a series of fo...

15/06/2025

Jason's Piano & API Drums instruments from Sulcata Sound

Composer/producer launches free virtual instruments Sulcata Sound is the latest venture of Jason Graves, a two-time British Academy Award-winnning composer,...

14/06/2025

Pluto TV Adds All Womens Sports Network's FAST Channel

NEW YORK Pluto TV and the All Womens Sports Network have launched a free ad-supported streaming TV (FAST) AWSN channel in the U.S., Canada, the U.K. and the Nor...

14/06/2025

Scripps Inks Multiyear Agreement for WNBA Games on Ion

NEW YORK and CINCINNATI E.W. Scripps has announced a new, multiyear agreement with the WNBA that will continue Ions regular-season coverage of the league on Fri...

14/06/2025

NAB Highlights Hidden Importance of Spectrum in Major Sports Broadcasting

WASHINGTON The National Association of Broadcasters highlighted the hidden importance of spectrum in the production of major sporting events and described wha...

14/06/2025

1.0 Sunset, BPS and NextGen Broadcast's Potential Dominate ATSC Meeting

WASHINGTON Sunsetting ATSC 1.0, expanding business opportunities for NextGen Broadcast and increasing international adoption of the ATSC 3.0 standard were top o...

14/06/2025

Samba TV and Acxiom Announce Massive 40-market Global Expansion

SAN FRANCISCO Samba TV and Acxiom have announced that they will dramatically expand their longstanding relationship....

14/06/2025

MPW announce free in-person workshops

July 2025 in Dublin, Berlin, Amsterdam & London Photo: Thea Martre Music Production for Women (MPW) have announced that they will be running a series of fo...

14/06/2025

San Francisco State University's School of Cinema Uses Blackmagic Design

San Francisco State University's School of Cinema Uses Blackmagic Design Brie Clayton June 13, 2025 0 Comments More than 40 Blackmagic Design came...

14/06/2025

Boris FX Mocha Pro Adds New AI Tools To Tackle VFX Tasks Fast

Boris FX Mocha Pro Adds New AI Tools To Tackle VFX Tasks Fast Jessie Electa Petrov June 13, 2025 0 Comments The 2025.5 release helps artists work more...

14/06/2025

AJA Debuts DRM2-Plus Mini-Converter Frame at InfoComm 2025

AJA Debuts DRM2-Plus Mini-Converter Frame at InfoComm 2025 Brie Clayton June 13, 2025 0 Comments Next-gen frame addresses diverse rackmount needs wit...

13/06/2025

Prime Minister: A Behind-the-Scenes Look at a Leader Who Champions Kindness

(L-R) Lindsay Utz, Michelle Walshe, and The Right Honourable Dame Jacinda Ardern attend the 2025 Sundance Film Festival premiere of Prime Minister at Eccles T...

13/06/2025

Materialists' Director Celine Song Reveals the Inspirations Behind the Film's Soundtrack

Photo credit: Atsushi Nishijima If you're a true lover of rom-coms, chances...

13/06/2025

Pure Drama and Fierce Rivalries set to dominate the world's most iconic sporting event

Pure Drama and Fierce Rivalries set to dominate the world's most iconic spor...

13/06/2025

Press Release: NFVF Opens Call for Public Film Screenings on GBV Awareness as South Africa Confronts Ongoing Femicide Crisis

Johannesburg, 12 June 2025 - The National Film and Video Foundation (NFVF), an a...

13/06/2025

Central Texas Storm Knocks out KTXS Tower, Severely Damages Building

ABILENE. Texas A severe storm knocked down the tower and severely damaged the news studio and main facility of Sinclair-owned KTXS here on Sunday, June 8....

13/06/2025

Berklee's Music Business/Management Department Recognized by the Music Biz Association

Berklee's Music Business/Management Department Recognized by the Music Biz A...

13/06/2025

ATSC Honors Aldo Cugnini, Clarence Hau

WASHINGTON The ATSC, the Broadcast Standards Association, honored veteran technologist Aldo Cugnini and Clarence Hau, Senior Vice President of Standards, Policy...

13/06/2025

ESPN Doubles Down on Immersive Fan Experience for UFL Championship

(Editor's note: The 2025 UFL Championship Game between the D.C. Defenders and Michigan Panthers kicks off Saturday, June 14, at 8 p.m. Eastern. The game wil...

13/06/2025

Soulyft Audio release Chime

New iPad/iPhone synth App announced Following on from last year's release of Gradient Synth - which reached #6 on the App Store's Paid Music charts ...

13/06/2025

HBO Max Plans July Launches in 12 New Markets

LONDON Warner Bros. Discovery has announced that HBO Max will launch direct-to-consumer in multiple new countries this July as the streamer becomes available in...

13/06/2025

Verbit Launches Speaker Identification for Live ASR Broadcast Captions

AI voice transcription and captioning platform Verbit has added a new feature to its Captivate ASR solution the ability to identify specific features in automat...

13/06/2025

FCC's Anna Gomez Meets with TV Networks, Studio Execs and Unions

WASHINGTON Federal Communications Commission member Anna Gomez has wrapped up two weeks in California visiting broadcasters, television studio executives, enter...

13/06/2025

House Passes Rescission Package That Would Claw Back CPB Funding

WASHINGTON The U.S. House of Representatives voted mostly along party lines to approve a rescission package that would cancel $9.4 billion in previously approve...

13/06/2025

AJA Debuts DRM2-Plus Mini-Converter Frame at InfoComm 202...

At InfoComm 2025, AJA Video Systems announced DRM2-Plus, an intuitive, high-capacity 3RU frame that can neatly house up to 24 AJA Mini-Converters. Tailored to s...

13/06/2025

National CineMedia Selects Operatives Suite of AI-Based C...

Cinema advertising leader to leverage AOS and suite of AI-enabled solutions to optimize forecasting, yield management, and streamlined ad sales and operations a...

13/06/2025

Manfrotto Unveils Unique New Tripod System for Mirrorless...

Manfrotto has launched the ONE Hybrid Tripod, a new support system designed specifically for professional content creators working with mirrorless cameras acros...

13/06/2025

Synamedia unveils security enhancements to its Media Edge...

Leading video software provider, Synamedia, today announced that its Media Edge Gateway (MEG), an ATSC 3.0 software-based IRD, now supports Device Security requ...

13/06/2025

LiveU Strengthens Presence in DACH Region with Strategic...

LiveU, the global leader in live IP-video contribution, production and distribution solutions, is deepening its commitment to the German-speaking market with th...

13/06/2025

Chaos Adds AI Tools Faster Animation Renders and More Sty...

Chaos, the leader in architectural visualisation software, today announces Chaos Corona 13, giving archviz designers new ways to add eye-catching style and flai...

13/06/2025

PALI's Nena Music Video Shot with Blackmagic Design

PALI's Nena Music Video Shot with Blackmagic Design Brie Clayton June 12, 2025 0 Comments Blackmagic Cinema Camera 6K and DaVinci Resolve Studio b...

13/06/2025

OddBeast Powers Up iRobot's Newest Roombas with Suite of CGI Launch Assets

OddBeast Powers Up iRobot's Newest Roombas with Suite of CGI Launch Assets Brie Clayton June 12, 2025 0 Comments The motion design and production ...

13/06/2025

On Chick Coreas Birthday, a Newly Uncovered Archival Release

On Chick Coreas Birthday, a Newly Uncovered Archival Release The Visitors, composed by Corea and performed by vibraphonist Gary Burton and pianist Kirill Gers...

13/06/2025

RT Seeks Expressions of Interest for on-air presenting roles on RT Radio 1 and RT News & Current Affairs Output

In fulfilment of a recommendation by the Government's Expert Advisory Commit...

13/06/2025

SVG Sit-Down: Backblaze's Gleb Budman Talks Products, Partnerships, and the Growth in Cloud Storage

SVG Sit-Down: Backblaze's Gleb Budman Talks Products, Partnerships, and the ...

13/06/2025

SVG Sit-Down: DAZN's Walker Jacobs Calls Streaming the FIFA Club World Cup The Most Ambitious Thing We've Ever Done in the U.S.'

SVG Sit-Down: DAZN's Walker Jacobs Calls Streaming the FIFA Club World Cup ...

13/06/2025

New Sponsor Spotlight: Vecima Networks' Paul Strickland on How Improving QoE for Sports Fans Can Deliver Real ROI

New Sponsor Spotlight: Vecima Networks' Paul Strickland on How Improving QoE...

13/06/2025

Pitch Perspective: Where's Next for Specialty Cameras in Soccer?

Pitch Perspective: Where's Next for Specialty Cameras in Soccer? Leaders from Sky Austria and ACS discuss the possibilities of camera placement pitchside B...

13/06/2025

Premiership Rugby Final 2025: Vintage Clash Between Bath and Leicester Gets Full TNT Sports Treatment with AR, RefCam 3.0 and Player Mic

Premiership Rugby Final 2025: Vintage clash between Bath and Leicester gets full...

13/06/2025

Premiership Rugby Final 2025: TNT Sports Gears Up for Bath vs Leicester Battle with Huge Uptick in Season Audience Views

Premiership Rugby Final 2025: TNT Sports gears up for Bath vs Leicester battle w...

13/06/2025

NCAA Men's College World Series: ESPN Adds Two-Point SupraCam, Invests in Nearly 100 Mics to Enhance Audio

NCAA Men's College World Series: ESPN Adds Two-Point SupraCam, Invests in Ne...

13/06/2025

New FSWX signal and spectrum analyzer with novel architecture overcomes limits of todays analysis methods

New FSWX signal and spectrum analyzer with novel architecture overcomes limits o...

13/06/2025

2025-05-28

Apple today announced the addition of iPad to Self Service Repair, providing iPad owners with access to repair manuals, genuine Apple parts, Apple Diagnostics t...

13/06/2025

2025-06-09

CUPERTINO, CALIFORNIA Apple today previewed iOS 26, a major update that brings a beautiful new design, intelligent experiences, and improvements to the apps use...

13/06/2025

2025-06-10

At Apple's Worldwide Developers Conference (WWDC), Apple unveiled Apple Games, an all-new destination designed to help players jump back into the games they...

13/06/2025

NVIDIA and Deutsche Telekom Partner to Advance Germany's Sovereign AI

Industrial AI isn't slowing down. Germany is ready. Following London Tech Week and GTC Paris at VivaTech, NVIDIA founder and CEO Jensen Huang's Europea...

12/06/2025

Spotify's Heart & Soul Initiative Brings Mental Health Support to Artists and Creators Worldwide

In 2018, Spotify launched Heart & Soul, a mental health initiative developed to ...

12/06/2025

50 Years Strong: SBS and NITV Supercharge NAIDOC Week 2025 in a joint 50th celebration

50 Years Strong: SBS and NITV Supercharge NAIDOC Week 2025 in a joint 50th celeb...