Sony Pixel Power calrec Sony

NVIDIA Instant NeRF Wins Best Paper at SIGGRAPH, Inspires Creative Wave Amid Tens of Thousands of Downloads

05/08/2022

3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.

Since its debut earlier this year, tens of thousands of developers around the world have downloaded the source code and used it to render spectacular scenes, sharing eye-catching results on social media.

The research behind Instant NeRF is being honored as a best paper at SIGGRAPH - which runs Aug. 8-11 in Vancouver and online - for its contribution to the future of computer graphics research. One of just five papers selected for this award, it's among 17 papers and workshops with NVIDIA authors that are being presented at the conference, covering topics spanning neural rendering, 3D simulation, holography and more.

NVIDIA recently held an Instant NeRF sweepstakes, asking developers to share 3D scenes created with the software for a chance to win a high-end NVIDIA GPU. Hundreds participated, posting 3D scenes of landmarks like Stonehenge, their backyards and even their pets.

Among the creators using Instant NeRF are:

Through the Looking Glass: Karen X. Cheng and James Perlman San Francisco-based creative director Karen X. Cheng is working with software engineer James Perlman to render 3D scenes that test the boundaries of what Instant NeRF can create.

The duo has used Instant NeRF to create scenes that explore reflections within a mirror (shown above) and handle complex environments with multiple people - like a group enjoying ramen at a restaurant.

The algorithm itself is groundbreaking - the fact that you can render a physical scene with higher fidelity than normal photogrammetry techniques is just astounding, Perlman said. It's incredible how accurately you can reconstruct lighting, color differences or other tiny details.

It even makes mistakes look artistic, said Cheng. We really lean into that, and play with training a scene less sometimes, experimenting with 1,000, or 5,000 or 50,000 iterations. Sometimes I'll prefer the ones trained less because the edges are softer and you get an oil-painting effect.

Using prior tools, it would take them three or four days to train a decent-quality scene. With Instant NeRF, the pair can churn out about 20 a day, using an NVIDIA RTX A6000 GPU to render, train and preview their 3D scenes.

With rapid rendering comes faster iteration.

Being able to render quickly is very necessary for the creative process. We'd meet up and shoot 15 or 20 different versions, run them overnight and then see what's working, said Cheng. Everything we've published has been shot and reshot a dozen times, which is only possible when you can run several scenes a day.

Preserving Moments in Time: Hugues Bruy re Hugues Bruy re, partner and chief of innovation at Dpt., a Montreal-based creative studio, uses Instant NeRF daily.

3D captures have always been of strong interest to me because I can go back to those volumetric reconstructions and move in them, adding an extra dimension of meaning to them, he said.

Bruy re rendered 3D scenes with Instant NeRF using the data he'd previously captured for traditional photogrammetry relying on mirrorless digital cameras, smartphones, 360 cameras and drones. He uses an NVIDIA GeForce RTX 3090 GPU to render his Instant NeRF scenes.

Bruy re believes Instant NeRF could be a powerful tool to help preserve and share cultural artifacts through online libraries, museums, virtual-reality experiences and heritage-conservation projects.

The aspect of capturing itself is being democratized, as camera and software solutions become cheaper, he said. In a few months or years, people will be able to capture objects, places, moments and memories and have them volumetrically rendered in real time, shareable and preserved forever.

Using pictures taken with a smartphone, Bruy re created an Instant NeRF render of an ancient marble statue of Zeus from an exhibition at Toronto's Royal Ontario Museum.

Stepping Into Remote Scenes: Jonathan Stephens Jonathan Stephens, chief evangelist for spatial computing company EveryPoint, has been exploring Instant NeRF for both creative and practical applications.

EveryPoint reconstructs 3D scenes such as stockpiles, railyards and quarries to help businesses manage their resources. With Instant NeRF, Stephens can capture a scene more completely, allowing clients to freely explore a scene. He uses an NVIDIA GeForce RTX 3080 GPU to run scenes rendered with Instant NeRF.

What I really like about Instant NeRF is that you quickly know if your render is working, Stephens said. With a large photogrammetry set, you could be waiting hours or days. Here, I can test out a bunch of different datasets and know within minutes.

He's also experimented with making NeRFs using footage from lightweight devices like smart glasses. Instant NeRF could turn the low-resolution, bumpy footage from Stephens walking down the street into a smooth 3D scene.

Find NVIDIA at SIGGRAPH Tune in for a special address by NVIDIA CEO Jensen Huang and other senior leaders on Tuesday, Aug. 9, at 9 a.m. PT to hear about the research and technology behind AI-powered virtual worlds.

NVIDIA is also presenting a score of in-person and virtual sessions for SIGGRAPH attendees, including:

The Next Evolution of Universal Scene Description (USD) for Building Virtual Worlds

Real-Time Collaboration in Ray-Traced VR

Meet the Researchers: How to Use NVIDIA Kaolin in Your 3D Deep Learning Workflows

The Future of Extended Reality: How Immersion Will Change Everything

Learn how to create with Instant NeRF in the hands-on demo, NVIDIA Instant NeRF - Getting Started With Neural Radiance Fields. Instant NeRF will also be part of SIGGRAPH's Real-Time Live showcase - where in-person attendees can vote for a winning project.

For more interactive sessions
LINK: https://blogs.nvidia.com/blog/2022/08/05/instant-nerf-creators-siggrap...
See more stories from nvidia

Most recent headlines

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

30/06/2025

Discover Weekly Turns 10: Celebrating 100 Billion+ Tracks Streamed and a Decade of Personalized Discovery

There's nothing quite like the magic of finding music that feels made just f...

30/06/2025

Spotify's Editors Pick Their Best Songs of the Year (So Far)

When it comes to new music, Spotify's team of editors across North America is always on the hunt for songs that make them feel, think, and move. They're...

30/06/2025

SBS On Demand boosts global news offering with launch of France 24 FAST Channel

SBS On Demand boosts global news offering with launch of France 24 FAST Channel 30 June, 2025 Media releases SBS is expanding its international news offeri...

30/06/2025

The Forsytes Season 2 Commissioned by MASTERPIECE on PBS

Star Studded Ensemble Cast Are Joined by Richard Rankin as Filming Begins on the Second Season [June 12, 2025 - Boston, MA]: The Forsytes, Debbie Horsfield...

30/06/2025

Artemis II Mission Advances with Successful RS-25 Engine Checkout Tests

The Artemis II Space Launch System core stage is integrated with the solid rocket boosters inside High Bay 3 of the Vehicle Assembly Building at NASAs Kennedy S...

30/06/2025

WRAL-WRAZ Raleigh Names Heather Gray as VP and GM

RALEIGH, N.C. Capitol Broadcasting Co. has named Heather Gray vice president and general manager of WRAL-TV and WRAZ-TV here....

30/06/2025

VAB Awards JJ Freeman Engineering Award to Bill Sewell of WTKR/WGNT

The Virginia Association of Broadcasters has recognized Bill Sewell, Director of Engineering at WTKR & WGNT in Norfolk, Va. as the recipient of the 2025 J.J. Fr...

30/06/2025

SBE Recruits 49 New Members

The Society of Broadcast Engineers said its annual member drive resulted in the recruitment of 49 individual members....

30/06/2025

Avid Releases Full Integration of MediaCentral, Wolftech News

BURLINGTON, Mass. Avid today released its fully integrated news platform, uniting MediaCentral and Wolftech News in a single newsroom solution, and will demonst...

30/06/2025

FCC Fines Sinclair $500,000

WASHINGTON The Federal Communication's Enforcement and Media Bureaus have entered into a Consent Decree with Sinclair Broadcast Group to resolve a variety o...

30/06/2025

Qu-Bit announce the Bloom v2

Eurorack sequencer module reimagined California-based modular synth innovators Qu-Bit have announced the launch of a new module that offers a fresh new take...

30/06/2025

Berklee at Umbria Jazz Clinics to Host 40th Anniversary Concert

Berklee at Umbria Jazz Clinics to Host 40th Anniversary Concert The celebration will be held on July 10 in Perugia, Italy. By Colette Greenstein June 30, 202...

30/06/2025

PremiumBeat Tips and Tricks

PremiumBeat Tips and Tricks Brie Clayton June 30, 2025 0 Comments When editing to impress, you'll need quality music, and if your studio happens t...

30/06/2025

Techivation launch T-De-Esser Pro Mk2

Improved dynamic behaviour, improved audio quality & more Techivation have announced the release of an upgraded edition of their very first premium plug-in,...

30/06/2025

German premiere with live flight demonstration: German industry team showcases electromagnetic combat from the air

German premiere with live flight demonstration: German industry team showcases e...

30/06/2025

Beln Cuesta and Karra Elejalde Star in 'El nio', the New Film by Mariano Barroso

Back to All News Bel n Cuesta and Karra Elejalde Star in El ni o, the New Film ...

30/06/2025

A New Dangerous Troll Awakens: Netflix Unleashes Teaser for 'Troll 2'

Back to All News A New Dangerous Troll Awakens: Netflix Unleashes Teaser for Troll 2Play Video Play Video Entertainment 30 June 2025 GlobalNorwayDenmarkSwe...

30/06/2025

The Focusrite Summer Sale is now on

The Focusrite Summer Sale is now on Don't miss unbeatable deals on Scarlett, Vocaster, and more. Whether you're an artist, a producer, or a podcaste...

30/06/2025

Yellowstone origin story 1923 starring Harrison Ford and Helen Mirren comes to RT One and RT Player

All 8 episodes of Season 1 of 1923 will be available on RT Player from Tuesday ...

30/06/2025

Thales 2025 Global Cloud Security Study Reveals Organizations Struggle to Secure Expanding, AI-Driven Cloud Environments

Facebook Twitter LinkedIn 52% report AI security spending is displacing tr...

30/06/2025

Thales Alenia Space to develop SOLiS very-high-throughput laser communications demonstrator

Facebook Twitter LinkedIn Cannes, June 30th, 2025 - Thales Alenia Space, t...

29/06/2025

Roland introduce the Mood Pan

Handpan-inspired instrument announced Roland have announced the launch of the Mood Pan, a unique electronic hand percussion instrument that has been designe...

29/06/2025

A Secret Society, Ritualistic Killings, and a Century-Old Curse Netflix and YRF Entertainment's 'Mandala Murders' Premieres July 25

Back to All News A Secret Society, Ritualistic Killings, and a Century-Old Curs...

28/06/2025

Press Release: NFVF Marks Youth Month by Empowering Future Creatives Through Film & TV Bursaries

Johannesburg, 27 June 2025 - As the nation commemorates Youth Month 2025, the N...

28/06/2025

FCC Chair Brendan Carr Promises Very, Very Busy, Productive Summer

WASHINGTON In a press conference following the Federal Communications Commission's May Open Meeting, Chair Brendan Carr promised the agency would move rapid...

28/06/2025

Spectrum Awards $1.1 Million in 2025 Spectrum Digital Education Grants

STAMFORD, Conn. Charter Communications has awarded $1.1 million in Spectrum Digital Education grants to 55 nonprofit organizations that work to expand access to...

28/06/2025

Sonnet Announces Echo 20 Thunderbolt 4 SuperDock Now Veri...

LAKE FOREST, Calif. June 19, 2025 What's New: Sonnet Technologies today announced the certification of its Echo 20 Thunderbolt 4 SuperDock as an Engin...

28/06/2025

IDC Names MASV One of Three Most Innovative Companies in...

MASV (massive.io), the fastest and most reliable large file transfer platform for media professionals, has been named an IDC Innovator in the IDC Innovators: Me...

28/06/2025

TV SKYLINE Expands Live Production Capabilities with Late...

Grass Valley today announced that TV SKYLINE GmbH, one of Europe's top mobile production providers, has expanded its camera inventory with 30 LDX 135 UHD/HD...

28/06/2025

AgileTV has been selected to develop and implement LIWEST...

AgileTV, a European leader in TV and video technology solutions, signed an agreement with Austrian telco LIWEST to develop and implement its TV service in Austr...

28/06/2025

Scaler 3.1 update from Scaler Music

Music theory plug-in updated Three months on from the release of the latest version of their renowned music theory plug in, Scaler Music have launched an up...

28/06/2025

The 48th Annual Indian National Finals Rodeo Shot with Blackmagic PYXIS 6K

The 48th Annual Indian National Finals Rodeo Shot with Blackmagic PYXIS 6K Brie Clayton June 27, 2025 0 Comments Filmmaker Cameron Mackey relied on Bl...

28/06/2025

Social, Streaming Don't Compete, They Compliment

Social, Streaming Don't Compete, They Compliment Andy Marken June 27, 2025 0 Comments I think we've all arrived at a very special place. Spir...

28/06/2025

Blackmagic Design Captures Filipino Rock Band Drama Singtala

Blackmagic Design Captures Filipino Rock Band Drama Singtala Brie Clayton June 27, 2025 0 Comments Blackmagic URSA Mini Pro 12K and DaVinci Resolve St...

28/06/2025

Enhance Videos Faster with Aiarty Video Enhancer - Offline, Sharp, and Natural

Enhance Videos Faster with Aiarty Video Enhancer - Offline, Sharp, and Natural Brie Clayton June 27, 2025 0 Comments If you've used AI video tools...

27/06/2025

Give Me the Backstory: Get to Know Eva Victor, the Writer-Director Behind Sorry, Baby

By Jessica Herndon One of the most exciting things about the Sundance Film Fest...

27/06/2025

Spotify Launches K-Pop Performance Video Series . . . Next Up, TWS

K-Pop remains one of the biggest genres globally, and many fans just can't get enough of it. That's why Spotify has launched a new series of K-Pop perf...

27/06/2025

Family Cybersecurity CEO: Protecting Kids, Parents, and My Sanity From Scams

In our latest blog post, Rafael Rivera highlights the rising threat of online scams, and the important role cybersecurity plays in protecting families across ge...

27/06/2025

FCC Sets Comment Deadlines on Proposed Foreign Ownership Rules

WASHINGTON The Federal Communications Commission has set deadlines for comments to a notice of proposed rulemaking (NPRM) to codify certain foreign ownership re...

27/06/2025

FCC Chair Brendan Carr Promises Very, Very Busy, Productive Summer'

WASHINGTON In a press conference following the Federal Communications Commission's May Open Meeting, Chair Brendan Carr promised the agency would move rapid...

27/06/2025

Klevgrand introduce Walls reverb plug-in

From grounded realism to bending, impossible geometries Klevgrand have announced the release of a new algorithmic reverb plug-in which they say deconstruct...

27/06/2025

GIK Acoustics: Room EQ Wizard Tutorial

Learn to use REW for room analysis Acoustic treatment is one of the most important factors in any studio, and with the extensive range of products available...

27/06/2025

HDMI Forum Introduces v2.2 of the HDMI Specification

SAN JOSE, Calif. The HDMI Forum has released Version 2.2. of the HDMI Specification with 96Gbps bandwidth and next-gen HDMI Fixed Rate Link technology to provid...

27/06/2025

TV Skyline Expands Live Production Capabilities with Grass Valley Cameras

MONTREAL Grass Valley has announced that TV Skyline GmbH, one of Europe's top mobile production providers, has expanded its camera inventory with the acquis...

27/06/2025

Fubo Adds Weigel Broadcasting's Networks

NEW YORK & CHICAGO FuboTV Inc. and Weigel Broadcasting Co. have announced a multi-year agreement for distribution of seven networks including MeTV, H&I, Movies!...

27/06/2025

Americans' Favorite Pastime is Watching TV

NEW YORK A national survey of U.S. consumers shows 66% of us watch TV all or most of the time and also multitask while doing it....

27/06/2025

Sunbeam, Findal Media Ink Deal to Broadcast ABC Miami

MIAMI Sunbeam Television has reached a multiyear agreement with Findal Media & Technology Group to broadcast the new ABC Miami beginning Aug. 4....

27/06/2025

AccuWeather Signs Weather Data Deal with AI Search Provider Perplexity

STATE COLLEGE, Pa. AccuWeather has announced a deal with Perplexity, a AI-powered search and answer engine, that will bring AccuWeathers weather data and severe...