Sony Pixel Power calrec Sony

NVIDIA Instant NeRF Wins Best Paper at SIGGRAPH, Inspires Creative Wave Amid Tens of Thousands of Downloads

05/08/2022

3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.

Since its debut earlier this year, tens of thousands of developers around the world have downloaded the source code and used it to render spectacular scenes, sharing eye-catching results on social media.

The research behind Instant NeRF is being honored as a best paper at SIGGRAPH - which runs Aug. 8-11 in Vancouver and online - for its contribution to the future of computer graphics research. One of just five papers selected for this award, it's among 17 papers and workshops with NVIDIA authors that are being presented at the conference, covering topics spanning neural rendering, 3D simulation, holography and more.

NVIDIA recently held an Instant NeRF sweepstakes, asking developers to share 3D scenes created with the software for a chance to win a high-end NVIDIA GPU. Hundreds participated, posting 3D scenes of landmarks like Stonehenge, their backyards and even their pets.

Among the creators using Instant NeRF are:

Through the Looking Glass: Karen X. Cheng and James Perlman San Francisco-based creative director Karen X. Cheng is working with software engineer James Perlman to render 3D scenes that test the boundaries of what Instant NeRF can create.

The duo has used Instant NeRF to create scenes that explore reflections within a mirror (shown above) and handle complex environments with multiple people - like a group enjoying ramen at a restaurant.

The algorithm itself is groundbreaking - the fact that you can render a physical scene with higher fidelity than normal photogrammetry techniques is just astounding, Perlman said. It's incredible how accurately you can reconstruct lighting, color differences or other tiny details.

It even makes mistakes look artistic, said Cheng. We really lean into that, and play with training a scene less sometimes, experimenting with 1,000, or 5,000 or 50,000 iterations. Sometimes I'll prefer the ones trained less because the edges are softer and you get an oil-painting effect.

Using prior tools, it would take them three or four days to train a decent-quality scene. With Instant NeRF, the pair can churn out about 20 a day, using an NVIDIA RTX A6000 GPU to render, train and preview their 3D scenes.

With rapid rendering comes faster iteration.

Being able to render quickly is very necessary for the creative process. We'd meet up and shoot 15 or 20 different versions, run them overnight and then see what's working, said Cheng. Everything we've published has been shot and reshot a dozen times, which is only possible when you can run several scenes a day.

Preserving Moments in Time: Hugues Bruy re Hugues Bruy re, partner and chief of innovation at Dpt., a Montreal-based creative studio, uses Instant NeRF daily.

3D captures have always been of strong interest to me because I can go back to those volumetric reconstructions and move in them, adding an extra dimension of meaning to them, he said.

Bruy re rendered 3D scenes with Instant NeRF using the data he'd previously captured for traditional photogrammetry relying on mirrorless digital cameras, smartphones, 360 cameras and drones. He uses an NVIDIA GeForce RTX 3090 GPU to render his Instant NeRF scenes.

Bruy re believes Instant NeRF could be a powerful tool to help preserve and share cultural artifacts through online libraries, museums, virtual-reality experiences and heritage-conservation projects.

The aspect of capturing itself is being democratized, as camera and software solutions become cheaper, he said. In a few months or years, people will be able to capture objects, places, moments and memories and have them volumetrically rendered in real time, shareable and preserved forever.

Using pictures taken with a smartphone, Bruy re created an Instant NeRF render of an ancient marble statue of Zeus from an exhibition at Toronto's Royal Ontario Museum.

Stepping Into Remote Scenes: Jonathan Stephens Jonathan Stephens, chief evangelist for spatial computing company EveryPoint, has been exploring Instant NeRF for both creative and practical applications.

EveryPoint reconstructs 3D scenes such as stockpiles, railyards and quarries to help businesses manage their resources. With Instant NeRF, Stephens can capture a scene more completely, allowing clients to freely explore a scene. He uses an NVIDIA GeForce RTX 3080 GPU to run scenes rendered with Instant NeRF.

What I really like about Instant NeRF is that you quickly know if your render is working, Stephens said. With a large photogrammetry set, you could be waiting hours or days. Here, I can test out a bunch of different datasets and know within minutes.

He's also experimented with making NeRFs using footage from lightweight devices like smart glasses. Instant NeRF could turn the low-resolution, bumpy footage from Stephens walking down the street into a smooth 3D scene.

Find NVIDIA at SIGGRAPH Tune in for a special address by NVIDIA CEO Jensen Huang and other senior leaders on Tuesday, Aug. 9, at 9 a.m. PT to hear about the research and technology behind AI-powered virtual worlds.

NVIDIA is also presenting a score of in-person and virtual sessions for SIGGRAPH attendees, including:

The Next Evolution of Universal Scene Description (USD) for Building Virtual Worlds

Real-Time Collaboration in Ray-Traced VR

Meet the Researchers: How to Use NVIDIA Kaolin in Your 3D Deep Learning Workflows

The Future of Extended Reality: How Immersion Will Change Everything

Learn how to create with Instant NeRF in the hands-on demo, NVIDIA Instant NeRF - Getting Started With Neural Radiance Fields. Instant NeRF will also be part of SIGGRAPH's Real-Time Live showcase - where in-person attendees can vote for a winning project.

For more interactive sessions
LINK: https://blogs.nvidia.com/blog/2022/08/05/instant-nerf-creators-siggrap...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

08/10/2026

Life Safety, Part 2: From Noise to Nice: The Evolution of Speech Intelligibility in Stadium Sound

Modern venues have come a long way since the tinny, echoing audio of the mid 20t...

08/10/2026

ESPN's First Super Bowl Adds Disney+ to U.S. Distribution Mix

ESPN's first Super Bowl production will stream in English and Spanish on Disney+, while the ESPN App carries the full slate of game, ManningCast, studio, an...

08/10/2026

SVG Students To Watch: Addison McGhee, Auburn University

From high-school videoboards to War Eagle Productions, the Opelika native is learning how to lead shows and capture big moments The future of live sports produ...

08/10/2026

Prime Video to Become Exclusive Global Home of Emmy Awards Beginning in 2027

The Television Academy and Prime Video have announced a six-year agreement making Prime Video the exclusive global home of the Emmy Awards beginning with the 20...

08/10/2026

Techex to Demonstrate Hybrid Satellite and IP Delivery Platform at NAB Show New York

Techex will exhibit at NAB Show New York 2026 (Booth 623, Javits Center, October...

08/10/2026

X Games Appoints Steve Rogers as Chief Operating Officer

X Games has announced the appointment of Steve Rogers as Chief Operating Officer. Rogers previously served as COO of World Supercross and spent nearly a decade ...

08/10/2026

Fonn Group Appoints Trevor Spielmann as Sales Director, DACH

Fonn Group has appointed Trevor Spielmann as Sales Director for Germany, Austria, and Switzerland. Spielmann joins from EVS, where he held sales and business de...

08/10/2026

Perfect Game Introduces New Studio Show on the Road With Launch of PG Central

The flagship program will originate from major PG events with a four-camera production, live distribution across PGTV, social platforms Perfect Game is bringin...

08/10/2026

Uplynk White Paper: The IP Convergence Framework for Distribution

Innovation rarely happens in a vacuum. More often, it happens at the point of collision: when worlds that have run on separate tracks begin to converge. That is...

08/10/2026

Gravity Media Op-Ed: Gravity Media's Next Act - From Service Provider to Strategic Content Partner

For decades, the production and broadcast services business has run on a familia...

08/10/2026

Uplynk, Zixi, BroadView Software, and Grass Valley Publish Satellite-to-IP Distribution Framework

Uplynk, Zixi, BroadView Software, and Grass Valley have published The IP Converg...

08/10/2026

NFL Announces Ninth Annual Big Data Bowl Powered by AWS

The NFL has announced the return of the Big Data Bowl, the league's analytics competition, now in its ninth year and again powered by AWS. Registration is o...

08/10/2026

Eutelsat Renews Partnership with Tldiffusion dAlgrie on EUTELSAT 7 West A

Eutelsat has renewed its partnership with T l diffusion d'Alg rie (TDA), Algeria's national broadcasting network operator, for continued distribution of...

08/10/2026

Disney+ to Stream Super Bowl LXI on February 14, 2027

Disney will livestream Super Bowl LXI on February 14, 2027, alongside the game's broadcast on ESPN and ABC. All Disney subscribers in the United States wi...

08/10/2026

RHStv to Stream Clemson vs. Coastal Carolina Baseball at Myrtle Beach Fall Showdown

RHStv and Red House Streaming have announced an expansion of their partnership w...

08/10/2026

Gray Media to Simulcast 15 Timberwolves Games Free Over-the-Air in Minnesota and Wisconsin

Gray Media has announced a distribution agreement with TEGNA and DAZN to simulca...

08/10/2026

SMPTE Media Technology Summit Returns to Pasadena Nov. 16-19; Get 10% Off With SVG Promo Code

SVG readers can save 10% on registration and receive a complimentary Solutions H...

08/10/2026

PROTON Camera Innovations Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

PROTON Camera Innovations GmbH has been named a recipient of a 2026 Technology a...

08/10/2026

Silver Lining: Sharing Tales From the Trenches of Cloud-Based Production with NBC Sports, MLB, NHL, and Warner Bros. Discovery

Industry leaders discuss real-world cloud workflows for live game production, pl...

08/10/2026

Dolby Atmos Coming to Formula 1 on Apple TV Beginning with 2026 U.S. Grand Prix

The next-gen audio technology joins Dolby Vision as part of Apple TV's immersive F1 experience...

08/10/2026

Free Leonard Peltier Proves That the Fight for Justice Is Just Beginning

David France, Jesse Short Bull, Mato Wayuhi, N. Bird Runningwater, Jodi Archambau, Jhane Myers, Paul McGuire, Amber Morning Star Byars, Holly Macarro, Nick Tils...

08/10/2026

Sound Particles update Energy Panner 2 & Brightness Panner 2

Dynamic panning plug-ins get an upgrade Sound Particles have just announced major updates for two of their popular dynamic panning plug-ins. Energy Panner 2...

08/10/2026

The DMNO ON from UDO Audio

New expandable instrument boasts full DMNO engine UDO Audio have just announced the upcoming release of a new, expandable synth that packs the power of the ...

08/10/2026

ADAM Audio introduce the Sub8 PRO & Sub10 PRO

Two new subwoofers added to monitoring line-up ADAM Audio's monitoring range has just been expanded with two new DSP-equipped subwoofers, the Sub8 PRO a...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2026

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

08/10/2026

NAB New York 2026 Preview

Calrec gives broadcasters freedom of choice at NAB Show New York We're looking forward to meeting up with you all at NAB New York on 21st-22nd October. Cal...

08/10/2026

ESPN Unveils First Studio W Refresh

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Pay-TV Operators Ask FCC to Pause TV Station Ownership Cap Rules

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Calrec Brings New Consoles, Software to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Mediagenix Bows AI Content-Aware Scheduling

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Unveil UHK-X700VN Camera at NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ed McGivern Joins USSI Global as Chief Revenue Officer

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Globecast Brings Media Orchestration and C-Band Transitio...

Globecast, a leading provider of broadcast, media and entertainment managed services, will showcase its next generation of media orchestration services at NAB S...

08/10/2026

Clear-Com Powers Critical Communications at Rock in Rio 2...

Clear-Com played a critical role in the production communications infrastructure for Rock in Rio 2026, one of the world's largest and most recognized music...

08/10/2026

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Creative Executives

Sohonet Launches ClearView Rush: A Leap Forward in Studio Review, Built for Crea...

08/10/2026

NAB Show New York Returns to Javits

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

FCC to Vote on Restrictions for Device Testing, Spectrum for D2D and Drones

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

World First' as DTM Deploys Riedel Private 5G for On-Track Coverage

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

LiveU Cranks Up Connectivity Across Tour de France

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Ikegami to Introduce New UHK-X700VN Camera at NAB New Yor...

Ikegami announces a major expansion to its range of broadcast-quality live production cameras. Scheduled for introduction on Ikegami booth 708 at NAB New York, ...

08/10/2026

Calrec gives broadcasters freedom of choice at NAB Show...

Calrec will be located at Booth 444. Freedom to choose The media landscape is evolving quickly, and the broadcasters best placed for what comes next will be...

08/10/2026

LiveU LU900Q with LIQ Brings Unprecedented Connectivity t...

LiveU has announced that CRD Audiovisuel relied on LiveUs LU900Q intelligent production unit, with built-in native LiveU IQ (LIQ ) connectivity, to deliver live...

08/10/2026

Disney+ to Stream Super Bowl LXI Live

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Formula 1 U.S. Grand Prix to Be Carried in Dolby Atmos, Dolby Vision on Apple TV

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall to Bring Newest PTZ and POV Cameras to NAB Show New York

Share Copy link Facebook X Linkedin Bluesky Email...

08/10/2026

Marshall Electronics to Showcase Award-winning Camera Sol...

Marshall Electronics, a globally recognized provider of high-performance video solutions for broadcast, streaming, AV and professional production, will exhibit ...

08/10/2026

UKTV acquires first two series of new Maigret for U and U&DRAMA in deal with Banijay Rights

14-hour package also includes A Remarkable Place to Die season 2 as well as libr...