Sony Pixel Power calrec Sony

NVIDIA Instant NeRF Wins Best Paper at SIGGRAPH, Inspires Creative Wave Amid Tens of Thousands of Downloads

05/08/2022

3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.

Since its debut earlier this year, tens of thousands of developers around the world have downloaded the source code and used it to render spectacular scenes, sharing eye-catching results on social media.

The research behind Instant NeRF is being honored as a best paper at SIGGRAPH - which runs Aug. 8-11 in Vancouver and online - for its contribution to the future of computer graphics research. One of just five papers selected for this award, it's among 17 papers and workshops with NVIDIA authors that are being presented at the conference, covering topics spanning neural rendering, 3D simulation, holography and more.

NVIDIA recently held an Instant NeRF sweepstakes, asking developers to share 3D scenes created with the software for a chance to win a high-end NVIDIA GPU. Hundreds participated, posting 3D scenes of landmarks like Stonehenge, their backyards and even their pets.

Among the creators using Instant NeRF are:

Through the Looking Glass: Karen X. Cheng and James Perlman San Francisco-based creative director Karen X. Cheng is working with software engineer James Perlman to render 3D scenes that test the boundaries of what Instant NeRF can create.

The duo has used Instant NeRF to create scenes that explore reflections within a mirror (shown above) and handle complex environments with multiple people - like a group enjoying ramen at a restaurant.

The algorithm itself is groundbreaking - the fact that you can render a physical scene with higher fidelity than normal photogrammetry techniques is just astounding, Perlman said. It's incredible how accurately you can reconstruct lighting, color differences or other tiny details.

It even makes mistakes look artistic, said Cheng. We really lean into that, and play with training a scene less sometimes, experimenting with 1,000, or 5,000 or 50,000 iterations. Sometimes I'll prefer the ones trained less because the edges are softer and you get an oil-painting effect.

Using prior tools, it would take them three or four days to train a decent-quality scene. With Instant NeRF, the pair can churn out about 20 a day, using an NVIDIA RTX A6000 GPU to render, train and preview their 3D scenes.

With rapid rendering comes faster iteration.

Being able to render quickly is very necessary for the creative process. We'd meet up and shoot 15 or 20 different versions, run them overnight and then see what's working, said Cheng. Everything we've published has been shot and reshot a dozen times, which is only possible when you can run several scenes a day.

Preserving Moments in Time: Hugues Bruy re Hugues Bruy re, partner and chief of innovation at Dpt., a Montreal-based creative studio, uses Instant NeRF daily.

3D captures have always been of strong interest to me because I can go back to those volumetric reconstructions and move in them, adding an extra dimension of meaning to them, he said.

Bruy re rendered 3D scenes with Instant NeRF using the data he'd previously captured for traditional photogrammetry relying on mirrorless digital cameras, smartphones, 360 cameras and drones. He uses an NVIDIA GeForce RTX 3090 GPU to render his Instant NeRF scenes.

Bruy re believes Instant NeRF could be a powerful tool to help preserve and share cultural artifacts through online libraries, museums, virtual-reality experiences and heritage-conservation projects.

The aspect of capturing itself is being democratized, as camera and software solutions become cheaper, he said. In a few months or years, people will be able to capture objects, places, moments and memories and have them volumetrically rendered in real time, shareable and preserved forever.

Using pictures taken with a smartphone, Bruy re created an Instant NeRF render of an ancient marble statue of Zeus from an exhibition at Toronto's Royal Ontario Museum.

Stepping Into Remote Scenes: Jonathan Stephens Jonathan Stephens, chief evangelist for spatial computing company EveryPoint, has been exploring Instant NeRF for both creative and practical applications.

EveryPoint reconstructs 3D scenes such as stockpiles, railyards and quarries to help businesses manage their resources. With Instant NeRF, Stephens can capture a scene more completely, allowing clients to freely explore a scene. He uses an NVIDIA GeForce RTX 3080 GPU to run scenes rendered with Instant NeRF.

What I really like about Instant NeRF is that you quickly know if your render is working, Stephens said. With a large photogrammetry set, you could be waiting hours or days. Here, I can test out a bunch of different datasets and know within minutes.

He's also experimented with making NeRFs using footage from lightweight devices like smart glasses. Instant NeRF could turn the low-resolution, bumpy footage from Stephens walking down the street into a smooth 3D scene.

Find NVIDIA at SIGGRAPH Tune in for a special address by NVIDIA CEO Jensen Huang and other senior leaders on Tuesday, Aug. 9, at 9 a.m. PT to hear about the research and technology behind AI-powered virtual worlds.

NVIDIA is also presenting a score of in-person and virtual sessions for SIGGRAPH attendees, including:

The Next Evolution of Universal Scene Description (USD) for Building Virtual Worlds

Real-Time Collaboration in Ray-Traced VR

Meet the Researchers: How to Use NVIDIA Kaolin in Your 3D Deep Learning Workflows

The Future of Extended Reality: How Immersion Will Change Everything

Learn how to create with Instant NeRF in the hands-on demo, NVIDIA Instant NeRF - Getting Started With Neural Radiance Fields. Instant NeRF will also be part of SIGGRAPH's Real-Time Live showcase - where in-person attendees can vote for a winning project.

For more interactive sessions
LINK: https://blogs.nvidia.com/blog/2022/08/05/instant-nerf-creators-siggrap...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

QC: Artificial Intelligence's Big Hammer Finds Another Nail

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

The AI Dilemma: Can C2PA Keep a Video's Provenance Intact?

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

BPS Gaining Traction in Broadcast and Other Sectors

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

Ikegami to Demonstrate Latest-Generation UNICAM Product R...

Ikegami has chosen the 11-14 September 2026 International Broadcasting Convention in Amsterdam as the European market launch venue for additions to its UNICAM p...

04/08/2026

Appear unifies hardware and software for live production...

Appear (IBC2026 booth 1.C61) will showcase new X & VX Platform capabilities that extend broadcast-grade performance from venue to cloud Appear ASA (OSE: APR), ...

04/08/2026

Broadcast Management Group Brings Amazon Prime Obsessed F...

LiveU, the global leader in live IP-video solutions, today highlighted the crucial role its EcoSystem played in Broadcast Management Group's (BMG) successfu...

04/08/2026

Scripps Completes Acquisition of WTVQ Lexington

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

U.S., U.K. Consumers Now Spend 11 Hours a Day Using Media

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

Sinclair Announces 2026 Annual Scholarship Winners

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

Tom DeLay: Only Congress Can Change Station Ownership Caps

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

IAB Tech Lab Upgrades Open Framework for Agentic Advertising

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

DirecTV For Business Inks New Agreement to Sell NFL Sunday Ticket

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

IEEE Broadcast Technology Society Honors Charles Einolf

Share Copy link Facebook X Linkedin Bluesky Email...

04/08/2026

Homecoming Artist Spotlight: Dreion

Homecoming Artist Spotlight: Dreion The singer, songwriter, and producer talks about finding his village at Berklee ahead of his Homecoming performance on Sep...

04/08/2026

AI Leaders Propose SAFE Guidelines for Cybersecurity Transparency

Members of the Open Secure AI Alliance - now more than 120 organizations strong - are developing new guidelines to strengthen agentic AI cybersecurity as the an...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

03/08/2026

SVGs TranSPORT Conference Returns to NYC on Oct. 20; Register Today!

SVG's annual TranSPORT conference returns to New York City for a full day of sessions focused on the current state of live-sports-transmission technology. S...

03/08/2026

SVG All-Stars: Stefan Richardson, Director, Global Broadcast, Riot Games

A five-time Emmy winner, this esports vet has built a production career on live storytelling, audience connection, and meeting viewers wherever they are The sp...

03/08/2026

MLBs Jason Hedgcock on Using the Cloud To Produce World Baseball Classic Games for Netflix Japan

Live production in the cloud is a growing trend across the industry and Major Le...

03/08/2026

Cookie Queens Is Sweet With Substance

(L-R) Nyah B., Nala B., Shannon Elizabeth S., Celia K., Olive G., and Nikki B. attend the Q&A for Cookie Queens by Alysa Nahmias, an official selection of the...

03/08/2026

Rhodes launch Rhodes Clav Pro

Recreates a 1977 Hohner Clavinet D6 After launching a software recreation of their own electric piano, Rhodes set about capturing another classic instrument...

03/08/2026

Peak Tamer from Nicky Howard

A modern solution for an old technique Peak Tamer is a new standalone application that automatically applies gain automation to keep rogue peaks under cont...

03/08/2026

Sound Particles update Beat Panner

Plug-in gains object metadata automation export Sound Particles have just released an update that adds a new Metadata Automation function to their their rec...

03/08/2026

SGL Carbon and X-energy announce capacity expansion for Nuclear-Grade Graphite

SGL Carbon and X-energy today announced a binding agreement to double SGL's production capacity for medium-grain isotropic graphite ( NBG-18 ), a specialize...

03/08/2026

Glensound launches Greater Divine Supernal at PLASA Show...

Glensound will launch the Greater Divine Supernal at PLASA Show 2026, extending its intelligent loudspeaker range for professional studio monitoring and live au...

03/08/2026

How Agua Tinta's Class Project Launched Her Songwriting Career

How Agua Tinta's Class Project Launched Her Songwriting Career Two years after graduating from Berklee, the songwriter has a Latin Grammy nomination, a So...

03/08/2026

Lightware UCX delivers campus-wide connectivity to Leiden...

Leiden University's new Campus Spui, located in the heart of The Hague, the diplomatic and administrative centre of the Netherlands, opened in February 2026...

03/08/2026

Bitfocus heads to the future with new investment

Bitfocus, the specialist in media control and monitoring, has received a further boost to its plans for continuing growth, particularly in Europe and North Amer...

03/08/2026

Leagues Cup kicks off tomorrow, August\u00A04, on\u00A0Apple\u00A0TV - UPDATE - Posted on 03 August 2026

Building on the momentum of a landmark year for soccer in North America, Leagues...

02/08/2026

Acustica introduce Dangerous Music BAX EQ Plugin

Classic EQ design goes virtual Following on from the launch of the 500-series version of their BAX EQ unit, Dangerous Music have now teamed up with modellin...

02/08/2026

Television, Resilience and National Security

The Government's Missing Dimension This article was originally published on the National Preparedness Commission website on 25 June 2026. ----------------...

01/08/2026

Harmonic Piano from The Crow Hill Company

Latest free Vaults instrument released The Crow Hill Company's Vaults collection offers a continually rotating selection of virtual instruments and samp...

01/08/2026

American Television Alliance Slams Deltavision Blackout on Verizon

Share Copy link Facebook X Linkedin Bluesky Email...

01/08/2026

FreeWheel Debuts TV Series-Level Reporting for CTV Buyers

Share Copy link Facebook X Linkedin Bluesky Email...

01/08/2026

Minnesota Timberwolves, DAZN to Launch New Streaming Offering

Share Copy link Facebook X Linkedin Bluesky Email...

01/08/2026

Early Registration Opens for 2026 SMPTE Media Technology Summit

Share Copy link Facebook X Linkedin Bluesky Email...

01/08/2026

NBCUniversal and YouTube Ink Landmark Distribution Deal

Share Copy link Facebook X Linkedin Bluesky Email...

01/08/2026

COW Jobs: Lead Generation Representative - Animation Services

COW Jobs: Lead Generation Representative - Animation Services Brie Clayton July 31, 2026 0 Comments Lead Generation Representative - Animation Service...

01/08/2026

Emilie Lowe Shoots Award Winning Short Film Where Dead Things Grow with Blackmagic Design

Emilie Lowe Shoots Award Winning Short Film Where Dead Things Grow with Blackmag...

01/08/2026

Early Registration Opens for the 2026 SMPTE Media Technology Summit

Early Registration Opens for the 2026 SMPTE Media Technology Summit Brie Clayton July 31, 2026 0 Comments Initial Program Announced Alongside New Medi...

31/07/2026

SVG Sit-Down: NHL's Steve Mayer on Building a Centralized Production Operation From Scratch

With an emphasis on local, the league is looking beyond the initial four teams t...

31/07/2026

Reflecting on the 2026 Summer Season of Our Sundance Institute Labs

The 2026 Sundance Institute Directors Lab fellows in Estes Park, Colorado (Photo by Gabe Rovick) Dear Friends, This has been an extraordinary year for our ar...

31/07/2026

Audiocube launch Audiocube Space

Offers 360-degree sound placement in any DAW Audiocube have just announced the launch of a new plug-in that embeds a complete 3D acoustic environment inside...

31/07/2026

Sonarworks expand SoundID VoiceAI library

10 new Chinese C-Pop voices introduced While Sonarworks are best known to many for their room-correction software, their product range also includes an inno...

31/07/2026

PSPaudioware release PSP BBDelay

Reimagines the vintage BBD sound character PSPaudioware have now officially launched the new delay plug-in that they were previewing at GearExpo UK. Said to...

31/07/2026

Savannah Bananas Hits a Broadcast Home Run with Calrec

The Savannah Bananas has built its reputation on refusing to play baseball by traditional rules, and the team's production arm Banana Ball TV (BTV) has draf...