Sony Pixel Power calrec Sony

NVIDIA Instant NeRF Wins Best Paper at SIGGRAPH, Inspires Creative Wave Amid Tens of Thousands of Downloads

05/08/2022

3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.

Since its debut earlier this year, tens of thousands of developers around the world have downloaded the source code and used it to render spectacular scenes, sharing eye-catching results on social media.

The research behind Instant NeRF is being honored as a best paper at SIGGRAPH - which runs Aug. 8-11 in Vancouver and online - for its contribution to the future of computer graphics research. One of just five papers selected for this award, it's among 17 papers and workshops with NVIDIA authors that are being presented at the conference, covering topics spanning neural rendering, 3D simulation, holography and more.

NVIDIA recently held an Instant NeRF sweepstakes, asking developers to share 3D scenes created with the software for a chance to win a high-end NVIDIA GPU. Hundreds participated, posting 3D scenes of landmarks like Stonehenge, their backyards and even their pets.

Among the creators using Instant NeRF are:

Through the Looking Glass: Karen X. Cheng and James Perlman San Francisco-based creative director Karen X. Cheng is working with software engineer James Perlman to render 3D scenes that test the boundaries of what Instant NeRF can create.

The duo has used Instant NeRF to create scenes that explore reflections within a mirror (shown above) and handle complex environments with multiple people - like a group enjoying ramen at a restaurant.

The algorithm itself is groundbreaking - the fact that you can render a physical scene with higher fidelity than normal photogrammetry techniques is just astounding, Perlman said. It's incredible how accurately you can reconstruct lighting, color differences or other tiny details.

It even makes mistakes look artistic, said Cheng. We really lean into that, and play with training a scene less sometimes, experimenting with 1,000, or 5,000 or 50,000 iterations. Sometimes I'll prefer the ones trained less because the edges are softer and you get an oil-painting effect.

Using prior tools, it would take them three or four days to train a decent-quality scene. With Instant NeRF, the pair can churn out about 20 a day, using an NVIDIA RTX A6000 GPU to render, train and preview their 3D scenes.

With rapid rendering comes faster iteration.

Being able to render quickly is very necessary for the creative process. We'd meet up and shoot 15 or 20 different versions, run them overnight and then see what's working, said Cheng. Everything we've published has been shot and reshot a dozen times, which is only possible when you can run several scenes a day.

Preserving Moments in Time: Hugues Bruy re Hugues Bruy re, partner and chief of innovation at Dpt., a Montreal-based creative studio, uses Instant NeRF daily.

3D captures have always been of strong interest to me because I can go back to those volumetric reconstructions and move in them, adding an extra dimension of meaning to them, he said.

Bruy re rendered 3D scenes with Instant NeRF using the data he'd previously captured for traditional photogrammetry relying on mirrorless digital cameras, smartphones, 360 cameras and drones. He uses an NVIDIA GeForce RTX 3090 GPU to render his Instant NeRF scenes.

Bruy re believes Instant NeRF could be a powerful tool to help preserve and share cultural artifacts through online libraries, museums, virtual-reality experiences and heritage-conservation projects.

The aspect of capturing itself is being democratized, as camera and software solutions become cheaper, he said. In a few months or years, people will be able to capture objects, places, moments and memories and have them volumetrically rendered in real time, shareable and preserved forever.

Using pictures taken with a smartphone, Bruy re created an Instant NeRF render of an ancient marble statue of Zeus from an exhibition at Toronto's Royal Ontario Museum.

Stepping Into Remote Scenes: Jonathan Stephens Jonathan Stephens, chief evangelist for spatial computing company EveryPoint, has been exploring Instant NeRF for both creative and practical applications.

EveryPoint reconstructs 3D scenes such as stockpiles, railyards and quarries to help businesses manage their resources. With Instant NeRF, Stephens can capture a scene more completely, allowing clients to freely explore a scene. He uses an NVIDIA GeForce RTX 3080 GPU to run scenes rendered with Instant NeRF.

What I really like about Instant NeRF is that you quickly know if your render is working, Stephens said. With a large photogrammetry set, you could be waiting hours or days. Here, I can test out a bunch of different datasets and know within minutes.

He's also experimented with making NeRFs using footage from lightweight devices like smart glasses. Instant NeRF could turn the low-resolution, bumpy footage from Stephens walking down the street into a smooth 3D scene.

Find NVIDIA at SIGGRAPH Tune in for a special address by NVIDIA CEO Jensen Huang and other senior leaders on Tuesday, Aug. 9, at 9 a.m. PT to hear about the research and technology behind AI-powered virtual worlds.

NVIDIA is also presenting a score of in-person and virtual sessions for SIGGRAPH attendees, including:

The Next Evolution of Universal Scene Description (USD) for Building Virtual Worlds

Real-Time Collaboration in Ray-Traced VR

Meet the Researchers: How to Use NVIDIA Kaolin in Your 3D Deep Learning Workflows

The Future of Extended Reality: How Immersion Will Change Everything

Learn how to create with Instant NeRF in the hands-on demo, NVIDIA Instant NeRF - Getting Started With Neural Radiance Fields. Instant NeRF will also be part of SIGGRAPH's Real-Time Live showcase - where in-person attendees can vote for a winning project.

For more interactive sessions
LINK: https://blogs.nvidia.com/blog/2022/08/05/instant-nerf-creators-siggrap...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

28/07/2026

Harvard Athletics Transforms Collegiate Sports Storytelling with AJA Gear

Harvard Athletics Transforms Collegiate Sports Storytelling with AJA Gear Brie Clayton July 27, 2026 0 Comments Between the maturation of IP and remot...

28/07/2026

New Live Action Projection Mapping Film Captured with URSA Cine 12K LF

New Live Action Projection Mapping Film Captured with URSA Cine 12K LF Brie Clayton July 27, 2026 0 Comments Large format sensor allows Texas Legacy ...

28/07/2026

NVIDIA Agent Toolkit Expands With New Omniverse Libraries, Putting AI Agents to Work Building Simulation-Ready Worlds

NVIDIA Agent Toolkit Expands With New Omniverse Libraries, Putting AI Agents to ...

28/07/2026

AI Agents Expand Creative Tools to Millions

AI Agents Expand Creative Tools to Millions Brie Clayton July 27, 2026 0 Comments Hero image courtesy of Epic Games Leading creative applications are...

28/07/2026

How Rick Aggeler Built a Music Community for Boston Teens

How Rick Aggeler Built a Music Community for Boston Teens When he was a Berklee student, Aggeler volunteered at the Boys & Girls Clubs of Boston, where he hel...

27/07/2026

AES Educational Foundation Announces 2026/2027 Scholarship and Grant Recipients

The Audio Engineering Society Educational Foundation has named its scholarship and grant recipients for the 2026/2027 academic year. The awards support students...

27/07/2026

ESPN and MEAC Reach Multi-Year Media Rights Agreement Through 2030-31

ESPN and the Mid-Eastern Athletic Conference (MEAC) have signed a multi-year media rights agreement covering basketball championships and select football and ba...

27/07/2026

Yahoo Sports and Cameo Integrate Celebrity Video Bookings into Yahoo Fantasy

Yahoo Sports and Cameo have partnered to allow fantasy football users to book personalized celebrity videos directly within the Yahoo Fantasy app and website. T...

27/07/2026

Eutelsat to Receive $504 Million in FCC Upper C-Band Transition Payments

Eutelsat has welcomed the FCC's order establishing the regulatory framework for the transition of Upper C-band spectrum in the United States. Under the orde...

27/07/2026

ESPN Acquires U.S. and International Rights to International Dance League

ESPN and the International Dance League (IDL) have signed a global rights agreement for the 2026 season. Events will air bi-weekly on ESPN2 at 7 p.m. ET beginni...

27/07/2026

NBCUniversal and YouTube Announce Multi-Year Global Partnership

NBCUniversal and YouTube have signed a multi-year global partnership that includes bundling Peacock with YouTube Premium, extending NBCUniversal's distribut...

27/07/2026

Two Weeks Away: 2026 SVG Venues & Teams Summit at Miamis Kaseya Center To Reunite In-Stadium Production Community

Agenda includes presentations from the Miami Heat, Inter Miami, Florida Panthers...

27/07/2026

Behind The Mic: CBS Sports Bolsters College Football Analyst Team

Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...

27/07/2026

PBR Goes Animated With BS: Bull Stories, Giving Its Bucking Bulls a Voice

Ten one-minute shorts will roll out across CBS, The CW, Paramount+ during the 2026 PBR Teams season PBR is officially moving into scripted animation. The Profe...

27/07/2026

Vochlea announce DubBox

New app turns vocal percussion into polished loops Vochlea, the company behind the voice-to-MIDI instrument Dubler 2, have just announced the launch of a ne...

27/07/2026

Sonora Cinematic launch Pure 12-String for Soundbox

Latest MPE-capable instrument completes Pure Trilogy line-up Sonora Cinematic have just released the third and final instalment in their series of acoustic ...

27/07/2026

fedDSP introduce Opto compressor plug-in

Emulates four varieties of optical compression The latest addition to the fedDSP line-up has just been announced, and packs four distinct optical compressor...

27/07/2026

Drawmer reveal the OC1 & FC1

Optical & FET compressors join 500-series line-up At our recent GearExpo UK show, we heard from Drawmer that they would soon be launching a pair of new 500-...

27/07/2026

T-Mobile Tops Ookla's Mobile Network Rankings

Share Copy link Facebook X Linkedin Bluesky Email...

27/07/2026

Pebble to Feature Virtualization, Cloud-Based Playout Tech at IBC

Share Copy link Facebook X Linkedin Bluesky Email...

27/07/2026

NBCU Telemundo Turns To Chyron PRIME 5 For World Cup Graphics

Share Copy link Facebook X Linkedin Bluesky Email...

27/07/2026

Lightware Adds SNMPv3 Monitoring to Taurus Devices

Lightware announces SNMPv3-based monitoring support for selected Taurus devices, available from firmware v1.20.0. The update enables IT administrators and AV in...

27/07/2026

Mediagenix Showcases the Real-Time Media Enterprise at IB...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, will showcase its vision for the Real-Time...

27/07/2026

Official trailer: Gugu Mbatha-Raw stars in Sky Original supernatural thriller Possession

All episodes available Thursday 6 August on Sky and streaming service NOWMonday ...

27/07/2026

Seven paradoxes shaping the next era of media production - Episode 4

Why Confidence MattersIn this series, we explore the technologies, architectures and operational realities shaping modern media operations. Along the way, we ex...

27/07/2026

Apple brings AppleCare One to the UK, streamlining coverage - UPDATE - Posted on 27 July 2026

Apple today announced AppleCare One - a new way for customers to protect multipl...

27/07/2026

944,000 VIEWERS WATCH RT'S COVERAGE OF MAYO'S HISTORIC WIN, AFTER A 75 YEAR WAIT TO LIFT THE SAM MAGUIRE

Yesterday witnessed truly memorable scenes in Croke Park, bringing the curtain d...

27/07/2026

SES Statement On FCC Upper C-band Auction Decision

Luxembourg, July 27, 2026 - SES, a leading space solutions company, issued the following statement following the U.S. Federal Communications Commission approval...

27/07/2026

Industry Leaders Unite in Open Secure AI Alliance for AI Safety and Security

Open source software is a critical pillar of the global economy. It underpins cloud computing, financial services, manufacturing, telecommunications, government...

26/07/2026

Audio Vivid: A New Destination for Immersive Audio

What is Audio Vivid? A New Destination for Immersive Audio Over the past several years, immersive audio has evolved from a niche production consideration into a...

26/07/2026

NVIDIA Harnesses Vera CPU to Speed Up Design of Next-Generation CPUs and GPUs

The complexity of modern chip design continues to grow as engineering teams work to develop increasingly sophisticated CPUs, GPUs and AI systems. To help meet t...

25/07/2026

Vochlea introduce DubBox

New app turns vocal percussion into polished loops Vochlea, the company behind the voice-to-MIDI instrument Dubler 2, have just announced the launch of a ne...

25/07/2026

Study: T-Mobile Remains Best Mobile and Fastest 5G Network

Share Copy link Facebook X Linkedin Bluesky Email...

25/07/2026

Mark Bridges to Lead CableLabs

Share Copy link Facebook X Linkedin Bluesky Email...

25/07/2026

Total YouTube Views for All FIFA World Cup Content Top 200 Billion

Share Copy link Facebook X Linkedin Bluesky Email...

25/07/2026

Pebble To Address Future Of Media Operations At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

25/07/2026

Paramount Agrees to Pause Warner Bros. Discovery Deal

Share Copy link Facebook X Linkedin Bluesky Email...

25/07/2026

Export FCP7 to XML Without Needing FCP7 Installed

Export FCP7 to XML Without Needing FCP7 Installed Dave Rice July 24, 2026 0 Comments I've created an open source tool that allows you to export FC...

25/07/2026

Documentary Sell Your House Edited with DaVinci Resolve Studio

Documentary Sell Your House Edited with DaVinci Resolve Studio Brie Clayton July 24, 2026 0 Comments Filmmakers post feature documentary from opposite...

25/07/2026

Time to Act: Bringing a New Opera to Life

Time to Act: Bringing a New Opera to Life Boston Conservatory at Berklee vocal arts students played a vital role in shaping the opera's creative developme...

25/07/2026

Beyond the Score

Beyond the Score For Dean of Music Kevin Haden, the boundless possibilities of classical music begin with process. July 24, 2026 By Kevin Haden Michelle ...

25/07/2026

Reading the Room

Reading the Room As music director of two major orchestras, conductor Jonathon Heyward aims to make the concert hall a space for everyone. July 24, 2026 By ...

25/07/2026

First look revealed for YAGA, a seductive mystery thriller coming to Sky and NOW this October

Saturday 25 July 2026 First look revealed for YAGA, a seductive mystery thrille...

24/07/2026

ESPN Adds New Production Features for NFL FLAG Championships

Referee hat cameras, player/coach mics, and virtual graphics will be deployed at the three-day event for the first time The NFL FLAG Championships return to ES...

24/07/2026

Qvest, Ateme and Scaleway Deliver Sovereign OTT Platforms for European Broadcasters

Qvest, Ateme, and Scaleway have partnered to offer broadcasters, media organizat...