Sony Pixel Power calrec Sony

NVIDIA Instant NeRF Wins Best Paper at SIGGRAPH, Inspires Creative Wave Amid Tens of Thousands of Downloads

05/08/2022

3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.

Since its debut earlier this year, tens of thousands of developers around the world have downloaded the source code and used it to render spectacular scenes, sharing eye-catching results on social media.

The research behind Instant NeRF is being honored as a best paper at SIGGRAPH - which runs Aug. 8-11 in Vancouver and online - for its contribution to the future of computer graphics research. One of just five papers selected for this award, it's among 17 papers and workshops with NVIDIA authors that are being presented at the conference, covering topics spanning neural rendering, 3D simulation, holography and more.

NVIDIA recently held an Instant NeRF sweepstakes, asking developers to share 3D scenes created with the software for a chance to win a high-end NVIDIA GPU. Hundreds participated, posting 3D scenes of landmarks like Stonehenge, their backyards and even their pets.

Among the creators using Instant NeRF are:

Through the Looking Glass: Karen X. Cheng and James Perlman San Francisco-based creative director Karen X. Cheng is working with software engineer James Perlman to render 3D scenes that test the boundaries of what Instant NeRF can create.

The duo has used Instant NeRF to create scenes that explore reflections within a mirror (shown above) and handle complex environments with multiple people - like a group enjoying ramen at a restaurant.

The algorithm itself is groundbreaking - the fact that you can render a physical scene with higher fidelity than normal photogrammetry techniques is just astounding, Perlman said. It's incredible how accurately you can reconstruct lighting, color differences or other tiny details.

It even makes mistakes look artistic, said Cheng. We really lean into that, and play with training a scene less sometimes, experimenting with 1,000, or 5,000 or 50,000 iterations. Sometimes I'll prefer the ones trained less because the edges are softer and you get an oil-painting effect.

Using prior tools, it would take them three or four days to train a decent-quality scene. With Instant NeRF, the pair can churn out about 20 a day, using an NVIDIA RTX A6000 GPU to render, train and preview their 3D scenes.

With rapid rendering comes faster iteration.

Being able to render quickly is very necessary for the creative process. We'd meet up and shoot 15 or 20 different versions, run them overnight and then see what's working, said Cheng. Everything we've published has been shot and reshot a dozen times, which is only possible when you can run several scenes a day.

Preserving Moments in Time: Hugues Bruy re Hugues Bruy re, partner and chief of innovation at Dpt., a Montreal-based creative studio, uses Instant NeRF daily.

3D captures have always been of strong interest to me because I can go back to those volumetric reconstructions and move in them, adding an extra dimension of meaning to them, he said.

Bruy re rendered 3D scenes with Instant NeRF using the data he'd previously captured for traditional photogrammetry relying on mirrorless digital cameras, smartphones, 360 cameras and drones. He uses an NVIDIA GeForce RTX 3090 GPU to render his Instant NeRF scenes.

Bruy re believes Instant NeRF could be a powerful tool to help preserve and share cultural artifacts through online libraries, museums, virtual-reality experiences and heritage-conservation projects.

The aspect of capturing itself is being democratized, as camera and software solutions become cheaper, he said. In a few months or years, people will be able to capture objects, places, moments and memories and have them volumetrically rendered in real time, shareable and preserved forever.

Using pictures taken with a smartphone, Bruy re created an Instant NeRF render of an ancient marble statue of Zeus from an exhibition at Toronto's Royal Ontario Museum.

Stepping Into Remote Scenes: Jonathan Stephens Jonathan Stephens, chief evangelist for spatial computing company EveryPoint, has been exploring Instant NeRF for both creative and practical applications.

EveryPoint reconstructs 3D scenes such as stockpiles, railyards and quarries to help businesses manage their resources. With Instant NeRF, Stephens can capture a scene more completely, allowing clients to freely explore a scene. He uses an NVIDIA GeForce RTX 3080 GPU to run scenes rendered with Instant NeRF.

What I really like about Instant NeRF is that you quickly know if your render is working, Stephens said. With a large photogrammetry set, you could be waiting hours or days. Here, I can test out a bunch of different datasets and know within minutes.

He's also experimented with making NeRFs using footage from lightweight devices like smart glasses. Instant NeRF could turn the low-resolution, bumpy footage from Stephens walking down the street into a smooth 3D scene.

Find NVIDIA at SIGGRAPH Tune in for a special address by NVIDIA CEO Jensen Huang and other senior leaders on Tuesday, Aug. 9, at 9 a.m. PT to hear about the research and technology behind AI-powered virtual worlds.

NVIDIA is also presenting a score of in-person and virtual sessions for SIGGRAPH attendees, including:

The Next Evolution of Universal Scene Description (USD) for Building Virtual Worlds

Real-Time Collaboration in Ray-Traced VR

Meet the Researchers: How to Use NVIDIA Kaolin in Your 3D Deep Learning Workflows

The Future of Extended Reality: How Immersion Will Change Everything

Learn how to create with Instant NeRF in the hands-on demo, NVIDIA Instant NeRF - Getting Started With Neural Radiance Fields. Instant NeRF will also be part of SIGGRAPH's Real-Time Live showcase - where in-person attendees can vote for a winning project.

For more interactive sessions
LINK: https://blogs.nvidia.com/blog/2022/08/05/instant-nerf-creators-siggrap...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

18/08/2026

SportStream 2026 Virtual Event Set for September 15-17

SportStream 2026, a free three-day virtual event, will take place September 15-17. One registration provides access to all three days of live programming and on...

18/08/2026

IBC 2026: BeckTV to Debut BeckFlow Documentation Platform

BeckTV will introduce BeckFlow to the European market at IBC2026, demonstrated on the Providius stand (10.F53). BeckFlow is a web-based schematic documentation...

18/08/2026

IBC 2026: Boland Communications to Introduce ST 2110 Option for 4K Monitors

Boland Communications will introduce a SMPTE ST 2110 input option for its 4K monitors at IBC2026, along with a new 55-inch super-narrow bezel display for video ...

18/08/2026

Seattle Seahawks Integrate Dolby OptiView with Dolby Vision for Fan Streaming

Dolby Laboratories and the Seattle Seahawks have announced a partnership integrating Dolby OptiView into the Seahawks' live streaming coverage, making the S...

18/08/2026

Insights from BMG's Graham Taylor on the Role of a Sports Producer in Live Broadcast Production

For BMG Executive Producer of Sports Production, Graham Taylor, producing live s...

18/08/2026

TMRW Sports Names Rufus Hack as President of Golf

TMRW Sports has appointed Rufus Hack as President of Golf, a newly created role in which he will lead the company's golf businesses including TGL presented ...

18/08/2026

SMT To Deliver Race Technology for Freedom 250 IndyCar Broadcast

SMT will provide race technology for FOX Sports' coverage of the Freedom 250 Grand Prix of Washington, D.C. on August 23, when the NTT INDYCAR SERIES races ...

18/08/2026

HMA's Creator Collective Pairs Digital Creators, Beat Writers in New Model for Local-Sports Coverage

The live, YouTube-native roundtables combine fan voices, credentialed reporters,...

18/08/2026

Behind The Mic: FOX Sports Shares Broadcast Lineup for 2026 NFL Season and College Football Season

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

18/08/2026

Miami Heats Ed Filomia on Rebuilding Kaseya Centers Video Infrastructure and 29 Years With the Heat

The industry legend sounds off on replacing the Heat's iconic Medusa score...

18/08/2026

Bill Rasmussen, ESPN Founder and Sports Broadcasting Hall of Famer, Dies at 93

William F. Rasmussen, the sports fan-turned broadcaster and entrepreneur whose out-of-the-box idea of a 24-hour cable sports network, ESPN, changed forever the ...

18/08/2026

DAZN Completes Acquisition of ViewLift

DAZN Group has completed its acquisition of ViewLift, a provider of streaming and digital solutions for sports content owners. The acquisition was first announc...

18/08/2026

American Association of Professional Baseball Adds SI TV as Broadcast Partner

The American Association of Professional Baseball (AAPB) has added SI TV, Sports Illustrated's 24/7 streaming channel, as a broadcast partner for the remain...

18/08/2026

Esports Foundation Postpones Inaugural Esports Nations Cup to November 2027

The Esports Foundation has announced that the inaugural Esports Nations Cup (ENC), originally scheduled for November 2026 in Riyadh, will be postponed to Novemb...

18/08/2026

Diversified Launches Global Managed Services Practice

Diversified has announced a new Global Managed Services Practice, consolidating the company's managed services capabilities into one organization. Rob Mello...

18/08/2026

Appear Completes REMI Proof of Concept with Thoroughbred Racing Productions

Appear has completed a proof of concept with Thoroughbred Racing Productions (TRP), demonstrating multi-camera remote live production over bonded 5G cellular an...

18/08/2026

IBC 2026: Riedel Implements Live Production Infrastructure at Edith Cowan University

Riedel Communications has announced that Edith Cowan University (ECU) in Perth, ...

18/08/2026

Panoramic from Panorama Labs

Company launch with stereo-imaging tool Panoramic is the debut release from Panorama Labs, a new company formed by mastering engineer Nicholas Di Lorenzo. C...

18/08/2026

Focusrite extend Control 2 support

Control software now available for older interfaces Focusrite have just announced the launch of an update that extends Control 2 software support their Scar...

18/08/2026

Call for the 20th Annual South African Film and Television Awards (SAFTAs20) Jury

The National Film and Video Foundation (NFVF), an agency of the Department of Sp...

18/08/2026

Corridor Television Pays $27,000 for Violating FCCs EAS Rules

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Disney's ABC Files First Amendment Lawsuit Against the FCC

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Lightware Integrates with SpectralBot to Accelerate AV Tr...

Lightware announces an integration with SpectralBot that helps system integrators and AV operators troubleshoot faster using augmented reality (AR), AI-assisted...

18/08/2026

Command Frame for After Effects

Command Frame for After Effects Scott Black August 18, 2026 0 Comments Free download, demonstrations, hands-on tests, and creator resources Want to t...

18/08/2026

Dot Group to show how cutting carbon cuts cost - live at...

At Stand 14.A57, the data company will demonstrate GreenDot and IBM Aspera together, giving media and entertainment businesses real-time visibility of what thei...

18/08/2026

Blue Lucy launches Connected Value Audit

New tool provides a robust audit of operational workflows, calculating the tangible value each delivers today, and informing business decisions for tomorrow. W...

18/08/2026

Media Utilities transitions to Media Utilities - a DigiNe...

Media Utilities is integrating its activities into DigiNet and will maintain a recognisable presence in the market under the name: Media Utilities, a DigiNet br...

18/08/2026

Appear demonstrates broadcast-grade REMI production over...

Proof of Concept validates reliable multi-camera live production from remote racecourses without fixed network infrastructure Appear ASA (Appear, OSE:APR), a g...

18/08/2026

Stingr brings frictionless second-screen interaction to I...

Stingr, a new venture from the founders of Hornets Tech, is bringing its second-screen interaction platform to IBC2026. The second screen has never really wor...

18/08/2026

Hiltron to Promote its Latest Generation Satellite Commun...

Long-established satellite equipment manufacturer and systems integrator Hiltron Communications will promote its new HACUX-IDU2 antenna control unit touchscreen...

18/08/2026

EMAM, PlayBox Neo and SNEWS Launch Combined Nuvex System

EMAM, PlayBox Neo and SNEWS Launch Combined Nuvex System Brie Clayton August 17, 2026 0 Comments Integrated platform melds media asset management, pla...

18/08/2026

The United Stand Scales Live Fan Show with Blackmagic Design Workflow

The United Stand Scales Live Fan Show with Blackmagic Design Workflow Brie Clayton August 17, 2026 0 Comments ATEM Constellation 8K and HyperDeck Stud...

18/08/2026

Twin Cities PBS to Become Minnesota PBS

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

MPA, ByteDance Reach AI Copyright Protection Deal

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

DirecTV to Launch Curated Multiview for Live Sports

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Sinclair Taps Carol Kellum to Head Nebraska Stations

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Corridor Television Pays $27,000 for Violations of FCCs EAS Rules

Share Copy link Facebook X Linkedin Bluesky Email...

18/08/2026

Triveni Digital Accelerates TV 3 0 Transition in Brazil W...

Triveni Digital Now Offers a Joint Solution With MediaKind and a Lab System Bundle Supporting ISDB-Tb and TV 3.0 Broadcast Services Triveni Digital, a trusted ...

18/08/2026

BeckTV Debuts BeckFlow at IBC and Showcases Expertise for...

At IBC2026, BeckTV, a premier systems integrator for the broadcast industry, will introduce BeckFlow to the European market. BeckFlow is the first web-based sch...

18/08/2026

PTZOptics Launches Rise 4K Bringing Ultra HD Quality and...

New flagship PTZ camera combines cinematic 4K imaging, professional broadcast connectivity and the complete Horizon intelligent video experience for productions...

18/08/2026

VisualOn IBC Show Preview - AI-Powered CAE Advanced Playb...

At IBC2026, VisualOn will demonstrate how video service providers can slash bandwidth costs, maximize ad revenue, and deploy premium interactive features withou...

18/08/2026

Paying It Forward: Greg Tabor on Giving Back to the Next Generation

The relationships built during graduate school often continue to shape careers long after a degree is earned, creating a community of scientists who learn from ...

18/08/2026

Sky Sports and The Fast and the Curious announce new partnership

Tuesday 18 August 2026 Sky Sports and The Fast and the Curious announce new partnership Sky Sports and The Fast and the Curious have announced a new long-term...

18/08/2026

Riedel Brings Professional Live Production Into the Classrooms of ECU

Wuppertal August 18, 2026 Riedel Brings Professional Live Production Into the Classrooms of ECURiedel Communications today announced that Edith Cowan Universi...

18/08/2026

The Biggest AI Opportunity Isn't in Engineering. It's in Everyone Else.

In my previous article, The AI Shift Feels Familiar. Our Response Should Be Different., I argued that the greatest challenge organizations face is no longer the...

18/08/2026

Apple announces changes for apps in the European Union - UPDATE - Posted on 18 August 2026

Apple today announced changes to its business terms for apps in the European Uni...

18/08/2026

RT TO AIR NEW DOCUMENTARY THAT LIFTS THE LID ON THE HEALY RAE DYNASTY

THE HEALY RAES: BLOOD, SWEAT & TEARS AIRS WEDNESDAY AUGUST 19 ON RT ONE AT 9:35PM A new documentary The Healy-Raes: Blood, Sweat & Tears airs on RT One and ...