Sony Pixel Power calrec Sony

NVIDIA Instant NeRF Wins Best Paper at SIGGRAPH, Inspires Creative Wave Amid Tens of Thousands of Downloads

05/08/2022

3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.

Since its debut earlier this year, tens of thousands of developers around the world have downloaded the source code and used it to render spectacular scenes, sharing eye-catching results on social media.

The research behind Instant NeRF is being honored as a best paper at SIGGRAPH - which runs Aug. 8-11 in Vancouver and online - for its contribution to the future of computer graphics research. One of just five papers selected for this award, it's among 17 papers and workshops with NVIDIA authors that are being presented at the conference, covering topics spanning neural rendering, 3D simulation, holography and more.

NVIDIA recently held an Instant NeRF sweepstakes, asking developers to share 3D scenes created with the software for a chance to win a high-end NVIDIA GPU. Hundreds participated, posting 3D scenes of landmarks like Stonehenge, their backyards and even their pets.

Among the creators using Instant NeRF are:

Through the Looking Glass: Karen X. Cheng and James Perlman San Francisco-based creative director Karen X. Cheng is working with software engineer James Perlman to render 3D scenes that test the boundaries of what Instant NeRF can create.

The duo has used Instant NeRF to create scenes that explore reflections within a mirror (shown above) and handle complex environments with multiple people - like a group enjoying ramen at a restaurant.

The algorithm itself is groundbreaking - the fact that you can render a physical scene with higher fidelity than normal photogrammetry techniques is just astounding, Perlman said. It's incredible how accurately you can reconstruct lighting, color differences or other tiny details.

It even makes mistakes look artistic, said Cheng. We really lean into that, and play with training a scene less sometimes, experimenting with 1,000, or 5,000 or 50,000 iterations. Sometimes I'll prefer the ones trained less because the edges are softer and you get an oil-painting effect.

Using prior tools, it would take them three or four days to train a decent-quality scene. With Instant NeRF, the pair can churn out about 20 a day, using an NVIDIA RTX A6000 GPU to render, train and preview their 3D scenes.

With rapid rendering comes faster iteration.

Being able to render quickly is very necessary for the creative process. We'd meet up and shoot 15 or 20 different versions, run them overnight and then see what's working, said Cheng. Everything we've published has been shot and reshot a dozen times, which is only possible when you can run several scenes a day.

Preserving Moments in Time: Hugues Bruy re Hugues Bruy re, partner and chief of innovation at Dpt., a Montreal-based creative studio, uses Instant NeRF daily.

3D captures have always been of strong interest to me because I can go back to those volumetric reconstructions and move in them, adding an extra dimension of meaning to them, he said.

Bruy re rendered 3D scenes with Instant NeRF using the data he'd previously captured for traditional photogrammetry relying on mirrorless digital cameras, smartphones, 360 cameras and drones. He uses an NVIDIA GeForce RTX 3090 GPU to render his Instant NeRF scenes.

Bruy re believes Instant NeRF could be a powerful tool to help preserve and share cultural artifacts through online libraries, museums, virtual-reality experiences and heritage-conservation projects.

The aspect of capturing itself is being democratized, as camera and software solutions become cheaper, he said. In a few months or years, people will be able to capture objects, places, moments and memories and have them volumetrically rendered in real time, shareable and preserved forever.

Using pictures taken with a smartphone, Bruy re created an Instant NeRF render of an ancient marble statue of Zeus from an exhibition at Toronto's Royal Ontario Museum.

Stepping Into Remote Scenes: Jonathan Stephens Jonathan Stephens, chief evangelist for spatial computing company EveryPoint, has been exploring Instant NeRF for both creative and practical applications.

EveryPoint reconstructs 3D scenes such as stockpiles, railyards and quarries to help businesses manage their resources. With Instant NeRF, Stephens can capture a scene more completely, allowing clients to freely explore a scene. He uses an NVIDIA GeForce RTX 3080 GPU to run scenes rendered with Instant NeRF.

What I really like about Instant NeRF is that you quickly know if your render is working, Stephens said. With a large photogrammetry set, you could be waiting hours or days. Here, I can test out a bunch of different datasets and know within minutes.

He's also experimented with making NeRFs using footage from lightweight devices like smart glasses. Instant NeRF could turn the low-resolution, bumpy footage from Stephens walking down the street into a smooth 3D scene.

Find NVIDIA at SIGGRAPH Tune in for a special address by NVIDIA CEO Jensen Huang and other senior leaders on Tuesday, Aug. 9, at 9 a.m. PT to hear about the research and technology behind AI-powered virtual worlds.

NVIDIA is also presenting a score of in-person and virtual sessions for SIGGRAPH attendees, including:

The Next Evolution of Universal Scene Description (USD) for Building Virtual Worlds

Real-Time Collaboration in Ray-Traced VR

Meet the Researchers: How to Use NVIDIA Kaolin in Your 3D Deep Learning Workflows

The Future of Extended Reality: How Immersion Will Change Everything

Learn how to create with Instant NeRF in the hands-on demo, NVIDIA Instant NeRF - Getting Started With Neural Radiance Fields. Instant NeRF will also be part of SIGGRAPH's Real-Time Live showcase - where in-person attendees can vote for a winning project.

For more interactive sessions
LINK: https://blogs.nvidia.com/blog/2022/08/05/instant-nerf-creators-siggrap...
See more stories from nvidia

Most recent headlines

07/12/2022

Dalet Flex Takes a Leap Forward

Dalet, a leading technology and service provider for media-rich organizations, today announced key new capabilities available in Dalet Flex that support importa...

04/11/2022

Game better with DTS Headphone:X

The best gamers know DTS Headphone:X technology ups their play. Now major magazines have caught on, too. DTS Headphone:X technology creates immersive soundsc...

08/10/2022

Dalet Next-Gen Solutions at IBC 2022

Dalet, a leading technology and service provider for media-rich organizations, is pleased to announce its return to the IBC Show, held in Amsterdam from Septemb...

12/08/2022

El rapero mexicano Santa Fe Klan presenta Mundo, su lbum ms personal, con contenido nico para sus fans en Spotify

Con apenas 22 a os, ngel Jair Quezada, quien se hace llamar Santa Fe Klan, es u...

12/08/2022

In Conversation: Winning Time

The HBO original series Winning Time: The Rise of the Lakers Dynasty re-creates the Los Angeles Lakers' historic climb to prominence over the rest of the NB...

12/08/2022

SAFTAs16 open call for in memorial segment.

The National Film and Video Foundation (NFVF), an agency of the Department of Sport, Arts, and Culture and custodian of the SAFTAs is calling all South Africans...

12/08/2022

Boston Conservatory at Berklee Dancers to Perform at KCON Los Angeles

Boston Conservatory at Berklee Dancers to Perform at KCON Los Angeles Thirteen dance students will perform four times throughout the convention, including ope...

12/08/2022

Cloud cover for Spanish theatre festival

A 4K cloud workflow from TVU Networks has enabled the broadcast of Spain's Almagro Classical Theater Festival for RTVE, who deployed a multi-camera producti...

12/08/2022

My IBC: Andrew Starks, AIMS board member

In a new series of features, Future speaks to a selection of industry stakeholders about their typical IBC routines, and what theyre looking forward to at this ...

12/08/2022

Disneys DTC Subs Surpass Netflix

BURBANK, Calif. As Disney announced significant subscription price increases (opens in new tab) for its streaming services and launch dates for a lower-cost ad-...

12/08/2022

RTVE Deploys TVU Networks Cloud Technology

ALMAGRO, Spain Spanish national public broadcaster Radiotelevisi n Espa ola (RTVE) in July used cloud-based 4K and 5G live production technology from TVU Networ...

12/08/2022

Olympic Broadcasting Services Lays Out Initial Plans for Paris 2024

PARIS With just under two years to go until the start of the Paris 2024 Olympic Games, Olympic Broadcasting Services (OBS) has revealed its initial plans for th...

12/08/2022

Producer Evan Shapiro to Keynote NAB Show New York Opening

WASHINGTON Award-winning film producer Evan Shapiro will keynote the 2022 NAB Show New York opening event. In his presentation, Bringing Media Into the Current...

12/08/2022

FTC Eyes Rules Cracking Down on 'Commercial Surveillance'

WASHINGTON D.C. The Federal Trade Commission has announced it is exploring rules to crack down on harmful commercial surveillance and lax data security....

12/08/2022

SDVI to Highlight Rally Enhancements at IBC2022

AMSTERDAM At the 2022 IBC Show in Amsterdam, Sept 9-13, SDVI will showcase the latest developments in media supply chain optimization, including net-zero emissi...

12/08/2022

A+E to Launch Crime+Investigation Play' DTC Service in U.K.

LONDON A+E Networks UK & EMEA has announced that it will launch the direct-to-consumer true crime streaming service Crime+Investigation Play on the 5th of Septe...

12/08/2022

Sky Studios Elstree Selects Xytech Systems Resource Management Software

BOREHAMWOOD, U.K. Sky Studios Elstree, a joint venture of Sky and NBCUniversal, has selected Xytech Systems resource management software for its complete operat...

12/08/2022

Chicken Soup Closes Redbox Deal

COS COB, Conn. & OAKBROOK TERRACE, Ill. Chicken Soup for the Soul Entertainment has announced that the company has completed the acquisition of Redbox Entertain...

12/08/2022

HBO Max Creates 'Our Flag Means Death' Using Blackmagic Design

FREMONT, Calif. Blackmagic Design has announced that the HBO Max series Our Flag Means Death used extensive Blackmagic Design products to create the stunning ...

12/08/2022

NDI: Connection without complication

TVBEurope sits down for a Q&A with Tarif Sayed, president and GM of NDI Global, to discuss his background, his path to NDI, and what makes it a great fit for co...

12/08/2022

The Guys from IPnema

As open-standards-based IP has come of age as a network protocol for the broadcast, AV and corporate sectors, the emphasis has moved from making essence transpo...

12/08/2022

Canon Releases New PTZ Protocols for CR-N500 and CR-N300 4K PTZ Cameras

Canon Releases New PTZ Protocols for CR-N500 and CR-N300 4K PTZ Cameras Brie Clayton August 11, 2022 0 Comments Canon CR-N500 and CR-N300 Firmware Upd...

12/08/2022

PHABRIX launches QxP - The portable QxL

PHABRIX launches QxP - The portable QxL Brie Clayton August 11, 2022 0 Comments PHABRIX, a broadcast test & measurement innovator, has announced the la...

12/08/2022

VEGAS Creative Software Launches VEGAS Pro 20

VEGAS Creative Software Launches VEGAS Pro 20 Brie Clayton August 11, 2022 0 Comments VEGAS Pro 20 Enhances Cloud Collaboration with New VEGAS Hub Feat...

12/08/2022

ATOMOS CONNECT and SHOGUN CONNECT new firmware enables Frame.io Camera to Cloud workflows

ATOMOS CONNECT and SHOGUN CONNECT new firmware enables Frame.io Camera to Cloud ...

12/08/2022

The Russell Howard Hour returns to Sky Max on Thursday 8th September at 10pm

Russell Howard is back to share his hilarious takes on the spiralling headlines with the 6th series of The Russell Howard Hour, coming to Sky MAX and streaming ...

12/08/2022

We picked' a great day for it!

Posted on 12 Aug 2022 ICG joined local volunteers and Coastal Conservationist and Marine Medic, Tracey Hope for the daily beach clean on the Fylde coast at St ...

12/08/2022

Metal Festival Feels Full Force of CODA Audio

Described by Winston McCall of Australian metalcore band, Parkway Drive, as the most metal place on earth! the Full Force festival in L bnitz, Germany has bee...

12/08/2022

Celebrities Embark on The Journey of a Lifetime in Meter TV's Adventure Series

Banijay today announces Swedish label Meter TV, part of Banijay Nordic, will pro...

12/08/2022

The Isley Brothers reimagine a 1975 classic with Beyonc [listen]

The Isley Brothers reimagine a 1975 classic with Beyonc [listen] R&B legends The Isley Brothers have teamed up with Beyonc on a duet of their 1975 classic, M...

12/08/2022

Actress Nomzamo Mbatha researched Nandi while filming Isibaya'

Actress Nomzamo Mbatha researched Nandi while filming Isibaya' Shaka Ilembe' producer and actress Nomzamo Mbatha says she's always wanted to play Q...

12/08/2022

Skeem Saam' September Spoilers: Kwaito leaves, Alfred is bribed

Skeem Saam' September Spoilers: Kwaito leaves, Alfred is bribedThe Skeem Saam' teasers reveal that Clement Maosa, who plays Kwaito Seakamela-Maputla wi...

12/08/2022

WATCH: Skeem Saam - Tonight's teaser E30 S11

WATCH: Skeem Saam - Tonight's teaser E30 S11Find out what's going on tonight on Skeem Saam! by SA TV and Soapies 12-08-2022 16:00 in SkeemSaam Fri...

12/08/2022

WATCH: Generations - The Legacy, tonight's teaser E190 S8

WATCH: Generations - The Legacy, tonight's teaser E190 S8Keen to know what's happening on the latest episode of Generations: The Legacy? by SA TV and ...

12/08/2022

WATCH: Uzalo- Tonight's teaser E115 S8

WATCH: Uzalo- Tonight's teaser E115 S8Don't get left behind, catch up on Uzalo now! by SA TV and Soapies 12-08-2022 16:05 in Soapies Friday's ...

12/08/2022

WATCH: Imbewu - The Seed, tonight's teaser E87 S5

WATCH: Imbewu - The Seed, tonight's teaser E87 S5Catch up on what's going on to night on Imbewu by SA TV and Soapies 12-08-2022 16:08 in Soapies F...

12/08/2022

WATCH: Diep City - Tonight's teaser E95 S2

WATCH: Diep City - Tonight's teaser E95 S2We've got you covered on what's happening tonight. by SA TV and Soapies 12-08-2022 16:10 in Soapies ...

12/08/2022

WATCH: The River - Tonight's teaser E135 S5

WATCH: The River - Tonight's teaser E135 S5Watch tonight's episode of The River and catch the latest episode every weekday at 20:00 on 1 Magic, don'...

12/08/2022

WATCH: Scandal - Tonight's teaser E96 S14

WATCH: Scandal - Tonight's teaser E96 S14Get to know what's happening on tonight's episode! by SA TV and Soapies 12-08-2022 16:15 in Scandal F...

12/08/2022

WATCH: Gomora - Tonight's teaser E80 S3

WATCH: Gomora - Tonight's teaser E80 S3Don't miss out on what's happening on tonight's episode of Gomora, and watch the latest episode every wee...

12/08/2022

WATCH: Muvhango - Tonight's teaser E419 S22

WATCH: Muvhango - Tonight's teaser E419 S22Don't miss out on the latest drama in Muvhango! by SA TV and Soapies 12-08-2022 16:20 in Muvhango Frida...

12/08/2022

WATCH: 7de Laan - Tonight's teaser E425 S22

WATCH: 7de Laan - Tonight's teaser E425 S22Don't miss out on what's happening on tonight's episode of 7de Laan and Catch the latest episode ever...

12/08/2022

Belinda the Bok anthem singer': Who is SA's Whitney Houston?

Belinda the Bok anthem singer': Who is SA's Whitney Houston?Belinda Davids has been tasked with singing the national anthem at the Springboks vs All Bla...

12/08/2022

Ross elevates its production switcher lineup with significant upgrades to the Carbonite & Acuity product lines

Ross Video's comprehensive production switcher lineup grows more robust and ...

12/08/2022

AJA Releases Mini-Config v2.26.4

AJA Releases Mini-Config v2.26.4 posted: 12/08/2022 Feature-rich software update streamlines conversion workflows, delivers enhanced flexibility AJA Vid...

12/08/2022

Daily devotion: Your bible verse and prayer for 12 August 2022

Daily devotion: Your bible verse and prayer for 12 August 2022GOOD MORNING! Here's your daily bible verse and prayer to get you ready and excited about your...

12/08/2022

Actor Arthur Masoma discusses playing Phuthi in Skeem Saam'

Actor Arthur Masoma discusses playing Phuthi in Skeem Saam' Actor Arthur Masoma recently joined Skeem Saam' after auditioning for the role of Phuthi L...

12/08/2022

From the Garden of Eden to the promised land: IT IS WRITTEN

From the Garden of Eden to the promised land: IT IS WRITTENOur Father is preparing a new heaven and a new earth, built for His bride, beautifully dressed for he...

12/08/2022

Beats n Bars festival moves to American Tobacco in Durham

The Beats n Bars Festival is relocating to the American Tobacco Campus in September. The festival kicks off Friday, Sept. 16, with a free hip hop show at Bouri...

11/08/2022

Celebrate the 25th Birthday of The Full Monty, Plus 4 More Sundance Films With August Anniversaries

By Vanessa Zimmer Twenty-five years ago this month, many of us learned the mean...