3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.
Since its debut earlier this year, tens of thousands of developers around the world have downloaded the source code and used it to render spectacular scenes, sharing eye-catching results on social media.
The research behind Instant NeRF is being honored as a best paper at SIGGRAPH - which runs Aug. 8-11 in Vancouver and online - for its contribution to the future of computer graphics research. One of just five papers selected for this award, it's among 17 papers and workshops with NVIDIA authors that are being presented at the conference, covering topics spanning neural rendering, 3D simulation, holography and more.
NVIDIA recently held an Instant NeRF sweepstakes, asking developers to share 3D scenes created with the software for a chance to win a high-end NVIDIA GPU. Hundreds participated, posting 3D scenes of landmarks like Stonehenge, their backyards and even their pets.
Among the creators using Instant NeRF are:
Through the Looking Glass: Karen X. Cheng and James Perlman San Francisco-based creative director Karen X. Cheng is working with software engineer James Perlman to render 3D scenes that test the boundaries of what Instant NeRF can create.
The duo has used Instant NeRF to create scenes that explore reflections within a mirror (shown above) and handle complex environments with multiple people - like a group enjoying ramen at a restaurant.
The algorithm itself is groundbreaking - the fact that you can render a physical scene with higher fidelity than normal photogrammetry techniques is just astounding, Perlman said. It's incredible how accurately you can reconstruct lighting, color differences or other tiny details.
It even makes mistakes look artistic, said Cheng. We really lean into that, and play with training a scene less sometimes, experimenting with 1,000, or 5,000 or 50,000 iterations. Sometimes I'll prefer the ones trained less because the edges are softer and you get an oil-painting effect.
Using prior tools, it would take them three or four days to train a decent-quality scene. With Instant NeRF, the pair can churn out about 20 a day, using an NVIDIA RTX A6000 GPU to render, train and preview their 3D scenes.
With rapid rendering comes faster iteration.
Being able to render quickly is very necessary for the creative process. We'd meet up and shoot 15 or 20 different versions, run them overnight and then see what's working, said Cheng. Everything we've published has been shot and reshot a dozen times, which is only possible when you can run several scenes a day.
Preserving Moments in Time: Hugues Bruy re Hugues Bruy re, partner and chief of innovation at Dpt., a Montreal-based creative studio, uses Instant NeRF daily.
3D captures have always been of strong interest to me because I can go back to those volumetric reconstructions and move in them, adding an extra dimension of meaning to them, he said.
Bruy re rendered 3D scenes with Instant NeRF using the data he'd previously captured for traditional photogrammetry relying on mirrorless digital cameras, smartphones, 360 cameras and drones. He uses an NVIDIA GeForce RTX 3090 GPU to render his Instant NeRF scenes.
Bruy re believes Instant NeRF could be a powerful tool to help preserve and share cultural artifacts through online libraries, museums, virtual-reality experiences and heritage-conservation projects.
The aspect of capturing itself is being democratized, as camera and software solutions become cheaper, he said. In a few months or years, people will be able to capture objects, places, moments and memories and have them volumetrically rendered in real time, shareable and preserved forever.
Using pictures taken with a smartphone, Bruy re created an Instant NeRF render of an ancient marble statue of Zeus from an exhibition at Toronto's Royal Ontario Museum.
Stepping Into Remote Scenes: Jonathan Stephens Jonathan Stephens, chief evangelist for spatial computing company EveryPoint, has been exploring Instant NeRF for both creative and practical applications.
EveryPoint reconstructs 3D scenes such as stockpiles, railyards and quarries to help businesses manage their resources. With Instant NeRF, Stephens can capture a scene more completely, allowing clients to freely explore a scene. He uses an NVIDIA GeForce RTX 3080 GPU to run scenes rendered with Instant NeRF.
What I really like about Instant NeRF is that you quickly know if your render is working, Stephens said. With a large photogrammetry set, you could be waiting hours or days. Here, I can test out a bunch of different datasets and know within minutes.
He's also experimented with making NeRFs using footage from lightweight devices like smart glasses. Instant NeRF could turn the low-resolution, bumpy footage from Stephens walking down the street into a smooth 3D scene.
Find NVIDIA at SIGGRAPH Tune in for a special address by NVIDIA CEO Jensen Huang and other senior leaders on Tuesday, Aug. 9, at 9 a.m. PT to hear about the research and technology behind AI-powered virtual worlds.
NVIDIA is also presenting a score of in-person and virtual sessions for SIGGRAPH attendees, including:
The Next Evolution of Universal Scene Description (USD) for Building Virtual Worlds
Real-Time Collaboration in Ray-Traced VR
Meet the Researchers: How to Use NVIDIA Kaolin in Your 3D Deep Learning Workflows
The Future of Extended Reality: How Immersion Will Change Everything
Learn how to create with Instant NeRF in the hands-on demo, NVIDIA Instant NeRF - Getting Started With Neural Radiance Fields. Instant NeRF will also be part of SIGGRAPH's Real-Time Live showcase - where in-person attendees can vote for a winning project.
For more interactive sessions
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
31/05/2024
A U.S. Marine fires an FIM-92 Stinger missile during a training exercise in Yuma...
31/05/2024
NEW YORK The global body that sets technical standards for digital advertising h...
31/05/2024
In a new analysis of what services might make up a good bundle and what services might benefit the most from bundling, Antenna has released new data that highli...
31/05/2024
Global SVOD revenues will increase by $116.6 billion by 2031, a growth rate of 13.3% per year over the next eight years, according to a new report from MIDiA Re...
31/05/2024
WASHINGTON, D.C. The FCC Media Bureau has announced that effective August 1, 2024 the Commission's TVStudy software will incorporate the most recent U.S. Ce...
31/05/2024
NBCUniversal has announced that its FAST channel TNBC will be rebranding to NBC Comedy Vault on June 1 and that the free streaming service will officially launc...
31/05/2024
PARIS Ateme has announced that the Indonesian public broadcaster TVRI is making the transition to 4K UHD OTT streaming using Ateme technologies....
31/05/2024
The proposal had received support from James Cameron, Andy Serkis, Paul Greengrass, Richard Curtis, and Jeremy Irons
By Matthew Corrigan
Published: May 31, 2...
31/05/2024
According to multiple reports, the new bid from Skydance offers a better deal to Paramounts Class B shareholders, who were said to be unhappy with the companys ...
31/05/2024
The awards recognise women and companies who are stand-out performers, innovators and leaders in the broadcast media technology industry
By Matthew Corrigan
...
31/05/2024
NEW YORK The global body that sets technical standards for digital advertising has expanded the reach of its measurement software development kit to include Sam...
31/05/2024
The rise of digital platforms is fundamentally changing the broadcast newsroom and its investment in technology according to Jon Roberts, director of technology...
31/05/2024
In a new analysis of what services might make up a good bundle and what services might benefit the most from bundling, Antenna has released new data that highli...
31/05/2024
WASHINGTON, D.C. Fifty state broadcasters associations, including the District of Columbia and the Commonwealth of Puerto Rico, have sent a letter to Congressio...
31/05/2024
EVS has announced the appointment of Richard Katz as senior vice president of operations for the North and Latin American (NALA) region. This appointment is par...
31/05/2024
CommScope has announced that it was selected by Casa Systems, Inc. as the highest to acquire Casa's cable business assets and that the two companies have en...
31/05/2024
Robert De Niro won't be receiving the Service to America Leadership Award from the NAB Leadership Foundation after all....
31/05/2024
Viant Technology said it formed an integration with Google Cloud's BigQuery data clean rooms...
31/05/2024
The CW said it will broadcast the 2024 Snoop Dogg Arizona Bowl presented by Gin & Juice by Dre and Snoop Last year, The CW aired the game when it was called Bar...
31/05/2024
Allen Media Group said it made a deal with Amazon's Fire TV Channel that will make content from several of Allen's outlet available via Fire TV and Echo...
31/05/2024
Robert De Niro, announced as the winner of the NAB's Leadership Foundation's Service to America Leadership Award on May 28, will not get the award. The ...
31/05/2024
Comcast Technology Solutions was selected by AccuWeather to create, manage and distribute linear and over-the-top video channels....
31/05/2024
Connected TV is becoming a bigger deal for consumers and advertisers, according to a new report from TVision....
31/05/2024
31 May 2024
VEON discloses April YTD trading update at its AGM Amsterdam, 31 May 2024 07:00 CEST -
VEON April YTD 2024 Highlights
Total revenue of USD 1,278 ...
31/05/2024
31 May 2024
VEON Announces Its New Board, Names Founder Augie Fabela as Chairman Amsterdam, 31 May 2024, 16.00 CET: VEON Ltd. (NASDAQ: VEON, Euronext Amsterdam...
31/05/2024
May 31st, 2024
TRIBECA FESTIVAL AND OPEN AI ANNOUNCE SORA SHORTS'
Five Commissioned Short Films Created Using Sora Debut at 2024 Tribeca Festival
New ...
31/05/2024
In-Venue Technology Wrap-Up: How 4K, IP, and More are Changing the Game Pres Gam...
31/05/2024
UEFA Champions League Final 2024: The host broadcast facts and figures for Real ...
31/05/2024
UEFA Europa Conference League Final 2024: Bringing the broadcast to global TV sc...
31/05/2024
Willow Offers Free 2024 ICC T20 Cricket World Cup Preview via DirecTV, Verizon, ...
31/05/2024
Women's College World Series: ESPN Brings Live Drone, Two-Point Cabled, and ...
31/05/2024
SVG College Summit Brings Video-Production Industry Together in Atlanta in the M...
31/05/2024
UEFA Champions League Final 2024: CBS Sports' UCL Today Studio Show Is Pitch...
31/05/2024
Back to All News
Master of the House' Unveils a Scandalous Tale of Power and Greed on July 18
Entertainment
31 May 2024
GlobalThailand
Link copied to ...
31/05/2024
Back to All News
JEEtu Bhaiya is Back: Kota Factory' Season 3 Arrives on Netflix June 20
Entertainment
31 May 2024
GlobalIndia
Link copied to clipboar...
31/05/2024
Facebook
Twitter
LinkedIn
With around 9,000 employees, Ground Transportation Systems is a global leader in Rail Signaling and Train Control Systems, Telec...
31/05/2024
RT 2FM is the home of music this summer, entertaining listeners across the day and night, with the best music, chat and interviews providing the soundtrack to ...
31/05/2024
After the 2008 financial crisis and increased risk-management regulations that f...
31/05/2024
RT Supporting the Arts: What's On this June
Watch our promo: RT Supporting the Arts | What's on YouTube
This June, RT is delighted to support Lim...
30/05/2024
When to Upgrade Software or Firmware This post is from our blog and news archive. The information may be out of date. Please contact us for further information ...
30/05/2024
The City of San Jose Chooses Utah Scientific Again! This post is from our blog and news archive. The information may be out of date. Please contact us for furth...
30/05/2024
Navigating Strategy, Ethics, and Innovation in the evolving European media lands...
30/05/2024
By Bailey Pennick
One of the most exciting things about the Sundance Film Festi...
30/05/2024
Tickets are now available for the first-of-its-kind event in the United States f...
30/05/2024
Mental health and well-being are fundamental components of a child's healthy...
30/05/2024
After 64 days, the winner of Alone Australia has been revealed
29 May, 2024
Media releases
*Contains Spoilers*
After 64 days alone in the extreme and wild...
30/05/2024
Alone Australia finale delivers strongly as SBS confirms it will join VOZ stream...
3D content creators are clamoring for NVIDIA Instant NeRF, an inverse rendering tool that turns a set of static images into a realistic 3D scene.
