How You Can Explore Nefertari's Tomb in Hyper-Realistic VR
31/10/2018
Nefertari was known as the most beautiful of five wives of Ramses II, a pharaoh renowned for his colossal monuments. The tomb he built for his favorite queen is a shrine to her beauty - every centimeter of the walls in the tomb's three chambers and connecting corridors is adorned with colorful scenes.
Like most of the tombs in the Valley of the Queens, this one had been plundered by the time it was discovered by archaeologists in 1904. And while preservation efforts have been made, the site remains extremely fragile, not to mention remote to most of the world's population.
Simon Che de Boer and his New Zealand-based VFX R&D company, realityvirtual.co, have found a way to digitally preserve Nefertari's tomb and give countless individuals the chance to see inside it.
Nefertari: A Journey to Eternity is a VR experience that uses high-end photogrammetry, visual effects techniques and AI to create an amazingly detailed experience that returns Queen Nefertari's tomb to its original glory. Visitors can digitally walk around, view the scene from different angles and zoom in for a closer look.
It's an amazingly realistic substitute for those who might otherwise have to travel to the other side of the Earth to experience it.
Powerful Data Crunching with NVIDIA Quadro GPUs To replicate the tomb's elaborate details, Che de Boer captured nearly 4,000 42-megapixel photographs of the site, then combined photogrammetry (the science of making measurements from photographs) with deep learning methods for processing and visualization.
NVIDIA GPUs played a critical role in processing the many hours of photogrammetric data collected onsite, crunching it many times faster than would be possible on CPUs.
GPUs were also integral to performing 3D reconstruction and presenting detailed textures. Working on powerful HP workstations equipped with high-end NVIDIA Quadro GPUs, realityvirtual.co converted the data to a dense 24Bn 3D point-cloud using CapturingReality for initial creation. Autodesk MeshMixer and Maya were used for initial clean-up. They then used an in-house, proprietary pipeline to work on the refinements and efficiencies - filling holes, extrapolating material characteristics, removing noise and cleaning up artifacts.
Che de Boer capturing imagery inside the tomb. These very large datasets were then optimized for real-time rendered in Unreal Engine at a stable 90 frames per second, retaining all 24Bn points of detail utilizing texture streaming from Granite. Full dynamic lighting, volumetric fog, reflections, effects and 3D spacial audio.
With these large datasets, speed of processing and playback is key, said Che de Boer. NVIDIA's new architecture combined with Unreal Engine adds a level of speed and power that's unbeatable with this enormous amount of data.
AI: Creating More Realistic VR No visit to an ancient tomb would be believable without removing the signs of recent modernization. To accomplish this, realityvirtual.co collected all the data that was encapsulated from the location and used the programmable Tensor Cores and 24Gb VRAM capacity from a single high-end NVIDIA Quadro GPU to train their super-sampling set.
By teaching the computer to understand what it was looking at, it could then modify the image to how it would have appeared with the modern artifacts removed. For instance, exit signs, plaques, handrails, floorboards and halogen lighting were painted out via in-painting methods and replaced with contextually aware content from the spaces around them.
To cover gaps in images, remove unwanted elements or fix overlap areas in the source photogrammetry images, realityvirtual.co infilled these areas using elements from the surrounding environment by leveraging a new AI-based method for Image InPainting developed by NVIDIA Research and available to software developers soon through the NVIDIA NGX technology stack. (Learn more about AI InPainting.)
Without the kind of memory the high-end NVIDIA Quadro provides, processing the data from our 42-megapixel images would not have been possible, said Che de Boer. We use NVIDIA CUDA cuDNN extensively in both our photogrammetry and AI processes and throughout all aspects of our creation pipeline to achieve the most realism. It looks absolutely amazing. You get a real sense of being there and it's only going to get better once we integrate NVIDIA RTX real time raytracing into our future releases.
More recent in-house releases of the Tomb have been run through realityvirtual.co's own super-sampling methods. This essentially trains their super-sampling on their own datasets, adding another level of detail to the final texture maps.
At that point, a viewer can't distinguish the final pixels no matter how close they get to the Tomb's artifacts. In addition more recent projects are now using realityvirtual.co's deepPBR methods to extrapolate contextually aware normals, delit diffuse, roughness and displacement. They're invaluable for working with physically based rendering engines such as Unreal Engine.
All this data was trained on itself, a great example of AI using its own data to improve itself. The result is an educational simulation that's available on the STEAM gaming platform for free, but requires a Vive, Rift or Windows VR headset.
To continue documenting heritage sites an digitally preserving them for years to come, Che de Boer recently formed a strategic relationship with Professor Sarah Kenderdine at EPFL, a prestigious research university in Lausanne Switzerland. Together they're looking to virtually re-create New Zealand's ChristChurch Cathedral as it existed before it was damaged b
LINK: | https://blogs.nvidia.com/blog/2018/10/31/explore-nefertaris-tomb-vr-vi... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
20/04/2024
PBS Kids Adds American Sign Language to Streaming Content
As part of a push to improve the accessibility of its content, PBS Kids has announced that it has integrated American Sign Language (ASL) interpretations into m...
20/04/2024
Survey: Concerns About Deep Fakes Spike As Election Approaches
SAN JOSE, Calif. Online security solution provider McAfee has released new research exploring the impact artificial intelligence (AI) and the rise of deepfakes ...
20/04/2024
FCC Sets April 25 Vote on Net Neutrality Rules
The Federal Communications Commission has announced the agenda for an Open Meeting on Thursday, April 25, 2024 that will include votes on Net Neutrality Rules a...
20/04/2024
Virtual Reality Becomes the New Production Reality
Virtual reality and its close relatives, such as extended reality, have been completely accepted into the workflow of high-end productions. Stepping into an LED...
20/04/2024
Video Games Round Out the Entertainment Package
Video Games Round Out the Entertainment Package Andy Marken April 19, 2024 0 Comments By this, I take it you think everybody is who they say they are...
20/04/2024
With Bears on the Clock, NBCU Local Chicago Plans Extensive NFL Draft Coverage
With the Bears picking first, NBCUniversal Local's properties in Chicago plan extensive coverage of the NFL draft next week....
20/04/2024
Fox Sports Hires Veteran Ad Sales Executives
Fox Sports said it hired two veteran advertising sales executives, with Jen Durda and Kathy Lydon both named VP....
20/04/2024
Daytime Emmys Announce Some Nominations Early
Daytime fans got a sneak peek at nominations for the 51st annual Daytime Emmys, with the National Academy of Television Arts and Sciences (NATAS) announcing the...
20/04/2024
DAZN Weighs in With Content Ahead of Haney-Garcia Fight
DAZN is launching its Run It Up, its first multi-sports original vodcast, or video podcast, and a set of micro-podcasts ahead of the Devin Haney-Ryan Garcia fig...
20/04/2024
Warner Bros. Discovery CEO David Zaslav Got 27% Raise to $49.7 Million in 2023
David Zaslav, CEO of troubled Warner Bros. Discovery, got a 27% increase in total compensation for 2023....
20/04/2024
April 19, 2024
New copper-catalyzed C-H activation strategy from Scripps Research Two-mode reactions inspired by human detox enzymes offer powerful new tools for drug discover...
19/04/2024
Thank You for visiting us at NAB 2024!
Thank You for visiting us at NAB 2024! Thank you for joining us at the ToolsOnAir booth during NAB Show 2024! We were delighted to showcase our latest inno...
19/04/2024
Stress Positions Mines Health Anxieties for Comedy
PARK CITY, UTAH - JANUARY 18: (L-R) John Early and Theda Hammel attend the 2024 Sundance Film Festival Stress Positions premiere at Library Center Theatre on ...
19/04/2024
Give Me the Backstory: Get to Know Julian Brave NoiseCat and Emily Kassie, the Filmmakers Behind Sugarcane
By Lucy Spicer One of the most exciting things about the Sundance Film Festival...
19/04/2024
Mexico City Watchlist: 7 Documentaries About Working in CDMX
Pictured: Midnight Family By Stephanie Ornelas A great way to get to know a city as culturally unique and rich as Mexico City is to listen to the stories tol...
19/04/2024
SNS Dominates NAB Show 2024 With Triple Win For MOD
St. Louis, MO - April 18, 2024 - Studio Network Solutions (SNS) announced today that MOD won three prestigious industry awards at NAB Show 2024 held this week i...
19/04/2024
How Spotify Approaches Safety With Sarah Hoyle, Global Head of Trust and Safety
Spotify's mission is to unlock the potential of human creativity by giving a million artists the opportunity to live off their art and billions of fans the ...
19/04/2024
Spotify and Taylor Swift Create a One-of-a-Kind Library To Celebrate THE TORTURED POETS DEPARTMENT'
It's a beautiful day to be a Swiftie. Today, Taylor Swift dropped her 11th s...
19/04/2024
L3Harris Announces Quarterly Dividend
MELBOURNE, Fla., April 19, 2024 - The Board of Directors of L3Harris Technologies (NYSE:LHX) declared a quarterly cash dividend of $1.16 per common share, payab...
19/04/2024
Intel Lays Out 8K Production, AI Tech Plans for Paris Olympics
PARIS Intel has announced that its plans for the Olympic and Paralympic Games Paris 2024 will include using artificial intelligence technology powered by Intel ...
19/04/2024
Tech Advances Boost Adoption of 8K Production
LAS VEGAS Technologists working on all aspects of the 8K media production chain offered an optimistic update at the 2024 NAB Show on the state of 8K in video pr...
19/04/2024
OpenDrives New Software-Defined Platform Atlas Wins 2024 NAB Show Product of the Year Award
OpenDrives New Software-Defined Platform Atlas Wins 2024 NAB Show Product of the...
19/04/2024
Grass Valley Showcases Next-Generation T3 Series 4K/HD Digital Recording and Playback for Venues and Stadiums
Grass Valley Showcases Next-Generation T3 Series 4K/HD Digital Recording and Pla...
19/04/2024
NiTRo's M-CUBE Studio Levels Up Esports Productions with AJA Gear
NiTRo's M-CUBE Studio Levels Up Esports Productions with AJA Gear Brie Clayton April 19, 2024 0 Comments Esports' rapid rise to popularity can...
19/04/2024
Blackmagic Design Announces DaVinci Resolve 19
Blackmagic Design Announces DaVinci Resolve 19 Brie Clayton April 19, 2024 0 Comments Major update adds new DaVinci Neural Engine AI tools, new color ...
19/04/2024
Sony Considering Bid to Acquire Paramount
Sony Pictures Entertainment is reportedly in talks with Apollo Global Management to make a bid to acquire Paramount which itself is currently discussing a merge...
19/04/2024
How 1185 Films created the VFX on new horror, All You Need Is Death
Simon Wilkinson, head of VFX at 1185 films, talks about the technology behind the newly-released horror By Matthew Corrigan Published: April 19, 2024 Simo...
19/04/2024
Could Sony be preparing a bid for Channel 5's parent company?
The global electronics company is said to be considering joining forces with investment firm Apollo Management to bid for Paramount Global By Jenny Priestley ...
19/04/2024
EBU report highlights contribution of free-to-air sport broadcasting
The report broke the economic footprint of EBU member sports broadcasting into three main areas By Matthew Corrigan Published: April 19, 2024 The report b...
19/04/2024
CBS Stations Launches CBS News California Investigates' Segments
CBS Stations has launched CBS News California Investigates , with Julie Watts named regional CBS California correspondent. She will uncover and raise awarenes...
19/04/2024
MediaCo Acquires Estrella Media's Spanish-Language Network, Content Assets
MediaCo Holding, which owns radio stations WQHT (Hot 97) and WBLS in New York, said it acquired Estrella Media's Spanish-language video, audio and digital c...
19/04/2024
Season 5 of The Witcher' Will Be Final One
Netflix has ordered season five of fantasy drama The Witcher, which will be the final season. Production has recently begun on season four, and the two remainin...
19/04/2024
DirecTV Stream To Carry Eight More The CW Affiliates
DirecTV Stream said it added eight more The CW affiliates to its lineup on Thursday....
19/04/2024
CBS Orders More Elsbeth'
CBS has renewed Elsbeth for the 2024-2025 season. The drama, with Carrie Preston in the lead role, debuted February 29....
19/04/2024
With Bears on the Clock. NBCU Local Chicago Plans Extensive NFL Draft Coverage
With the Bears picking first, NBCUniversal Local's properties in Chicago plan extensive coverage of the NFL draft next week....
19/04/2024
Comcast Launches NOW
PHILADELPHIA As government subsidies for broadband services come to an end, Comcast has launched NOW, a new product portfolio of lower-cost Internet, mobile and...
19/04/2024
DirecTV Stream Adds CW Affiliates
DirecTV Stream has added more local CW stations for its streaming customers in Boston, Charlotte, Cincinnati, Cleveland, Hartford-New Haven Conn., Phoenix, San ...
19/04/2024
MediaCo Acquires Estrella Media's Content and Digital Operations
NEW YORK & LOS ANGELES MediaCo Holding Inc. has announced that it has acquired all of Estrella Media's network, content, digital, and commercial operations....
19/04/2024
Adobe Launches New Adobe Express Mobile App with Firefly AI
SAN JOSE, Calif. Adobe has announced that the all-new Adobe Express mobile app is available to all users, bringing features powered by Adobe Firefly generative ...
19/04/2024
Netflix Adds 9.3M Subs in Q1
LOS GATOS, Calif. Netflix reported another blockbuster quarter by adding 9.33 million new subscribers in Q1, 2024 as global paid memberships hit 269.6 million, ...
19/04/2024
The Current State of the Industry and the Future Impact of AI
The Current State of the Industry and the Future Impact of AI Hillary Lewis April 18, 2024 0 Comments The Entertainment Industry: How did we get here ...
19/04/2024
After Effects Tutorial Text Blur Reveal
After Effects Tutorial Text Blur Reveal Andy Ford April 18, 2024 0 Comments Here's a way to do a quick blur reveal for your text layer. Start by...
19/04/2024
Hollyland Mars M1 Enhanced Wireless Transmitter / Receiver
Hollyland Mars M1 Enhanced Wireless Transmitter / Receiver Colin Smith April 18, 2024 0 Comments This tutorial shows the new wireless transmitter rece...
19/04/2024
Resolve Fusion: Writing Expressions with Lua
Resolve Fusion: Writing Expressions with Lua Simon Ubsdell April 18, 2024 0 Comments The answer to the very frequently-asked question: what is the pro...
19/04/2024
B+C,' Next TV' Announce Winners of Best of Show Awards at NAB Show
B+C and Next TV have announced the winners of Best of Show Awards for the 2024 NAB Show. The awards were judged by a panel of industry experts at the convention...
19/04/2024
Cate Blanchett Narrates Nature Series on Netflix
Cate Blanchett narrates the Netflix series Our Living World, which premieres April 17. The four-part series looks at the extraordinary creatures around the glob...
19/04/2024
For All Mankind' Spinoff Is in the Works at Apple TV Plus
Apple TV Plus has a spinoff of For All Mankind in the works. It is called Star City and details the cosmonauts, engineers and intelligence officers working behi...