New NVIDIA Neural Graphics SDKs Make Metaverse Content Creation Available to All
Brie Clayton August 11, 2022
0 Comments
A dozen tools and programs - including new releases NeuralVDB and Kaolin Wisp - enable easy, fast 3D content creation for millions of designers and creators.
The creation of 3D objects for building scenes for games, virtual worlds including the metaverse, product design or visual effects is traditionally a meticulous process, where skilled artists balance detail and photorealism against deadlines and budget pressures.
It takes a long time to make something that looks and acts as it would in the physical world. And the problem gets harder when multiple objects and characters need to interact in a virtual world. Simulating physics becomes just as important as simulating light. A robot in a virtual factory, for example, needs to have not only the same look, but also the same weight capacity and braking capability as its physical counterpart.
It's hard. But the opportunities are huge, affecting trillion-dollar industries as varied as transportation, healthcare, telecommunications and entertainment, in addition to product design. Ultimately, more content will be created in the virtual world than in the physical one.
To simplify and shorten this process, NVIDIA today released new research and a broad suite of tools that apply the power of neural graphics to the creation and animation of 3D objects and worlds.
These SDKs - including NeuralVDB, a ground-breaking update to industry standard OpenVDB,and Kaolin Wisp, a Pytorch library establishing a framework for neural fields research - ease the creative process for designers while making it easy for millions of users who aren't design professionals to create 3D content.
Neural graphics is a new field intertwining AI and graphics to create an accelerated graphics pipeline that learns from data. Integrating AI enhances results, helps automate design choices and provides new, yet to be imagined opportunities for artists and creators. Neural graphics will redefine how virtual worlds are created, simulated and experienced by users.
These SDKs and research contribute to each stage of the content creation pipeline, including:
3D Content Creation
Kaolin Wisp - an addition to Kaolin, a PyTorch library enabling faster 3D deep learning research by reducing the time needed to test and implement new techniques from weeks to days. Kaolin Wisp is a research-oriented library for neural fields, establishing a common suite of tools and a framework to accelerate new research in neural fields.
Instant Neural Graphics Primitives - a new approach to capturing the shape of real-world objects, and the inspiration behind NVIDIA Instant NeRF, an inverse rendering model that turns a collection of still images into a digital 3D scene. This technique and associated GitHub code accelerate the process by up to 1,000x.
3D MoMa - a new inverse rendering pipeline that allows users to quickly import a 2D object into a graphics engine to create a 3D object that can be modified with realistic materials, lighting and physics.
GauGAN360 - the next evolution of NVIDIA GauGAN, an AI model that turns rough doodles into photorealistic masterpieces. GauGAN360 generates 8K, 360-degree panoramas that can be ported into Omniverse scenes.
Omniverse Avatar Cloud Engine (ACE) - a new collection of cloud APIs, microservices and tools to create, customize and deploy digital human applications. ACE is built on NVIDIA's Unified Compute Framework, allowing developers to seamlessly integrate core NVIDIA AI technologies into their avatar applications.
Physics and Animation
NeuralVDB - a groundbreaking improvement on OpenVDB, the current industry standard for volumetric data storage. Using machine learning, NeuralVDB introduces compact neural representations, dramatically reducing memory footprint to allow for higher-resolution 3D data.
Omniverse Audio2Face - an AI technology that generates expressive facial animation from a single audio source. It's useful for interactive real-time applications and as a traditional facial animation authoring tool.
ASE: Animation Skills Embedding - an approach enabling physically simulated characters to act in a more responsive and life-like manner in unfamiliar situations. It uses deep learning to teach characters how to respond to new tasks and actions.
TAO Toolkit - a framework to enable users to create an accurate, high-performance pose estimation model, which can evaluate what a person might be doing in a scene using computer vision much more quickly than current methods.
Experience
Image Features Eye Tracking - a research model linking the quality of pixel rendering to a user's reaction time. By predicting the best combination of rendering quality, display properties and viewing conditions for the least latency, It will allow for better performance in fast-paced, interactive computer graphics applications such as competitive gaming.
Holographic Glasses for Virtual Reality - a collaboration with Stanford University on a new VR glasses design that delivers full-color 3D holographic images in a groundbreaking 2.5-mm-thick optical stack.
Join NVIDIA at SIGGRAPH to see more of the latest research and technology breakthroughs in graphics, AI and virtual worlds. Check out the latest innovations from NVIDIA Research, and access the full suite of NVIDIA's SDKs, tools and libraries.
###
Enjoying the news? Sign up for the Creative COW Newsletter! Sign up for the Creative COW newsletter and get weekly updates on industry news, forum highlights, jobs, inspirational tutorials, tips, burning questions, and more! Receive bulletins from the largest, longest-running community dedicated to supporting professionals working in film, video, and audio.
Enter your email address, a first and last name, and let u
North America Stories
23/04/2024
IN ADDITION TO FICTION AND DOCUMENTARY FEATURES, THE SELECTION INCLUDES:
PRO...
23/04/2024
LONDON IBC is now accepting nominations for its IBC2024 Innovation Awards, which honor achievements in technological innovation and social impact media & entert...
23/04/2024
WASHINGTON, D.C. In response to the introduction of the Broadcast VOICES Act that seeks to encourage more diversity in the ownership of TV and radio stations, t...
23/04/2024
MIAMI, Fla. As part of a push to expand its FAST channel and streaming operations, Hemisphere Media Group has launched its free ad supported television (FAST) c...
23/04/2024
LOS ANGELES DirecTV is adding seven new channels to its rapidly expanding streaming lineup through new licensing agreements with Cineverse Corp. and Scripps Net...
23/04/2024
IBC is preparing to honour the highest achievements in technological innovation and social impact with the launch of its prestigious IBC2024 Innovation Awards, ...
23/04/2024
BREA, Calif. Bolin Technology is integrating Network Device Interface (NDI) across its product line, bringing support for the latest NDI technologies to its PTZ...
23/04/2024
WYOMISSING, Pa. PENN Entertainment has announced that longtime Disney and ESPN executive Aaron LaBerge has been named chief technology officer effective July 1,...
23/04/2024
In response to an FCC ruling in March proposing a $1.2 million fine against Nexstar and a ruling that Mission Broadcasting sell WPIX, Nexstar has filled a respo...
23/04/2024
Sony has announced new details about how the National Hot Rod Association (NHRA) is using Sony's Ci Media Cloud platform to streamline its workflows and spe...
23/04/2024
Esports' rapid rise to popularity can be attributed to many factors, from technological advancements that have enhanced the quality of modern gaming experie...
23/04/2024
OpenDrives, Inc., the global provider of software-defined media workflow solutions and data management capabilities, has been selected as a winner in the 2024 N...
23/04/2024
BCNEXXT is pleased to announce that Vpe has won the 2024 NAB Show Product of the Year Award in the Asset Management, Automation and Playout category. The offici...
23/04/2024
Gravity Media, a world leading global provider of complex live creative production and media services, today outlined the broadcast technology and television pr...
23/04/2024
Scality, a global leader in cyber-resilient storage for the AI era, today announced the appointment of Peter Brennan as Chief Executive Officer (CEO) of Scality...
23/04/2024
Blackmagic Design today announced ATEM 1 M/E Constellation 4K and ATEM 2 M/E Constellation 4K switchers, two new Ultra HD models of the ATEM Constellation famil...
23/04/2024
Blackmagic Design today announced Blackmagic Videohub 120x120 12G, the newest model in the Videohub 12G router family. The massive Blackmagic Videohub 120x120 1...
23/04/2024
Blackmagic Design today announced new lower prices for Blackmagic Video Assist 3G and 12G models. Customers can save US$200 on all models. These lower prices ma...
23/04/2024
Adder Technology continues to shine brightly, with its groundbreaking product, the ADDERLink INFINITY 3000 (ALIF3000), once again taking center stage. Hot on t...
23/04/2024
Pliant Technologies' CRP-C12 Compact Radio Pack is an Audio Production, Processing and Networking category winner in the 2024 NAB Show Product of the Year A...
23/04/2024
SipRadius, the specialists in live media transport and transcoding, will showcase their world-leading implementation of AV1 and JPEG-XS over transport streams a...
23/04/2024
Composer Rafael Krux has added a Prism Sound Dream ADA-128 modular conversion system to his production studio where he creates music for commercials, trailers, ...
23/04/2024
PMC proudly provides the ultimate large-scale Dolby Atmos audio system for the legendary musician Steven Wilson at the High End, Munich. He will share his exten...
23/04/2024
Particles emitting from a 3D rotating shape's edge
Graham Quince April 22, 2024
0 Comments
In Fixin' FX, people send me their problematic proj...
23/04/2024
Hollyland Technology Announces a New Line of Video Transmitters: Introducing the...
23/04/2024
Charlotte Deleste, anchor at WISC Madison, Wisconsin, is leaving the station. Her final day on the air is April 24. Deleste has spent 18 years there....
23/04/2024
Top WNBA draft choice Caitlin Clark will appear on local broadcast for 17 games next season in a deal between Tegna and the Indiana Fever....
23/04/2024
Soccer's Appeal to Younger Audiences: Inside the Gamification of European Fo...
23/04/2024
With NBA and NHL Playoffs in Full Swing, Never a Dull Moment for TNT Sports Prod...
23/04/2024
NAB 2024: AT&T Business's Scott Beckett Details Transmission Firepower With ...
23/04/2024
NAB 2024: Manufacturers focus on cinematic look for live productions By George Bevir
Tuesday, April 23, 2024 - 10:40
Print This Story
With live sports pro...
23/04/2024
Save the Date: SVG Sports Content Management Forum Returns to NYC on July 24 By SVG Staff
Tuesday, April 23, 2024 - 4:05 pm
Print This Story | Subscribe
...
23/04/2024
Back to All News
Who's In for Something Really Fun ? The Curtain Rises on ...
23/04/2024
Back to All News
Celebrating World Book Day: How Netflix Adaptations Are Driving Bestseller Lists
Entertainment
23 April 2024
Global
Link copied to clipboa...
23/04/2024
Back to All News
Top 10 Week of Apr. 15: Rebel Moon - Part Two: The Scargiver&...
23/04/2024
Submissions for the 2024 HPA Engineering Excellence Awards are now being accepted. This renowned accolade recognizes and celebrates innovation and outstanding t...
23/04/2024
Haivision video wall, ISR, and DoDIN APL-certified video distribution solutions enable real-time awareness for decision making in defense environments
MONTREAL...
22/04/2024
The Nexstar Media Group has decided not to renew affiliation agreements for The CW broadcast network with stations owned by Scripps in seven markets....
22/04/2024
INDIANAPOLIS and Tysons, Va. In the wake of record viewing levels for the NCAA Women's Championship games, Tegna has announced that it has signed an agreeme...
22/04/2024
Digital Domain Unveils Masquerade3 : Revolutionary Markerless Facial Motion Cap...
22/04/2024
Pixotope brings the power of Unreal Engine to automated and news broadcast graph...
22/04/2024
Brand New Color Slice tool in DaVinci Resolve 19!
Kasia Jarco April 22, 2024
0 Comments
In this video i would like to show you the newest Color Slice ...
22/04/2024
Apple Motion's Best-Kept Secret
Simon Ubsdell April 22, 2024
0 Comments
A seriously useful technique that I have employed in many of my tutorials ...
22/04/2024
After Thursday night's sneak peek, the National Academy of Television Arts a...
22/04/2024
Nexstar Media Group said it does not intend to renew the affiliations of The CW stations owned by the E.W. Scripps Co. in seven markets....
22/04/2024
WRAL-TV Anchor/Reporter Brian Shrader made a big announcement on Friday, April 19, 2024. After 16 years as morning traffic anchor, Shrader will be moving to ...
22/04/2024
Prime Video has ordered a second season of Fallout. The show, based on a videogame and set 200 years after the apocalypse, comes from Jonathan Nolan and Lisa Jo...
22/04/2024
CBS News and Stations debuts a multi-part investigation called Anything For Love: Inside the Romance Scam Epidemic Sunday, April 21. Airing across CBS News and ...
22/04/2024
Fremantle said it hired Jeff Boone as VP of scripted development, a new post at the company....
New NVIDIA Neural Graphics SDKs Make Metaverse Content Creation Available to All 
