New NVIDIA Neural Graphics SDKs Make Metaverse Content Creation Available to All

11/08/2022

New NVIDIA Neural Graphics SDKs Make Metaverse Content Creation Available to All

Brie Clayton August 11, 2022

0 Comments

A dozen tools and programs - including new releases NeuralVDB and Kaolin Wisp - enable easy, fast 3D content creation for millions of designers and creators.

The creation of 3D objects for building scenes for games, virtual worlds including the metaverse, product design or visual effects is traditionally a meticulous process, where skilled artists balance detail and photorealism against deadlines and budget pressures.

It takes a long time to make something that looks and acts as it would in the physical world. And the problem gets harder when multiple objects and characters need to interact in a virtual world. Simulating physics becomes just as important as simulating light. A robot in a virtual factory, for example, needs to have not only the same look, but also the same weight capacity and braking capability as its physical counterpart.

It's hard. But the opportunities are huge, affecting trillion-dollar industries as varied as transportation, healthcare, telecommunications and entertainment, in addition to product design. Ultimately, more content will be created in the virtual world than in the physical one.

To simplify and shorten this process, NVIDIA today released new research and a broad suite of tools that apply the power of neural graphics to the creation and animation of 3D objects and worlds.

These SDKs - including NeuralVDB, a ground-breaking update to industry standard OpenVDB,and Kaolin Wisp, a Pytorch library establishing a framework for neural fields research - ease the creative process for designers while making it easy for millions of users who aren't design professionals to create 3D content.

Neural graphics is a new field intertwining AI and graphics to create an accelerated graphics pipeline that learns from data. Integrating AI enhances results, helps automate design choices and provides new, yet to be imagined opportunities for artists and creators. Neural graphics will redefine how virtual worlds are created, simulated and experienced by users.

These SDKs and research contribute to each stage of the content creation pipeline, including:

3D Content Creation

Kaolin Wisp - an addition to Kaolin, a PyTorch library enabling faster 3D deep learning research by reducing the time needed to test and implement new techniques from weeks to days. Kaolin Wisp is a research-oriented library for neural fields, establishing a common suite of tools and a framework to accelerate new research in neural fields.

Instant Neural Graphics Primitives - a new approach to capturing the shape of real-world objects, and the inspiration behind NVIDIA Instant NeRF, an inverse rendering model that turns a collection of still images into a digital 3D scene. This technique and associated GitHub code accelerate the process by up to 1,000x.

3D MoMa - a new inverse rendering pipeline that allows users to quickly import a 2D object into a graphics engine to create a 3D object that can be modified with realistic materials, lighting and physics.

GauGAN360 - the next evolution of NVIDIA GauGAN, an AI model that turns rough doodles into photorealistic masterpieces. GauGAN360 generates 8K, 360-degree panoramas that can be ported into Omniverse scenes.

Omniverse Avatar Cloud Engine (ACE) - a new collection of cloud APIs, microservices and tools to create, customize and deploy digital human applications. ACE is built on NVIDIA's Unified Compute Framework, allowing developers to seamlessly integrate core NVIDIA AI technologies into their avatar applications.

Physics and Animation

NeuralVDB - a groundbreaking improvement on OpenVDB, the current industry standard for volumetric data storage. Using machine learning, NeuralVDB introduces compact neural representations, dramatically reducing memory footprint to allow for higher-resolution 3D data.

Omniverse Audio2Face - an AI technology that generates expressive facial animation from a single audio source. It's useful for interactive real-time applications and as a traditional facial animation authoring tool.

ASE: Animation Skills Embedding - an approach enabling physically simulated characters to act in a more responsive and life-like manner in unfamiliar situations. It uses deep learning to teach characters how to respond to new tasks and actions.

TAO Toolkit - a framework to enable users to create an accurate, high-performance pose estimation model, which can evaluate what a person might be doing in a scene using computer vision much more quickly than current methods.

Experience

Image Features Eye Tracking - a research model linking the quality of pixel rendering to a user's reaction time. By predicting the best combination of rendering quality, display properties and viewing conditions for the least latency, It will allow for better performance in fast-paced, interactive computer graphics applications such as competitive gaming.

Holographic Glasses for Virtual Reality - a collaboration with Stanford University on a new VR glasses design that delivers full-color 3D holographic images in a groundbreaking 2.5-mm-thick optical stack.

Join NVIDIA at SIGGRAPH to see more of the latest research and technology breakthroughs in graphics, AI and virtual worlds. Check out the latest innovations from NVIDIA Research, and access the full suite of NVIDIA's SDKs, tools and libraries.

###

Enjoying the news? Sign up for the Creative COW Newsletter! Sign up for the Creative COW newsletter and get weekly updates on industry news, forum highlights, jobs, inspirational tutorials, tips, burning questions, and more! Receive bulletins from the largest, longest-running community dedicated to supporting professionals working in film, video, and audio.

Enter your email address, a first and last name, and let u

LINK:	https://creativecow.net/new-nvidia-neural-graphics-sdks-make-metaverse...
	See more stories from creativecow

North America Stories

17/07/2026

Foundry Unlocks Professional-Grade AI for VFX with Gripta...

Creative software developer Foundry today announced Griptape Enterprise, a new tier of the Griptape AI workflow orchestration platform, extended to meet the str...

17/07/2026

Foundry Releases SmartRoto for Nuke

Creative software developer Foundry today announced the availability of SmartRoto, a new AI-powered plugin upgrade for Nuke, NukeX, Nuke Studio, and Nuke Indie ...

17/07/2026

The Final Release of Blackmagic Fairlight Live is Now Available!

The Final Release of Blackmagic Fairlight Live is Now Available! Brie Clayton July 16, 2026 0 Comments Fairlight Live is a new audio mixer designed fo...

17/07/2026

Leveraging All of Entertainment's IP

Leveraging All of Entertainment's IP Andy Marken July 16, 2026 0 Comments Nobody ever wins the games. Period. There are survivors. There\s no win...

16/07/2026

SVG Students To Watch: Kaden Sherman, Albany State University

This recent graduate and Georgia native has turned an early fascination with live production into a growing passion for camera work In the live-sports-video in...

16/07/2026

TNDV Marks First Year of Aspiration 35 Cinematic Production Truck

TNDV is marking the first anniversary of Aspiration 35, a mobile production truck built around ARRI Alexa 35 Live camera systems. Over its first year, the truck...

16/07/2026

ATSC Releases First Major Revision to A/85 Audio Loudness Recommended Practice Since 2013

ATSC has completed a major revision to its A/85 Recommended Practice: Techniques...

16/07/2026

FloSports Named Exclusive Global Media Partner for 2026 CrossFit Games

FloSports has announced an exclusive global media partnership with CrossFit for the 2026 CrossFit Games, presented by Air National Guard, beginning July 21 in S...

16/07/2026

Sennheiser Releases Spectera Firmware 1.4 and Command Button

Sennheiser has released firmware version 1.4 for its Spectera wireless system and announced the Spectera Command Button (Cat. No. 701014). The update adds comma...

16/07/2026

ESPN and Southwestern Athletic Conference Announce Multi-Year Media Rights Agreement Through 2030-31

ESPN and the Southwestern Athletic Conference (SWAC) have announced a multi-year...

16/07/2026

Audio-Technica Releases 20 Series Control Application for Elgato Stream Deck

Audio-Technica has announced the 20 Series Control Application, a Stream Deck plug-in for compatible Audio-Technica USB microphones. The application is compatib...

16/07/2026

SSL Live L550 Plus Consoles Power Audio Production for The Voice France Season 15

The fifteenth season of The Voice - La plus belle voix on TF1 used four Solid St...

16/07/2026

Gray Media and Atlanta Hawks Announce Georgia-Wide Broadcast Partnership for 2026-27 NBA Season

Gray Media and the Atlanta Hawks have announced a broadcast partnership that wil...

16/07/2026

SVG Sit-Down: Quarterback Showrunner Joe Zucco on Cinematography, Building Trust, Carrying On the NFL Films Legacy

Season 3 of Netflix's docuseries, which dropped this week, follows Jayden Da...

16/07/2026

Texas Rangers Switch Direct-to-Consumer Streaming Partner to BZZR

The Texas Rangers and Rangers Sports Network presented by Progressive (RSN) have announced BZZR as the new direct-to-consumer distributor for Rangers game broad...

16/07/2026

FIFA World Cup 2026: BBC Sport on Moving Across the Pond to Bring the Atmosphere of the Final Matches to Fans

With England's FIFA World Cup 2026 team getting ready to fly home after losi...

16/07/2026

With 36 Unilateral Cameras, NBC Sports Shapes 154th Open Championship Coverage for U.S. Viewers

In a return to Royal Birkdale, the team enjoys partnering with ETP and Gravity M...

16/07/2026

Altitude Sports & Entertainment's Tim De Lay on New SkyCam Digital Feed, Upgraded Studio Space

Along with a new studio at Ball Arena, the Colorado-based RSN is working with XR...

16/07/2026

FIFA World Cup 2026: Inside ORF's Austria-Based Production to Bring All the Emotions of the Tournament to Fans

Austria was back at the World Cup for the first time in 28 years, and the team d...

16/07/2026

Inside Gravity Media's Effort To Power the 154th Open Championship Production

With 42 RF cameras and high-power radio mics deployed, the spectrum environment ...

16/07/2026

The Gauge: Poland | June 2026

June brought stabilization to the television market. Poles spent an average of 3 hours and 36 minutes a day in front of their TV screens exactly the same as i...

16/07/2026

New studio monitoring leads Glensound's 60th year line-up...

Glensound returns to IBC with a major new addition to its intelligent loudspeaker range, the Greater Divine Supernal studio monitor, alongside recent developmen...

16/07/2026

Complete spectrum of innovation from British exhibitors a...

33 leading exhibitors are taking part in the GREAT Britain and Northern Ireland Pavilions and linked locations across IBC2026 (Amsterdam RAI, 11 14 September)...

16/07/2026

Hitomi Broadcast to showcase HDR colour verification and...

Hitomi Broadcast will introduce Spectra, a new HDR colour verification solution measured in picture, not using VPID, at IBC2026 (Hall 10, Stand A40). Expanding ...