
New NVIDIA Neural Graphics SDKs Make Metaverse Content Creation Available to All
Brie Clayton August 11, 2022
0 Comments
A dozen tools and programs - including new releases NeuralVDB and Kaolin Wisp - enable easy, fast 3D content creation for millions of designers and creators.
The creation of 3D objects for building scenes for games, virtual worlds including the metaverse, product design or visual effects is traditionally a meticulous process, where skilled artists balance detail and photorealism against deadlines and budget pressures.
It takes a long time to make something that looks and acts as it would in the physical world. And the problem gets harder when multiple objects and characters need to interact in a virtual world. Simulating physics becomes just as important as simulating light. A robot in a virtual factory, for example, needs to have not only the same look, but also the same weight capacity and braking capability as its physical counterpart.
It's hard. But the opportunities are huge, affecting trillion-dollar industries as varied as transportation, healthcare, telecommunications and entertainment, in addition to product design. Ultimately, more content will be created in the virtual world than in the physical one.
To simplify and shorten this process, NVIDIA today released new research and a broad suite of tools that apply the power of neural graphics to the creation and animation of 3D objects and worlds.
These SDKs - including NeuralVDB, a ground-breaking update to industry standard OpenVDB,and Kaolin Wisp, a Pytorch library establishing a framework for neural fields research - ease the creative process for designers while making it easy for millions of users who aren't design professionals to create 3D content.
Neural graphics is a new field intertwining AI and graphics to create an accelerated graphics pipeline that learns from data. Integrating AI enhances results, helps automate design choices and provides new, yet to be imagined opportunities for artists and creators. Neural graphics will redefine how virtual worlds are created, simulated and experienced by users.
These SDKs and research contribute to each stage of the content creation pipeline, including:
3D Content Creation
Kaolin Wisp - an addition to Kaolin, a PyTorch library enabling faster 3D deep learning research by reducing the time needed to test and implement new techniques from weeks to days. Kaolin Wisp is a research-oriented library for neural fields, establishing a common suite of tools and a framework to accelerate new research in neural fields.
Instant Neural Graphics Primitives - a new approach to capturing the shape of real-world objects, and the inspiration behind NVIDIA Instant NeRF, an inverse rendering model that turns a collection of still images into a digital 3D scene. This technique and associated GitHub code accelerate the process by up to 1,000x.
3D MoMa - a new inverse rendering pipeline that allows users to quickly import a 2D object into a graphics engine to create a 3D object that can be modified with realistic materials, lighting and physics.
GauGAN360 - the next evolution of NVIDIA GauGAN, an AI model that turns rough doodles into photorealistic masterpieces. GauGAN360 generates 8K, 360-degree panoramas that can be ported into Omniverse scenes.
Omniverse Avatar Cloud Engine (ACE) - a new collection of cloud APIs, microservices and tools to create, customize and deploy digital human applications. ACE is built on NVIDIA's Unified Compute Framework, allowing developers to seamlessly integrate core NVIDIA AI technologies into their avatar applications.
Physics and Animation
NeuralVDB - a groundbreaking improvement on OpenVDB, the current industry standard for volumetric data storage. Using machine learning, NeuralVDB introduces compact neural representations, dramatically reducing memory footprint to allow for higher-resolution 3D data.
Omniverse Audio2Face - an AI technology that generates expressive facial animation from a single audio source. It's useful for interactive real-time applications and as a traditional facial animation authoring tool.
ASE: Animation Skills Embedding - an approach enabling physically simulated characters to act in a more responsive and life-like manner in unfamiliar situations. It uses deep learning to teach characters how to respond to new tasks and actions.
TAO Toolkit - a framework to enable users to create an accurate, high-performance pose estimation model, which can evaluate what a person might be doing in a scene using computer vision much more quickly than current methods.
Experience
Image Features Eye Tracking - a research model linking the quality of pixel rendering to a user's reaction time. By predicting the best combination of rendering quality, display properties and viewing conditions for the least latency, It will allow for better performance in fast-paced, interactive computer graphics applications such as competitive gaming.
Holographic Glasses for Virtual Reality - a collaboration with Stanford University on a new VR glasses design that delivers full-color 3D holographic images in a groundbreaking 2.5-mm-thick optical stack.
Join NVIDIA at SIGGRAPH to see more of the latest research and technology breakthroughs in graphics, AI and virtual worlds. Check out the latest innovations from NVIDIA Research, and access the full suite of NVIDIA's SDKs, tools and libraries.
###
Enjoying the news? Sign up for the Creative COW Newsletter! Sign up for the Creative COW newsletter and get weekly updates on industry news, forum highlights, jobs, inspirational tutorials, tips, burning questions, and more! Receive bulletins from the largest, longest-running community dedicated to supporting professionals working in film, video, and audio.
Enter your email address, a first and last name, and let u
North America Stories
30/04/2026
The Professional Women's Hockey League (PWHL) concluded its third regular season on Saturday, reporting growth across attendance, viewership, digital engage...
30/04/2026
NBC Sports will air national MLB coverage on Sundays beginning May 3, with MLB Sunday Leadoff on Peacock and NBCSN at 12:30 p.m. ET, followed by the debut of th...
30/04/2026
Clear-Com has appointed Brian Grahn as Market Outreach Manager of the Americas and Ben Turnwell as Business Development Manager for EMEA live.
Grahn joined Cle...
30/04/2026
ARRI has introduced the cforce MAX, a new lens motor for the Hi-5 lens control system. The cforce MAX is twice as fast as the cforce plus motor it replaces whil...
30/04/2026
Knuerr, Voxtronic, and IHSE will jointly present an integrated control room solu...
30/04/2026
The CW Network and ESPN have announced an agreement to make the ESPN App the exclusive streaming home for all CW Sports live events. CW Sports will continue to ...
30/04/2026
Ed Sheeran's The Loop' tour launched in Auckland in January 2026 before moving on to Australia, with South America and the United States to follow late...
30/04/2026
Audinate has announced Dante Preset Creator, a free online tool for configuring Dante network settings before hardware is available on site. Presets created in ...
30/04/2026
Yahoo Sports has announced the appointment of Jarrod Schwarz as General Manager of Yahoo Sports. Schwarz will oversee product, design, and technology; revenue a...
30/04/2026
Nielsen has released a new report, Get Ready with Media Intelligence: 2026 FIFA World Cup Edition, examining U.S. soccer viewership trends, fan engagement, and ...
30/04/2026
USA Lacrosse and SportsEngine have announced an expanded partnership, naming Spo...
30/04/2026
Telos Alliance will participate in the 2026 Media Production and Technology Show (MPTS), taking place May 13-14 at Olympia London. Rather than exhibiting from a...
30/04/2026
The global streamer buys the U.S. DTC platform solutions provider for a reported...
30/04/2026
Tigo Sports, Paraguay's leading sports broadcaster, has upgraded its video infrastructure with Ateme solutions for live encoding, multiplexing, and signal c...
30/04/2026
World Rugby and IMG have announced a long-term media rights partnership focused on growing rugby in the United States ahead of the Men's and Women's Rug...
30/04/2026
For the second year in a row, Overtime and the National Women's Soccer League (NWSL) are teaming up through a renewed content partnership to bring fans even...
30/04/2026
The 22-year ESPN vet's responsibilities will reportedly be taken over by SVP Mike Foss...
30/04/2026
In-venue and creative video staffers at the professional and collegiate level ha...
30/04/2026
Amazon and Duke University have announced a multiyear agreement for Prime Video to present exclusive coverage of three Duke Blue Devils men's basketball neu...
30/04/2026
Ratings Roundup is a rundown of recent rating news and is derived from press rel...
30/04/2026
MELBOURNE, Fla., April 29, 2026 - L3Harris Technologies (NYSE: LHX) today announ...
30/04/2026
MELBOURNE, Fla., April 30, 2026 - L3Harris Technologies (NYSE: LHX) reports first quarter 2026 results.
Highlights
Orders of $7.8 billion; book-to-bill of 1....
30/04/2026
STA VENERA, MALTA, APRIL 29, 2026 CPI Media, a voluntary organization within the Missionary Society of St Paul (MSSP) and a leading media house dedicated to p...
30/04/2026
New software platform delivers comprehensive timing measurement across production workflows...
30/04/2026
Once again, the UK Pavilion in Hall 5 of BroadcastAsia 2026 will feature the latest and best in technology specifically developed and tailored for modern media ...
30/04/2026
Avid powers faster workflows and next-generation immersive audio with latest Pro...
30/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/04/2026
Scalable broadcast-grade production over public internet, replacing traditional OB workflows...
30/04/2026
Live demonstrations highlight LCEVC ecosystem momentum, AI-powered video pipelines, and expansion across broadcast, streaming, and social media.
DTV (TV 3.0) ...
30/04/2026
Student Spotlight: Matthew Leon The dual major shares his path from community college to Berklee, and how his heritage influences his work.
April 29, 2026
B...
30/04/2026
Berklee Artists to Perform at Major Global Music Festivals As part of the Berklee Popular Music Institute, students will perform at Lollapalooza, Governors Ba...
30/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/04/2026
A flexible monitoring platform designed to simplify ST 2110 operations, consolidate vendor tools, and support modern live production environments. See it at NAB...
30/04/2026
Sundance-premiering Run Amok is an expressive, unconventional take on today's teen experience, replete with musical numbers. When cinematographer Shachar ...
30/04/2026
JACKSONVILLE, AL, APRIL 29, 2026 Jacksonville State University, known as Jax State and a proud NCAA Division I member of Conference USA, has transformed its a...
30/04/2026
Transforming viewer and content data into real-time intelligence to deliver relevant streaming experiences at scale
ThinkAnalytics, the global leader in AI-pow...
30/04/2026
Sports Production, Delivery is Big Biz at NAB
Andy Marken April 29, 2026
0 Comments
Hero image source: NAB
One of the neat things about trade shows i...
30/04/2026
NAB Show 2026 was a big one for WideOrbit. From a live broadcast on the show floor to a Best of Show award, our team had an incredible few days in Las Vegas. We...
30/04/2026
Telos Alliance To Highlight Audio Processing, Intercom, and Workflow Solutions ...
30/04/2026
Back to All News
The Map of Longing Arrives on Netflix Next July 17
Entertainment
30 April 2026
GlobalSpain
Link copied to clipboard
WE ARE ALL MADE OF SM...
30/04/2026
Back to All News
Saif Ali Khan Anchors a Story of Duty and Dilemma, Red Chillie...
30/04/2026
Back to All News
Netflix has released the trailer for Emi Mart nez: The Kid Who...
30/04/2026
Back to All News
A Bunch of Goofy Misfits Out to Save the World: Netflix Releas...
30/04/2026
Back to All News
Introducing Exciting New Ways to Find and Enjoy Your Next Favorite on Mobile
Product
30 April 2026
Global
Link copied to clipboard
Downlo...
30/04/2026
It's gonna be May - and the cloud's in full festival mode.
16 games ar...