Sony Pixel Power calrec Sony

New NVIDIA Neural Graphics SDKs Make Metaverse Content Creation Available to All

11/08/2022

New NVIDIA Neural Graphics SDKs Make Metaverse Content Creation Available to All

Brie Clayton August 11, 2022

0 Comments

A dozen tools and programs - including new releases NeuralVDB and Kaolin Wisp - enable easy, fast 3D content creation for millions of designers and creators.

The creation of 3D objects for building scenes for games, virtual worlds including the metaverse, product design or visual effects is traditionally a meticulous process, where skilled artists balance detail and photorealism against deadlines and budget pressures.

It takes a long time to make something that looks and acts as it would in the physical world. And the problem gets harder when multiple objects and characters need to interact in a virtual world. Simulating physics becomes just as important as simulating light. A robot in a virtual factory, for example, needs to have not only the same look, but also the same weight capacity and braking capability as its physical counterpart.

It's hard. But the opportunities are huge, affecting trillion-dollar industries as varied as transportation, healthcare, telecommunications and entertainment, in addition to product design. Ultimately, more content will be created in the virtual world than in the physical one.

To simplify and shorten this process, NVIDIA today released new research and a broad suite of tools that apply the power of neural graphics to the creation and animation of 3D objects and worlds.

These SDKs - including NeuralVDB, a ground-breaking update to industry standard OpenVDB,and Kaolin Wisp, a Pytorch library establishing a framework for neural fields research - ease the creative process for designers while making it easy for millions of users who aren't design professionals to create 3D content.

Neural graphics is a new field intertwining AI and graphics to create an accelerated graphics pipeline that learns from data. Integrating AI enhances results, helps automate design choices and provides new, yet to be imagined opportunities for artists and creators. Neural graphics will redefine how virtual worlds are created, simulated and experienced by users.

These SDKs and research contribute to each stage of the content creation pipeline, including:

3D Content Creation

Kaolin Wisp - an addition to Kaolin, a PyTorch library enabling faster 3D deep learning research by reducing the time needed to test and implement new techniques from weeks to days. Kaolin Wisp is a research-oriented library for neural fields, establishing a common suite of tools and a framework to accelerate new research in neural fields.

Instant Neural Graphics Primitives - a new approach to capturing the shape of real-world objects, and the inspiration behind NVIDIA Instant NeRF, an inverse rendering model that turns a collection of still images into a digital 3D scene. This technique and associated GitHub code accelerate the process by up to 1,000x.

3D MoMa - a new inverse rendering pipeline that allows users to quickly import a 2D object into a graphics engine to create a 3D object that can be modified with realistic materials, lighting and physics.

GauGAN360 - the next evolution of NVIDIA GauGAN, an AI model that turns rough doodles into photorealistic masterpieces. GauGAN360 generates 8K, 360-degree panoramas that can be ported into Omniverse scenes.

Omniverse Avatar Cloud Engine (ACE) - a new collection of cloud APIs, microservices and tools to create, customize and deploy digital human applications. ACE is built on NVIDIA's Unified Compute Framework, allowing developers to seamlessly integrate core NVIDIA AI technologies into their avatar applications.

Physics and Animation

NeuralVDB - a groundbreaking improvement on OpenVDB, the current industry standard for volumetric data storage. Using machine learning, NeuralVDB introduces compact neural representations, dramatically reducing memory footprint to allow for higher-resolution 3D data.

Omniverse Audio2Face - an AI technology that generates expressive facial animation from a single audio source. It's useful for interactive real-time applications and as a traditional facial animation authoring tool.

ASE: Animation Skills Embedding - an approach enabling physically simulated characters to act in a more responsive and life-like manner in unfamiliar situations. It uses deep learning to teach characters how to respond to new tasks and actions.

TAO Toolkit - a framework to enable users to create an accurate, high-performance pose estimation model, which can evaluate what a person might be doing in a scene using computer vision much more quickly than current methods.

Experience

Image Features Eye Tracking - a research model linking the quality of pixel rendering to a user's reaction time. By predicting the best combination of rendering quality, display properties and viewing conditions for the least latency, It will allow for better performance in fast-paced, interactive computer graphics applications such as competitive gaming.

Holographic Glasses for Virtual Reality - a collaboration with Stanford University on a new VR glasses design that delivers full-color 3D holographic images in a groundbreaking 2.5-mm-thick optical stack.

Join NVIDIA at SIGGRAPH to see more of the latest research and technology breakthroughs in graphics, AI and virtual worlds. Check out the latest innovations from NVIDIA Research, and access the full suite of NVIDIA's SDKs, tools and libraries.

###

Enjoying the news? Sign up for the Creative COW Newsletter! Sign up for the Creative COW newsletter and get weekly updates on industry news, forum highlights, jobs, inspirational tutorials, tips, burning questions, and more! Receive bulletins from the largest, longest-running community dedicated to supporting professionals working in film, video, and audio.

Enter your email address, a first and last name, and let u
LINK: https://creativecow.net/new-nvidia-neural-graphics-sdks-make-metaverse...
See more stories from creativecow

North America Stories

21/11/2026

Give Me the Ball! Serves a Powerful Portrait of Billie Jean King

Billie Jean King and Ilana Kloss attend the premiere of Give Me the Ball! by Liz Garbus and Elizabeth Wolff, an official selection of the 2026 Sundance Film Fes...

21/11/2026

Can a Democratic Congress Revive Public Media Funding?

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

21/11/2026

ATSC's Jerry Whitaker, Zandra Clarke Receive SMPTE Honors

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

21/11/2026

Brightline Lighting Introduces the MOD2 Increasing the Re...

A larger studio puts more distance between the lights and the people who need to look good under them. Brightline Lighting, a manufacturer of energy-efficient l...

21/11/2026

Scripps Research awarded $7M to catalyze pain and addiction initiative

LA JOLLA, CA-Despite its enormous impact on individuals, families and communities, addiction remains an area of significant unmet medical need. A $7 million gi...

21/11/2026

27 FANGORIA Chainsaw Awards Nominees Created with Blackmagic Design

27 FANGORIA Chainsaw Awards Nominees Created with Blackmagic Design Brie Clayton November 20, 2026 0 Comments Blackmagic Design hardware and software ...

21/11/2026

Qube Cinema Named Technical Partner for 57th International Film Festival of India

Qube Cinema Named Technical Partner for 57th International Film Festival of Indi...

20/11/2026

ESPN's Jimmy Pitaro on Super Bowl LXI: A Yearlong Story That Features a Game'

The sports broadcaster's chairman sees the upcoming game as an opportunity t...

20/11/2026

SVG GameDay, Ep. 40: New York Mets Brendan McKeon - Firing Up Fans in Flushing

In-venue and creative video staffers at the professional and collegiate level have one major thing in common: the intensity and attention to detail ramps up dur...

20/11/2026

Back at Belmont Park, Part 1: Historic Venue's Renovation Puts a Premium on the Fan Experience

A variety of LED displays, integrated broadcast infrastructure covers every angl...

20/11/2026

RAF Partners with Migu Video to Bring RAF15 Main Event to China

Real American Freestyle (RAF) has announced a distribution partnership with Migu Video, a Chinese digital sports platform, to carry the RAF15 main event between...

20/11/2026

Apple TV Becomes U.S. Home of F1 Academy Beginning in 2027

Apple and F1 Academy have announced that the all-female racing series will stream on Apple TV in the U.S. beginning in 2027. Fans will be able to watch every qu...

20/11/2026

mnchen.tv Relies on Riedel Technology for New Production Center

Regional broadcaster m nchen.tv has modernized its production infrastructure at a new location in northern Munich. Riedel MediorNet provides decentralized signa...

20/11/2026

Eutelsat Announces Three Executive Committee Appointments

Eutelsat has announced three appointments to its Executive Committee, effective November 2026, under CEO Jean-Fran ois Fallacher. Jean-Hubert Lenotte is appoin...

20/11/2026

Seven Melbourne Selects RTS and Magna Systems for Comms Upgrade at New Facility

After more than two decades at Harbour Esplanade in Docklands, the Seven Network has relocated its Melbourne headquarters to a new, custom-built ST 2110 facilit...

20/11/2026

Brazil's TV 3.0 Rollout Shows VVC Moving from Standards Work to Commercial Deployment

Brazil is among the first markets deploying Versatile Video Coding (VVC) as part...

20/11/2026

NBC Sports and The Soccer Tournament Agree to Two-Year Extension for TST 2027 and 2028

The Soccer Tournament (TST), the $1 million winner-take-all 7v7 world championsh...

20/11/2026

Back at Belmont Park, Part 2: NYRA Reaps Benefits of Reimagined Track With Expanded Broadcast Capabilities

Enhancements include a larger compound, an elevated camera count, and a whole lo...

20/11/2026

With Women's Sports Programming Skyrocketing, Content and Production Strategy Are Evolving

Leaders from ESPN, iHeartMedia, and Just Women's Sports explore creating new...

20/11/2026

TVP Claims Top Spot in Poland's Content Distributor Rankings

UEFA Nations League football and autumn premieres propel TVP to number one as YouTube grows its TV screen share Warsaw, Poland, November 19, 2026 - Nielsen, a...

20/11/2026

The Gauge: Poland | October 2026

October's autumn weather clearly encouraged Poles to spend more time in front of their screens, resulting in both longer viewing times and a higher overall ...

20/11/2026

FIFA Finds Few U.S. Networks Interested in 2030 World Cup Broadcast Rights

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives what is slowing them down

DigitalGlue releases creative.space Pulse, a free Mac app that shows creatives w...

20/11/2026

How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 Coverage

How NBCUniversal Telemundo Used Virtual Production for its FIFA World Cup 2026 C...

20/11/2026

What Film School Pays and What it Costs: The Federal Numbers

What Film School Pays and What it Costs: The Federal Numbers Mark Santos November 20, 2026 0 Comments Every editor has had the argument about film sch...

20/11/2026

3D Sound Specialist Turns to Nugen Halo Upmix

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

World's First Hybrid Film Production Platform Debuts

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

NBC Adds New Stats Feature for Premier League

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

Hearst TV Names Shawnda Adams to Lead KOCO-TV Oklahoma City

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

FCC Modernizes Drone Communications, Detection Rules

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

OBSBOT Unveils 2 New PTZR Cameras

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

New DigitalGlue Mac App Identifies Media Production Hurdles

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

20/11/2026

Beam Dynamics Introduces MCP for Faster, Smarter Technolo...

Beam Dynamics has introduced new Model Context Protocol (MCP) support, expanding how customers can work with the live operational data held in Beam. The new cap...

20/11/2026

Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30

Re:Vision Effects Cyber Week Sale Nov 24 to Nov 30 Pierre Jasmin November 19, 2026 0 Comments Long time friends of the COW are up with a big sale! Us...

20/11/2026

Avid is offering up to 33% off annual subscriptions!

Avid is offering up to 33% off annual subscriptions! Brie Clayton November 19, 2026 0 Comments Hero image courtesy Deposit Photos Pro Tools Pro To...

19/11/2026

Live From the UFL Draft: League's First Live Draft Broadcast Is Set To Innovate, Bring Viewers Close to the Action

With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...

19/11/2026

SVG Students To Watch: Niamh Campbell, Seton Hall University

The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone The future of live sports produ...

19/11/2026

RED Connect Adds Native Colorfront Color Management for Live RED Camera Feeds

RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...

19/11/2026

SMPTE Publishes Engineering Report on Content Provenance and Authenticity

SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...

19/11/2026

CTech and Skyline Communications Partner on Integrated SATCOM Operations for Defense

CTech and Skyline Communications have announced a partnership to deliver integra...

19/11/2026

EITB Deploys SMPTE ST 2110 Infrastructure with Lawo HOME mc DSP Processing

Euskal Irrati Telebista (EITB), the Basque Country's public media group, has completed Phase 1 of a five-studio renewal with the commissioning of a Lawo IP ...

19/11/2026

Esports Foundation Expands Road to Esports Nations Cup 2027 with New Qualifiers, Larger Rosters and National Rankings

The Esports Foundation (EF) has announced an expanded Road to ENC 2027 for the E...

19/11/2026

AWSN Holds First Women's Sports Awards Show, VEON: Women Who Win, in New York City

All Women's Sports Network (AWSN) held its first awards show, VEON: Women W...

19/11/2026

Gracenote Extends DIRECTV Partnership for Sports Hubs

Gracenote, the content intelligence business unit of Nielsen, has extended its relationship with DIRECTV. Gracenote will continue to supply visual imagery and p...

19/11/2026

AES Technical Committee Expands Loudness Website with Dialogue Intelligibility Content

The Audio Engineering Society (AES) Technical Committee on Broadcast and Online ...

19/11/2026

NDI 6.4 Adds Recording and Playback APIs, HEVC 4:4:4 and Wi-Fi Receiver Buffer

NDI has released NDI 6.4, which adds Recording and Playback APIs, support for HEVC 4:4:4 and a configurable receiver buffer for Wi-Fi. The update also includes ...

19/11/2026

Lemonlight Announces Hero, an AI Production Operating System for Video

Lemonlight, the video production company behind more than 50,000 brand videos, has announced Hero, an AI production operating system, along with a new AI agent ...

19/11/2026

FanConnect Brings JPEG XS Beyond the Control Room, Cuts In-Venue IPTV Latency 89% for University of Maryland Athletics

In a first-of-its-kind deployment at XFINITY Center, the digital signage/display...

19/11/2026

NBCU Intros Peacock Performance View for Premier League Coverage

For the first time on a US streaming service, real-time player identification, contextual stats, and visual insights appear right in the live stream, available ...

19/11/2026

Dome Productions Director of Engineering Mike Johnson To Retire at Years End

His career runs from the 2-in. videotape era to Canada's first HD and UHD live-production facilities...