Sony Pixel Power calrec Sony

Meet the Omnivore: Ph.D. Student Lets Anyone Bring Simulated Bots to Life With NVIDIA Omniverse Extension

05/10/2022

Editor's note: This post is a part of our Meet the Omnivore series, which features individual creators and developers who use NVIDIA Omniverse to accelerate their 3D workflows and create virtual worlds.

Yizhou Zhao When not engrossed in his studies toward a Ph.D. in statistics, conducting data-driven research on AI and robotics, or enjoying his favorite hobby of sailing, Yizhou Zhao is winning contests for developers who use NVIDIA Omniverse - a platform for connecting and building custom 3D pipelines and metaverse applications.

The fifth-year doctoral candidate at the University of California, Los Angeles recently received first place in the inaugural #ExtendOmniverse contest, where developers were invited to create their own Omniverse extension for a chance to win an NVIDIA RTX GPU.

Omniverse extensions are core building blocks that let anyone create and extend functions of Omniverse apps using the popular Python programming language.

Zhao's winning entry, called IndoorKit, allows users to easily load and record robotics simulation tasks in indoor scenes. It sets up robotics manipulation tasks by automatically populating scenes with the indoor environment, the bot and other objects with just a few clicks.

Typically, it's hard to deploy a robotics task in simulation without a lot of skills in scene building, layout sampling and robot control, Zhao said. By bringing assets into Omniverse's powerful user interface using the Universal Scene Description framework, my extension achieves instant scene setup and accurate control of the robot.

Within IndoorKit, users can simply click add object, add house, load scene, record scene and other buttons to manipulate aspects of the environment and dive right into robotics simulation.

With Universal Scene Description (USD), an open-source, extensible file framework, Zhao seamlessly brought 3D models into his environments using Omniverse Connectors for Autodesk Maya and Blender software.

The IndoorKit extension also relies on assets from the NVIDIA Isaac Sim robotics simulation platform and Omniverse's built-in PhysX capabilities for accurate, articulated manipulation of the bots.

In addition, IndoorKit can randomize a scene's lighting, room materials and more. One scene Zhao built with the extension is highlighted in the feature video above.

Omniverse for Robotics The IndoorKit extension bridges Omniverse and robotics research in simulation.

A view of Zhao's IndoorKit extension I don't see how accurate robot control was performed prior to Omniverse, Zhao said. He provides four main reasons for why Omniverse was the ideal platform on which to build this extension:

First, Python's popularity means many developers can build extensions with it to unlock machine learning and deep learning research for a broader audience, he said.

Second, using NVIDIA RTX GPUs with Omniverse greatly accelerates robot control and training.

Third, Omniverse's ray-tracing technology enables real-time, photorealistic rendering of his scenes. This saves 90% of the time Zhao used to spend for experiment setup and simulation, he said.

And fourth, Omniverse's real-time advanced physics simulation engine, PhysX, supports an extensive range of features - including liquid, particle and soft-body simulation - which land on the frontier of robotics studies, according to Zhao.

The future of art, engineering and research is in the spirit of connecting everything: modeling, animation and simulation, he said. And Omniverse brings it all together.

Join In on the Creation Creators and developers across the world can download NVIDIA Omniverse for free, and enterprise teams can use the platform for their 3D projects.

Discover how to build an Omniverse extension in less than 10 minutes.

For a deeper dive into developing on Omniverse, watch the on-demand NVIDIA GTC session, How to Build Extensions and Apps for Virtual Worlds With NVIDIA Omniverse.

Find additional documentation and tutorials in the Omniverse Resource Center, which details how developers like Zhao can build custom USD-based applications and extensions for the platform.

To discover more free tools, training and a community for developers, join the NVIDIA Developer Program.

Follow NVIDIA Omniverse on Instagram, Medium, Twitter and YouTube for additional resources and inspiration. Check out the Omniverse forums, and join our Discord server and Twitch channel to chat with the community.
LINK: https://blogs.nvidia.com/blog/2022/10/05/yizhou-zhao-omniverse-develop...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

27/05/2026

Gravity Media Expands Into Creative Services With New Agency

Share Copy link Facebook X Linkedin Bluesky Email...

27/05/2026

Tegna Names Patrick Paolini as CEO

Share Copy link Facebook X Linkedin Bluesky Email...

27/05/2026

Telestream Taps Company Vet Benjamin Desbois as CEO

Share Copy link Facebook X Linkedin Bluesky Email...

27/05/2026

HDR10+ Technologies to Launch Eclipsa Video Certification Program

Share Copy link Facebook X Linkedin Bluesky Email...

27/05/2026

ATSC to Gather in Washington Next Week for Annual Meeting

Share Copy link Facebook X Linkedin Bluesky Email...

27/05/2026

Telestream Appoints Benjamin Desbois as Chief Executive O...

Co-founder Dan Castles to transition to Executive Chair; internal promotion reinforces continuity and long-term growth Telestream, a global leader in media wor...

27/05/2026

Big Blue Marble Announces First End-to-End 5G Broadcast S...

Big Blue Marble today announced that its Nakolos platform is the first end-to-end 5G Broadcast solution worldwide to implement the complete feature set introduc...

27/05/2026

Lightware Continues Its ESG Commitment Through Girls Day...

Lightware recently hosted the Girls' Day event in April at its headquarters in Budapest, welcoming students for an interactive introduction to engineering a...

26/05/2026

Matrox Video Marks 50 Year Milestone

Share Copy link Facebook X Linkedin Bluesky Email...

26/05/2026

Roku Expands Premium Subscriptions With Fox One

Share Copy link Facebook X Linkedin Bluesky Email...

26/05/2026

Brian Gross Joins ASG's Audio Team as Account Manager

Share Copy link Facebook X Linkedin Bluesky Email...

26/05/2026

MPA Urges FCC Not to Reclassify vMVPDs

Share Copy link Facebook X Linkedin Bluesky Email...

26/05/2026

Cobalt Digital to Showcase End-to-End IPMX Ecosystem at I...

Cobalt Digital to Showcase End-to-End IPMX Ecosystem at InfoComm 2026, Making ST 2110 Easy for Pro AV blueCORE standalone processors headline solutions designe...

26/05/2026

Matrox Video Celebrates 50 Years of Innovation and Looks...

Matrox Video today celebrates its 50th anniversary, marking five decades of innovation, engineering excellence, and customer-focused evolution from its headquar...

26/05/2026

Cuez Helps ITV Studios Run Three Live Shows as One includ...

ITV Studios, the production arm of the UKs largest commercial broadcaster, has deployed the Cuez live production platform to unify the management of three back-...

26/05/2026

CETA Software releases Morpheus, an AI tool for real-time post-production project oversight

CETA Software releases Morpheus, an AI tool for real-time post-production projec...

26/05/2026

Ikegami Accelerates Motorsport Broadcast Innovation with...

In a move set to redefine motorsports coverage across the Asia Pacific region, Ikegami Electronics announces that Two Wheels Motor Racing Sdn Bhd (TWMR), a lead...

26/05/2026

Three new kids' digital series set to hatch from ACTF and Screen Australia incubator

Three new kids' digital series set to hatch from ACTF and Screen Australia i...

26/05/2026

NVIDIA Vera CPU Is Packing a Heavy-Hitting Punch' Against Competition

The shift to agentic AI creates a new CPU requirement for the AI factory: fast cores, massive memory bandwidth and the ability to sustain high performance when ...

25/05/2026

SVG All-Stars: LJ Helbig, Senior Manager, Broadcast Engineering, FloSports

The former University of Wyoming wrestler is essential in helping the rapidly growing streamer delivers more than 50,000 live events per year The sports-produc...

25/05/2026

SBS announces exclusive TV broadcast schedule for FIFA World Cup 2026

SBS announces exclusive TV broadcast schedule for FIFA World Cup 2026 21 May, 2026 Media releases Luke Wilkshire, Tommy Oar, Andrew Redmayne, Sarah Walsh ...

25/05/2026

Enabling Persistent Arctic Surveillance

Image courtesy of GA-ASI...

25/05/2026

Conform.Tools Brings Order to Post-Production Delivery

Conform.Tools Brings Order to Post-Production Delivery Brie Clayton May 25, 2026 0 Comments New platform helps colorists, editors, and conform artists...

25/05/2026

Chyron Announces Powerful Scorebug Solutions

Chyron Announces Powerful Scorebug Solutions Brie Clayton May 25, 2026 0 Comments PRIME Scorebug Offers On Prem or Virtual Solution for Superior Score...

25/05/2026

Introducing OWC Stack AI - The World's First Thunderbolt 5 AI Accelerator and Storage Hub That Lets Users Own Their AI

Introducing OWC Stack AI - The World's First Thunderbolt 5 AI Accelerator an...

25/05/2026

Wooden Camera Releases New Accessories for Blackmagic URSA Cine Immersive

Wooden Camera Releases New Accessories for Blackmagic URSA Cine Immersive Brie Clayton May 25, 2026 0 Comments Wooden Camera today announced the relea...

25/05/2026

RT Concert Orchestra celebrates Marilyn Monroe's centenary at the National Concert Hall

The RT Concert Orchestra will celebrate the centenary of Hollywood icon Marilyn...

24/05/2026

The Bob Moog Foundation's Minimoog raffle

Win Bob Moog Tribute Edition Minimoog Model D #001 The Bob Moog Foundation are currently running a fundraising raffle for a brand-new Bob Moog Tribute Editi...

24/05/2026

Documentary Meets Fashion with Matching 12K Sensors

Documentary Meets Fashion with Matching 12K Sensors Brie Clayton May 24, 2026 0 Comments DP Troy Edige matches sensors across documentary and fashion ...

24/05/2026

Netflix reveals the trailer for the film 'The Marked Woman'

Back to All News Netflix reveals the trailer for the film The Marked Woman Entertainment 24 May 2026 GlobalSpain Link copied to clipboard Watch the traile...

23/05/2026

FOX Sports, IMS Productions Scale Up Indy 500 Production With New In-Car Cameras, AR Graphics, Cinematic Sets

In its second year as rightsholder, FOX Sports goes bigger across the board for ...

23/05/2026

Inside Apple TVs MLS iPhone Production with Royce Dickerson, Apple Live Sports, Executive Producer

Tonight's MLS matchup between the LA Galaxy and the Houston Dynamo FC will m...

23/05/2026

IK Multimedia reveal ReSing Voices Japanese Pack

AI-powered vocal tool gains first new language expansion IK Multimedia's AI-powered voice-creation software has seen a number of updates since it launch...

23/05/2026

Building a better future: Nielsen celebrates Global Volunteer Month and Earth Day 2026 with record participation

Nielsen Global Leadership Network graduates celebrate Earth Day 2026 Nielsen vo...

23/05/2026

Gray Media Names New Station General Managers

Share Copy link Facebook X Linkedin Bluesky Email...

23/05/2026

New CIMM Paper Urges Industry to Rethink How Media Is Evaluated

Share Copy link Facebook X Linkedin Bluesky Email...

23/05/2026

Lawo to Showcase Edge One, Efficient IP Workflows at InfoComm 2026

Share Copy link Facebook X Linkedin Bluesky Email...

23/05/2026

Spectrum Launches Ultra-Low Latency Internet

Share Copy link Facebook X Linkedin Bluesky Email...

22/05/2026

Germanys Magenta TV Selects DMC to Provide FIFA World Cup Technical Support for Studios in Munich, New York City

Germany's Magenta TV, which will have 44 exclusive FIFA World Cup match broa...

22/05/2026

DAZN Grabs IFAF Flag Football Global Rights

DAZN, the world's leading sports entertainment platform, has acquired global broadcast rights to the International Federation of American Football's ( I...

22/05/2026

ATHLOS 2026 Season Set for October Debut in London; Aurora Media Worldwide Named Host Broadcast Partner

ATHLOS, the all-women's professional track and field league, has announced i...

22/05/2026

NATAS to Stream Sports, News, and Documentary Emmy Awards Live on YouTube

The National Academy of Television Arts & Sciences (NATAS) today announced that the 47th Annual Sports Emmy Awards and the 47th Annual News & Documentary Emmy A...

22/05/2026

Wooden Camera Rolls Out New Blackmagic URSA Accessories

Wooden Camera today announced the release of new accessories for the Blackmagic URSA Cine Immersive. The new lineup includes a redesigned Top Plate and Side Rai...

22/05/2026

YES Network, OTT Advisors Extend Streaming Partnership for Sixth Season

YES Network and OTT Advisors have announced a sixth consecutive season of their streaming partnership, continuing their collaboration on the Gotham app. OTT Adv...

22/05/2026

NESN Monster Week' Returns With Full Red Sox Broadcast From Atop Green Monster

NESN, New England's premier sports network, will again turn its camera to Fe...

22/05/2026

Dale Pro Audio RF Over Fiber Webinar Set for May 28

Dale Pro Audio is hosting an RF over Fiber Livestream Webinar on May 28 from 1-2:30 pm EST. With major sporting events and large-scale productions putting incre...