Editor's note: This post is a part of our Meet the Omnivore series, which features individual creators and developers who use NVIDIA Omniverse to accelerate their 3D workflows and create virtual worlds.
Yizhou Zhao When not engrossed in his studies toward a Ph.D. in statistics, conducting data-driven research on AI and robotics, or enjoying his favorite hobby of sailing, Yizhou Zhao is winning contests for developers who use NVIDIA Omniverse - a platform for connecting and building custom 3D pipelines and metaverse applications.
The fifth-year doctoral candidate at the University of California, Los Angeles recently received first place in the inaugural #ExtendOmniverse contest, where developers were invited to create their own Omniverse extension for a chance to win an NVIDIA RTX GPU.
Omniverse extensions are core building blocks that let anyone create and extend functions of Omniverse apps using the popular Python programming language.
Zhao's winning entry, called IndoorKit, allows users to easily load and record robotics simulation tasks in indoor scenes. It sets up robotics manipulation tasks by automatically populating scenes with the indoor environment, the bot and other objects with just a few clicks.
Typically, it's hard to deploy a robotics task in simulation without a lot of skills in scene building, layout sampling and robot control, Zhao said. By bringing assets into Omniverse's powerful user interface using the Universal Scene Description framework, my extension achieves instant scene setup and accurate control of the robot.
Within IndoorKit, users can simply click add object, add house, load scene, record scene and other buttons to manipulate aspects of the environment and dive right into robotics simulation.
With Universal Scene Description (USD), an open-source, extensible file framework, Zhao seamlessly brought 3D models into his environments using Omniverse Connectors for Autodesk Maya and Blender software.
The IndoorKit extension also relies on assets from the NVIDIA Isaac Sim robotics simulation platform and Omniverse's built-in PhysX capabilities for accurate, articulated manipulation of the bots.
In addition, IndoorKit can randomize a scene's lighting, room materials and more. One scene Zhao built with the extension is highlighted in the feature video above.
Omniverse for Robotics The IndoorKit extension bridges Omniverse and robotics research in simulation.
A view of Zhao's IndoorKit extension I don't see how accurate robot control was performed prior to Omniverse, Zhao said. He provides four main reasons for why Omniverse was the ideal platform on which to build this extension:
First, Python's popularity means many developers can build extensions with it to unlock machine learning and deep learning research for a broader audience, he said.
Second, using NVIDIA RTX GPUs with Omniverse greatly accelerates robot control and training.
Third, Omniverse's ray-tracing technology enables real-time, photorealistic rendering of his scenes. This saves 90% of the time Zhao used to spend for experiment setup and simulation, he said.
And fourth, Omniverse's real-time advanced physics simulation engine, PhysX, supports an extensive range of features - including liquid, particle and soft-body simulation - which land on the frontier of robotics studies, according to Zhao.
The future of art, engineering and research is in the spirit of connecting everything: modeling, animation and simulation, he said. And Omniverse brings it all together.
Join In on the Creation Creators and developers across the world can download NVIDIA Omniverse for free, and enterprise teams can use the platform for their 3D projects.
Discover how to build an Omniverse extension in less than 10 minutes.
For a deeper dive into developing on Omniverse, watch the on-demand NVIDIA GTC session, How to Build Extensions and Apps for Virtual Worlds With NVIDIA Omniverse.
Find additional documentation and tutorials in the Omniverse Resource Center, which details how developers like Zhao can build custom USD-based applications and extensions for the platform.
To discover more free tools, training and a community for developers, join the NVIDIA Developer Program.
Follow NVIDIA Omniverse on Instagram, Medium, Twitter and YouTube for additional resources and inspiration. Check out the Omniverse forums, and join our Discord server and Twitch channel to chat with the community.
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
19/04/2024
Thank You for visiting us at NAB 2024!
Thank you for joining us at the ToolsOnAir booth during NAB Show 2024!
We were delighted to showcase our latest inno...
19/04/2024
PARK CITY, UTAH - JANUARY 18: (L-R) John Early and Theda Hammel attend the 2024 Sundance Film Festival Stress Positions premiere at Library Center Theatre on ...
19/04/2024
By Lucy Spicer
One of the most exciting things about the Sundance Film Festival...
19/04/2024
Pictured: Midnight Family
By Stephanie Ornelas
A great way to get to know a city as culturally unique and rich as Mexico City is to listen to the stories tol...
19/04/2024
St. Louis, MO - April 18, 2024 - Studio Network Solutions (SNS) announced today that MOD won three prestigious industry awards at NAB Show 2024 held this week i...
19/04/2024
Spotify's mission is to unlock the potential of human creativity by giving a million artists the opportunity to live off their art and billions of fans the ...
19/04/2024
It's a beautiful day to be a Swiftie. Today, Taylor Swift dropped her 11th s...
19/04/2024
MELBOURNE, Fla., April 19, 2024 - The Board of Directors of L3Harris Technologies (NYSE:LHX) declared a quarterly cash dividend of $1.16 per common share, payab...
19/04/2024
PARIS Intel has announced that its plans for the Olympic and Paralympic Games Paris 2024 will include using artificial intelligence technology powered by Intel ...
19/04/2024
LAS VEGAS Technologists working on all aspects of the 8K media production chain offered an optimistic update at the 2024 NAB Show on the state of 8K in video pr...
19/04/2024
OpenDrives New Software-Defined Platform Atlas Wins 2024 NAB Show Product of the...
19/04/2024
Grass Valley Showcases Next-Generation T3 Series 4K/HD Digital Recording and Pla...
19/04/2024
NiTRo's M-CUBE Studio Levels Up Esports Productions with AJA Gear
Brie Clayton April 19, 2024
0 Comments
Esports' rapid rise to popularity can...
19/04/2024
Blackmagic Design Announces DaVinci Resolve 19
Brie Clayton April 19, 2024
0 Comments
Major update adds new DaVinci Neural Engine AI tools, new color ...
19/04/2024
Sony Pictures Entertainment is reportedly in talks with Apollo Global Management to make a bid to acquire Paramount which itself is currently discussing a merge...
19/04/2024
Simon Wilkinson, head of VFX at 1185 films, talks about the technology behind the newly-released horror
By Matthew Corrigan
Published: April 19, 2024
Simo...
19/04/2024
The global electronics company is said to be considering joining forces with investment firm Apollo Management to bid for Paramount Global
By Jenny Priestley
...
19/04/2024
The report broke the economic footprint of EBU member sports broadcasting into three main areas
By Matthew Corrigan
Published: April 19, 2024
The report b...
19/04/2024
CBS Stations has launched CBS News California Investigates , with Julie Watts named regional CBS California correspondent. She will uncover and raise awarenes...
19/04/2024
MediaCo Holding, which owns radio stations WQHT (Hot 97) and WBLS in New York, said it acquired Estrella Media's Spanish-language video, audio and digital c...
19/04/2024
Netflix has ordered season five of fantasy drama The Witcher, which will be the final season. Production has recently begun on season four, and the two remainin...
19/04/2024
DirecTV Stream said it added eight more The CW affiliates to its lineup on Thursday....
19/04/2024
CBS has renewed Elsbeth for the 2024-2025 season. The drama, with Carrie Preston in the lead role, debuted February 29....
19/04/2024
With the Bears picking first, NBCUniversal Local's properties in Chicago plan extensive coverage of the NFL draft next week....
19/04/2024
PHILADELPHIA As government subsidies for broadband services come to an end, Comcast has launched NOW, a new product portfolio of lower-cost Internet, mobile and...
19/04/2024
DirecTV Stream has added more local CW stations for its streaming customers in Boston, Charlotte, Cincinnati, Cleveland, Hartford-New Haven Conn., Phoenix, San ...
19/04/2024
NEW YORK & LOS ANGELES MediaCo Holding Inc. has announced that it has acquired all of Estrella Media's network, content, digital, and commercial operations....
19/04/2024
SAN JOSE, Calif. Adobe has announced that the all-new Adobe Express mobile app is available to all users, bringing features powered by Adobe Firefly generative ...
19/04/2024
LOS GATOS, Calif. Netflix reported another blockbuster quarter by adding 9.33 million new subscribers in Q1, 2024 as global paid memberships hit 269.6 million, ...
19/04/2024
The Current State of the Industry and the Future Impact of AI
Hillary Lewis April 18, 2024
0 Comments
The Entertainment Industry: How did we get here ...
19/04/2024
After Effects Tutorial Text Blur Reveal
Andy Ford April 18, 2024
0 Comments
Here's a way to do a quick blur reveal for your text layer. Start by...
19/04/2024
Hollyland Mars M1 Enhanced Wireless Transmitter / Receiver
Colin Smith April 18, 2024
0 Comments
This tutorial shows the new wireless transmitter rece...
19/04/2024
Resolve Fusion: Writing Expressions with Lua
Simon Ubsdell April 18, 2024
0 Comments
The answer to the very frequently-asked question: what is the pro...
19/04/2024
B+C and Next TV have announced the winners of Best of Show Awards for the 2024 NAB Show. The awards were judged by a panel of industry experts at the convention...
19/04/2024
Cate Blanchett narrates the Netflix series Our Living World, which premieres April 17. The four-part series looks at the extraordinary creatures around the glob...
19/04/2024
Apple TV Plus has a spinoff of For All Mankind in the works. It is called Star City and details the cosmonauts, engineers and intelligence officers working behi...
19/04/2024
Jacquie Walker, longtime anchor at WIVB Buffalo, will step down from the anchor desk. She has spent over 40 years at WIVB and her last day as an anchor is May 2...
19/04/2024
Bob Hearts Abishola will premiere in broadcast syndication this fall on such station groups as Nexstar Media Group, Sinclair, Hearst Television, Tegna, E.W. Scr...
19/04/2024
Live With Kelly and Mark remains TV's top entertainment talk show as Kelly Ripa and her co-host and husband Mark Consuelo celebrate their one-year anniversa...
19/04/2024
Sean McLaughlin has been named VP of news for Graham Media Group. He had been senior VP of local news at E.W. Scripps. He will will be responsible for developi...
19/04/2024
Netflix has shared the first trailer from One Hundred Years of Solitude, a series based on the esteemed novel by Gabriel Garc a M rquez. The streamer is on boar...
19/04/2024
NAB 2024 in Review: West Hall - SportsTech Buzz From AWS, Appear, Ateme, The Swi...
19/04/2024
NAB 2024 Draws 61,000+ Attendees With More Than Half Attending the Show for the ...
19/04/2024
Rohde & Schwarz and VIAVI support European OTIC in Berlin for O-RAN conformance ...
19/04/2024
Wuppertal April 19, 2024
Riedel launches Bolero Connect for seamless integration with PunQtum A pioneer in the field of digital intercom, Riedel has recently ...
Editor's note: This post is a part of our Meet the Omnivore series, which features individual creators and developers who use NVIDIA Omniverse to accelerate their 3D workflows and create virtual worlds.
