Sony Pixel Power calrec Sony

Meet the Omnivore: Developer Builds Bots With NVIDIA Omniverse and Isaac Sim

01/08/2022

Editor's note: This post is a part of our Meet the Omnivore series, which features individual creators and developers who use NVIDIA Omniverse to accelerate their 3D workflows and create virtual worlds.

Antonio Serrano-Mu oz While still in grad school, Antonio Serrano-Mu oz has helped author papers spanning planetary gravities, AI-powered diagnosis of rheumatoid arthritis and robots that precisely track millimetric-sized walkers, like ants.

Now, the Ph.D. student in applied robotics at Mondragon University in northern Spain, is using robotics and AI in remanufacturing to tackle issues of climate change and pollution.

In short, Serrano-Mu oz is busy discovering unique ways to apply technology to complex, real-world issues - and, in his free time, he makes extensions for NVIDIA Omniverse, a platform for real-time 3D design collaboration and world simulation.

Omniverse Extensions are core building blocks that enable anyone to create and extend the functionality of Omniverse Apps to meet the specific needs of their workflows with just a few lines of Python code.

Serrano-Mu oz has created six open-source Omniverse Extensions that can be accessed on GitHub, one of which enhances the capabilities of NVIDIA Isaac Sim, an Omniverse-powered application framework for creating photorealistic, physically accurate virtual environments in which to develop, train and simulate AI robots.

Since the beginning of my Ph.D. studies, I decided to work with Isaac Sim to simulate robots, Serrano-Mu oz said. It offers a powerful, real-time simulation platform with an ultra-realistic physics engine and graphics - as well as a clean, simple application programming interface that makes it easy to interact with the whole system.

Omniverse for Robotics Simulation Serrano-Mu oz has pursued robotics for as long as he can remember. Growing up in Cuba, he always fiddled with electronics, and he fell deeper in love with technology when he began coding in college.

Robots can assist humans with strenuous, high-precision, repetitive and sometimes hazardous tasks, Serrano-Mu oz said. They have the potential to improve our lives, and I hope my work advances robotics in a way that allows us to build a better present and achieve a better future.

He believes Omniverse is crucial to his doctoral studies in applied robotics.

Performing real-time, graphically realistic simulations of robotics environments wasn't possible before Omniverse, he said. The platform opens the door to a new era of revolutionary changes in robotics, simulation and real-time collaboration.

Omniverse links specialists of all kinds - engineers, designers, content creators - for the development of simulation systems, he added. Key for this is Universal Scene Description (USD), an open source 3D scene description and extensible file framework serving as the common language for virtual worlds.

USD plays an important role in the process of authoring, composing and reading a hierarchically organized scene to create and manipulate its rendering elements and objects, Serrano-Mu oz said.

Extending Omniverse for Isaac Sim Using NVIDIA Omniverse, the developer has created robot simulations for industrial use cases and a digital twin of Mondragon University's laboratory for robotics prototyping.

A digital twin of a bench in Mondragon University's robotics lab, made with NVIDIA Omniverse. And while working on such projects, Serrano-Mu oz wanted to integrate with Isaac Sim a tool he was already familiar with: Robot Operating System, or ROS, a set of software libraries for building robot applications. So, he created an Omniverse Extension to enable just that.

The extension lets users manipulate simulated robotic systems in the Omniverse-powered Isaac Sim application via ROS control interfaces. ROS MoveIt, a motion planning framework for robots, can be used in conjunction with Isaac Sim's dynamic control extension and PhysX capabilities, which bring physical accuracy to high-fidelity robotics simulations.

It's easy to develop code without leaving the Omniverse Kit, Serrano-Mu oz said. Omniverse Extensions come with a system-wide integration API, installation, activation and reload mechanisms to augment the functionality of Omniverse Apps.

This particular extension for ROS, he added, boosts agile prototyping for robotics applications - which is further accelerated by his NVIDIA RTX 3080 Laptop GPU - making his workflow faster than ever.

Hear more from Serrano-Mu oz about using digital twins for industrial robotics by watching his NVIDIA GTC session on demand. And watch his Community Spotlight on the Omniverse Twitch channel happening Aug. 3 at 11 a.m. PT.

Join in on the Creation Creators and developers across the world can download NVIDIA Omniverse for free, and enterprise teams can use the platform for their 3D projects.

Developers like Serrano-Mu oz will join NVIDIA at SIGGRAPH, a global computer graphics conference running Aug. 8-11. Watch the Omniverse community livestream at SIGGRAPH on Tuesday, Aug. 9, at noon PT to learn how Omniverse and other design and visualization technologies are driving breakthroughs in graphics and GPU-accelerated software.

Plus, anyone can submit to the inaugural #ExtendOmniverse developer contest through Friday, Aug. 19. Create an Omniverse Extension using Omniverse Code for a chance to win an NVIDIA RTX GPU.

Check out artwork from other Omnivores and submit projects in the gallery. Connect your workflows to Omniverse with software from Adobe, Autodesk, Epic Games, Maxon, Reallusion and more.

Follow NVIDIA Omniverse on Instagram, Twitter, YouTube and Medium for additional resources and inspiration. Check out the Omniverse forums, and join our Discord server and Twitch channel to chat with the community.
LINK: https://blogs.nvidia.com/blog/2022/08/01/omniverse-developer-antonio-s...
See more stories from nvidia

Most recent headlines

04/08/2024

Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation

Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

28/04/2024

Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2

Mediahaus delivers the first SRT live-streaming sports production over 5G with U...

23/04/2024

IBC Now Accepting Nominations for 2024 Innovation Awards

LONDON IBC is now accepting nominations for its IBC2024 Innovation Awards, which honor achievements in technological innovation and social impact media & entert...

23/04/2024

NAB Backs Broadcast VOICES Act

WASHINGTON, D.C. In response to the introduction of the Broadcast VOICES Act that seeks to encourage more diversity in the ownership of TV and radio stations, t...

23/04/2024

Hemisphere Media Group Launches WAPA+ on the Roku Channel

MIAMI, Fla. As part of a push to expand its FAST channel and streaming operations, Hemisphere Media Group has launched its free ad supported television (FAST) c...

23/04/2024

DirecTV Launches New Streaming Channels from Cineverse and Scripps Networks

LOS ANGELES DirecTV is adding seven new channels to its rapidly expanding streaming lineup through new licensing agreements with Cineverse Corp. and Scripps Net...

23/04/2024

Creative UK launches manifesto calling for more investment in creative R&D; revised approach to trade and exports

Entitled Our Creative Future, the manifesto calls for radical new action' t...

23/04/2024

Audiotonix secures landmark' investment

The company has secured investment from private equity firm PAI Partners, which also holds a stake in outside broadcasting company EMG By Jenny Priestley Pub...

23/04/2024

James Cameron backs Marlow Film Studios proposal

Cameron also said he recognised Marlow as a potential UK and European base for his new company, LIGHTSTORM 3D By Matthew Corrigan Published: April 23, 2024 ...

23/04/2024

IBC launches 2024 Innovation Awards with new categories

The five categories cover Content Creation, Content Distribution, Content Everywhere, Social Impact and Environment & Sustainability By Matthew Corrigan Publ...

23/04/2024

Pascal Fratellia leaves Olympics role at EBU

He played a central role in securing key broadcast rights, including the FIFA World Cup 2018 and 2022 By Matthew Corrigan Published: April 23, 2024 He pla...

23/04/2024

IBC Launches 2024 Innovation Awards with Nominations Now...

IBC is preparing to honour the highest achievements in technological innovation and social impact with the launch of its prestigious IBC2024 Innovation Awards, ...

23/04/2024

Bolin Technology Integrates NDI Across Product Portfolio

BREA, Calif. Bolin Technology is integrating Network Device Interface (NDI) across its product line, bringing support for the latest NDI technologies to its PTZ...

23/04/2024

Aaron LaBerge Joins PENN Entertainment at CTO

WYOMISSING, Pa. PENN Entertainment has announced that longtime Disney and ESPN executive Aaron LaBerge has been named chief technology officer effective July 1,...

23/04/2024

Nexstar Disputes FCC $1.2M Fine, Order to Sell WPIX

In response to an FCC ruling in March proposing a $1.2 million fine against Nexstar and a ruling that Mission Broadcasting sell WPIX, Nexstar has filled a respo...

23/04/2024

Sony's Ci Media Cloud Keeps NHRA Moving

Sony has announced new details about how the National Hot Rod Association (NHRA) is using Sony's Ci Media Cloud platform to streamline its workflows and spe...

23/04/2024

NiTRos M-CUBE Studio Levels Up Esports Productions with A...

Esports' rapid rise to popularity can be attributed to many factors, from technological advancements that have enhanced the quality of modern gaming experie...

23/04/2024

OpenDrives New Software-Defined Platform Atlas Wins 2024...

OpenDrives, Inc., the global provider of software-defined media workflow solutions and data management capabilities, has been selected as a winner in the 2024 N...

23/04/2024

Vipe by BCNEXXT Takes Home 2024 NAB Show Product of the Y...

BCNEXXT is pleased to announce that Vpe has won the 2024 NAB Show Product of the Year Award in the Asset Management, Automation and Playout category. The offici...

23/04/2024

Gravity Media Australia to Deliver Broadcast Technology a...

Gravity Media, a world leading global provider of complex live creative production and media services, today outlined the broadcast technology and television pr...

23/04/2024

Industry veteran Peter Brennan to lead Scality operations...

Scality, a global leader in cyber-resilient storage for the AI era, today announced the appointment of Peter Brennan as Chief Executive Officer (CEO) of Scality...

23/04/2024

Blackmagic Design Announces New ATEM Constellation 4K Swi...

Blackmagic Design today announced ATEM 1 M/E Constellation 4K and ATEM 2 M/E Constellation 4K switchers, two new Ultra HD models of the ATEM Constellation famil...

23/04/2024

Blackmagic Design Announces New Blackmagic Videohub 120x1...

Blackmagic Design today announced Blackmagic Videohub 120x120 12G, the newest model in the Videohub 12G router family. The massive Blackmagic Videohub 120x120 1...

23/04/2024

Blackmagic Design Announces New Lower Price for Blackmagi...

Blackmagic Design today announced new lower prices for Blackmagic Video Assist 3G and 12G models. Customers can save US$200 on all models. These lower prices ma...

23/04/2024

Adder Wins Best of Show TV Tech Award at NAB 2024

Adder Technology continues to shine brightly, with its groundbreaking product, the ADDERLink INFINITY 3000 (ALIF3000), once again taking center stage. Hot on t...

23/04/2024

Pliant Technologies Wins 2024 NAB Show Product of The Yea...

Pliant Technologies' CRP-C12 Compact Radio Pack is an Audio Production, Processing and Networking category winner in the 2024 NAB Show Product of the Year A...

23/04/2024

SipRadius transforms remote production at CABSAT with liv...

SipRadius, the specialists in live media transport and transcoding, will showcase their world-leading implementation of AV1 and JPEG-XS over transport streams a...

23/04/2024

Rafael Krux Makes Room For A Prism Sound Dream ADA-128 Co...

Composer Rafael Krux has added a Prism Sound Dream ADA-128 modular conversion system to his production studio where he creates music for commercials, trailers, ...

23/04/2024

PMC Loudspeakers Provide Reference Sound For Steven Wilso...

PMC proudly provides the ultimate large-scale Dolby Atmos audio system for the legendary musician Steven Wilson at the High End, Munich. He will share his exten...

23/04/2024

Particles emitting from a 3D rotating shape's edge

Particles emitting from a 3D rotating shape's edge Graham Quince April 22, 2024 0 Comments In Fixin' FX, people send me their problematic proj...

23/04/2024

Hollyland Technology Announces a New Line of Video Transmitters: Introducing the Pyro Series

Hollyland Technology Announces a New Line of Video Transmitters: Introducing the...

23/04/2024

Charlotte Deleste, WISC Madison Anchor, Gives Notice

Charlotte Deleste, anchor at WISC Madison, Wisconsin, is leaving the station. Her final day on the air is April 24. Deleste has spent 18 years there....

23/04/2024

Tegna Brings Caitlin Clark Effect To Local Broadcast With Fever Deal

Top WNBA draft choice Caitlin Clark will appear on local broadcast for 17 games next season in a deal between Tegna and the Indiana Fever....

23/04/2024

Skeem Saam: Monday's episode, 22 April 2024 [video]

Skeem Saam: Monday's episode, 22 April 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...

23/04/2024

Skeem Saam' May Spoiler: Inside Mr Kgomo, Eunice's romance?

Skeem Saam' May Spoiler: Inside Mr Kgomo, Eunice's romance? Skeem Saam' May teasers reveal that Melita will be jealous of Mr Kgomo and Eunice's ...

23/04/2024

Tonight on Scandal: Dintle takes a huge risk on her quest to save her daughter

Tonight on Scandal: Dintle takes a huge risk on her quest to save her daughterDon't miss Tuesday, 23 April's riveting episode of South African soapie Sc...

23/04/2024

Niels Steenstrup appointed CEO of Thales InFlyt Experience

Facebook Twitter LinkedIn We thank TK for his leadership and dedication to our customers' success. We wish him well on his retirement, said Yannick ...

23/04/2024

Thales opens a new System Testing Centre for German F126 project

Facebook Twitter LinkedIn On April 23rd 2024, Thales, the German Navy and German military procurement agency, BAAINBw (Federal Office of Bundeswehr Equipm...

22/04/2024

UKTV Ventures partners with Elder, in airtime-for-equity deal

22 April 2024 - Award-winning broadcaster UKTV has today announced it has invested in the award-winning online care marketplace, Elder, using its multi-million ...

22/04/2024

Taylor Swift's THE TORTURED POETS DEPARTMENT' Breaks Multiple Spotify Records in Less Than 24 Hours

It's a beautiful day to be a Swiftie. On April 19, Taylor Swift dropped her ...

22/04/2024

SBS marks Earth Day with Australian TV milestone as The Cook Up with Adam Liaw becomes first show to measure its carbon footprint

SBS marks Earth Day with Australian TV milestone as The Cook Up with Adam Liaw b...

22/04/2024

Adapting to Landscapes With LEE Filters

In this video, LEE Filters ambassador Jordan Banks ventures into Snowdonia National Park in Wales. Faced with less-than-ideal weather conditions, he adapts his ...

22/04/2024

The CW Will Not Renew Affiliations with Scripps Stations in Seven Markets

The Nexstar Media Group has decided not to renew affiliation agreements for The CW broadcast network with stations owned by Scripps in seven markets....

22/04/2024

Tegna's WTHR and WALV to Broadcast Indiana Fever WNBA Games

INDIANAPOLIS and Tysons, Va. In the wake of record viewing levels for the NCAA Women's Championship games, Tegna has announced that it has signed an agreeme...

22/04/2024

Digital Domain Unveils Masquerade3: Revolutionary Markerless Facial Motion Capture System

Digital Domain Unveils Masquerade3 : Revolutionary Markerless Facial Motion Cap...

22/04/2024

Pixotope brings the power of Unreal Engine to automated and news broadcast graphics

Pixotope brings the power of Unreal Engine to automated and news broadcast graph...

22/04/2024

Brand New Color Slice tool in DaVinci Resolve 19!

Brand New Color Slice tool in DaVinci Resolve 19! Kasia Jarco April 22, 2024 0 Comments In this video i would like to show you the newest Color Slice ...

22/04/2024

Apple Motion's Best-Kept Secret

Apple Motion's Best-Kept Secret Simon Ubsdell April 22, 2024 0 Comments A seriously useful technique that I have employed in many of my tutorials ...