Meet the Omnivore: Developer Builds Bots With NVIDIA Omniverse and Isaac Sim
01/08/2022
Antonio Serrano-Mu oz While still in grad school, Antonio Serrano-Mu oz has helped author papers spanning planetary gravities, AI-powered diagnosis of rheumatoid arthritis and robots that precisely track millimetric-sized walkers, like ants.
Now, the Ph.D. student in applied robotics at Mondragon University in northern Spain, is using robotics and AI in remanufacturing to tackle issues of climate change and pollution.
In short, Serrano-Mu oz is busy discovering unique ways to apply technology to complex, real-world issues - and, in his free time, he makes extensions for NVIDIA Omniverse, a platform for real-time 3D design collaboration and world simulation.
Omniverse Extensions are core building blocks that enable anyone to create and extend the functionality of Omniverse Apps to meet the specific needs of their workflows with just a few lines of Python code.
Serrano-Mu oz has created six open-source Omniverse Extensions that can be accessed on GitHub, one of which enhances the capabilities of NVIDIA Isaac Sim, an Omniverse-powered application framework for creating photorealistic, physically accurate virtual environments in which to develop, train and simulate AI robots.
Since the beginning of my Ph.D. studies, I decided to work with Isaac Sim to simulate robots, Serrano-Mu oz said. It offers a powerful, real-time simulation platform with an ultra-realistic physics engine and graphics - as well as a clean, simple application programming interface that makes it easy to interact with the whole system.
Omniverse for Robotics Simulation Serrano-Mu oz has pursued robotics for as long as he can remember. Growing up in Cuba, he always fiddled with electronics, and he fell deeper in love with technology when he began coding in college.
Robots can assist humans with strenuous, high-precision, repetitive and sometimes hazardous tasks, Serrano-Mu oz said. They have the potential to improve our lives, and I hope my work advances robotics in a way that allows us to build a better present and achieve a better future.
He believes Omniverse is crucial to his doctoral studies in applied robotics.
Performing real-time, graphically realistic simulations of robotics environments wasn't possible before Omniverse, he said. The platform opens the door to a new era of revolutionary changes in robotics, simulation and real-time collaboration.
Omniverse links specialists of all kinds - engineers, designers, content creators - for the development of simulation systems, he added. Key for this is Universal Scene Description (USD), an open source 3D scene description and extensible file framework serving as the common language for virtual worlds.
USD plays an important role in the process of authoring, composing and reading a hierarchically organized scene to create and manipulate its rendering elements and objects, Serrano-Mu oz said.
Extending Omniverse for Isaac Sim Using NVIDIA Omniverse, the developer has created robot simulations for industrial use cases and a digital twin of Mondragon University's laboratory for robotics prototyping.
A digital twin of a bench in Mondragon University's robotics lab, made with NVIDIA Omniverse. And while working on such projects, Serrano-Mu oz wanted to integrate with Isaac Sim a tool he was already familiar with: Robot Operating System, or ROS, a set of software libraries for building robot applications. So, he created an Omniverse Extension to enable just that.
The extension lets users manipulate simulated robotic systems in the Omniverse-powered Isaac Sim application via ROS control interfaces. ROS MoveIt, a motion planning framework for robots, can be used in conjunction with Isaac Sim's dynamic control extension and PhysX capabilities, which bring physical accuracy to high-fidelity robotics simulations.
It's easy to develop code without leaving the Omniverse Kit, Serrano-Mu oz said. Omniverse Extensions come with a system-wide integration API, installation, activation and reload mechanisms to augment the functionality of Omniverse Apps.
This particular extension for ROS, he added, boosts agile prototyping for robotics applications - which is further accelerated by his NVIDIA RTX 3080 Laptop GPU - making his workflow faster than ever.
Hear more from Serrano-Mu oz about using digital twins for industrial robotics by watching his NVIDIA GTC session on demand. And watch his Community Spotlight on the Omniverse Twitch channel happening Aug. 3 at 11 a.m. PT.
Join in on the Creation Creators and developers across the world can download NVIDIA Omniverse for free, and enterprise teams can use the platform for their 3D projects.
Developers like Serrano-Mu oz will join NVIDIA at SIGGRAPH, a global computer graphics conference running Aug. 8-11. Watch the Omniverse community livestream at SIGGRAPH on Tuesday, Aug. 9, at noon PT to learn how Omniverse and other design and visualization technologies are driving breakthroughs in graphics and GPU-accelerated software.
Plus, anyone can submit to the inaugural #ExtendOmniverse developer contest through Friday, Aug. 19. Create an Omniverse Extension using Omniverse Code for a chance to win an NVIDIA RTX GPU.
Check out artwork from other Omnivores and submit projects in the gallery. Connect your workflows to Omniverse with software from Adobe, Autodesk, Epic Games, Maxon, Reallusion and more.
Follow NVIDIA Omniverse on Instagram, Twitter, YouTube and Medium for additional resources and inspiration. Check out the Omniverse forums, and join our Discord server and Twitch channel to chat with the community.
LINK: | https://blogs.nvidia.com/blog/2022/08/01/omniverse-developer-antonio-s... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
23/04/2024
IBC Now Accepting Nominations for 2024 Innovation Awards
LONDON IBC is now accepting nominations for its IBC2024 Innovation Awards, which honor achievements in technological innovation and social impact media & entert...
23/04/2024
NAB Backs Broadcast VOICES Act
WASHINGTON, D.C. In response to the introduction of the Broadcast VOICES Act that seeks to encourage more diversity in the ownership of TV and radio stations, t...
23/04/2024
Hemisphere Media Group Launches WAPA+ on the Roku Channel
MIAMI, Fla. As part of a push to expand its FAST channel and streaming operations, Hemisphere Media Group has launched its free ad supported television (FAST) c...
23/04/2024
DirecTV Launches New Streaming Channels from Cineverse and Scripps Networks
LOS ANGELES DirecTV is adding seven new channels to its rapidly expanding streaming lineup through new licensing agreements with Cineverse Corp. and Scripps Net...
23/04/2024
Creative UK launches manifesto calling for more investment in creative R&D; revised approach to trade and exports
Entitled Our Creative Future, the manifesto calls for radical new action' t...
23/04/2024
Audiotonix secures landmark' investment
The company has secured investment from private equity firm PAI Partners, which also holds a stake in outside broadcasting company EMG By Jenny Priestley Pub...
23/04/2024
James Cameron backs Marlow Film Studios proposal
Cameron also said he recognised Marlow as a potential UK and European base for his new company, LIGHTSTORM 3D By Matthew Corrigan Published: April 23, 2024 ...
23/04/2024
IBC launches 2024 Innovation Awards with new categories
The five categories cover Content Creation, Content Distribution, Content Everywhere, Social Impact and Environment & Sustainability By Matthew Corrigan Publ...
23/04/2024
Pascal Fratellia leaves Olympics role at EBU
He played a central role in securing key broadcast rights, including the FIFA World Cup 2018 and 2022 By Matthew Corrigan Published: April 23, 2024 He pla...
23/04/2024
IBC Launches 2024 Innovation Awards with Nominations Now...
IBC is preparing to honour the highest achievements in technological innovation and social impact with the launch of its prestigious IBC2024 Innovation Awards, ...
23/04/2024
Bolin Technology Integrates NDI Across Product Portfolio
BREA, Calif. Bolin Technology is integrating Network Device Interface (NDI) across its product line, bringing support for the latest NDI technologies to its PTZ...
23/04/2024
Aaron LaBerge Joins PENN Entertainment at CTO
WYOMISSING, Pa. PENN Entertainment has announced that longtime Disney and ESPN executive Aaron LaBerge has been named chief technology officer effective July 1,...
23/04/2024
Nexstar Disputes FCC $1.2M Fine, Order to Sell WPIX
In response to an FCC ruling in March proposing a $1.2 million fine against Nexstar and a ruling that Mission Broadcasting sell WPIX, Nexstar has filled a respo...
23/04/2024
Sony's Ci Media Cloud Keeps NHRA Moving
Sony has announced new details about how the National Hot Rod Association (NHRA) is using Sony's Ci Media Cloud platform to streamline its workflows and spe...
23/04/2024
NiTRos M-CUBE Studio Levels Up Esports Productions with A...
Esports' rapid rise to popularity can be attributed to many factors, from technological advancements that have enhanced the quality of modern gaming experie...
23/04/2024
OpenDrives New Software-Defined Platform Atlas Wins 2024...
OpenDrives, Inc., the global provider of software-defined media workflow solutions and data management capabilities, has been selected as a winner in the 2024 N...
23/04/2024
Vipe by BCNEXXT Takes Home 2024 NAB Show Product of the Y...
BCNEXXT is pleased to announce that Vpe has won the 2024 NAB Show Product of the Year Award in the Asset Management, Automation and Playout category. The offici...
23/04/2024
Gravity Media Australia to Deliver Broadcast Technology a...
Gravity Media, a world leading global provider of complex live creative production and media services, today outlined the broadcast technology and television pr...
23/04/2024
Industry veteran Peter Brennan to lead Scality operations...
Scality, a global leader in cyber-resilient storage for the AI era, today announced the appointment of Peter Brennan as Chief Executive Officer (CEO) of Scality...
23/04/2024
Blackmagic Design Announces New ATEM Constellation 4K Swi...
Blackmagic Design today announced ATEM 1 M/E Constellation 4K and ATEM 2 M/E Constellation 4K switchers, two new Ultra HD models of the ATEM Constellation famil...
23/04/2024
Blackmagic Design Announces New Blackmagic Videohub 120x1...
Blackmagic Design today announced Blackmagic Videohub 120x120 12G, the newest model in the Videohub 12G router family. The massive Blackmagic Videohub 120x120 1...
23/04/2024
Blackmagic Design Announces New Lower Price for Blackmagi...
Blackmagic Design today announced new lower prices for Blackmagic Video Assist 3G and 12G models. Customers can save US$200 on all models. These lower prices ma...
23/04/2024
Adder Wins Best of Show TV Tech Award at NAB 2024
Adder Technology continues to shine brightly, with its groundbreaking product, the ADDERLink INFINITY 3000 (ALIF3000), once again taking center stage. Hot on t...
23/04/2024
Pliant Technologies Wins 2024 NAB Show Product of The Yea...
Pliant Technologies' CRP-C12 Compact Radio Pack is an Audio Production, Processing and Networking category winner in the 2024 NAB Show Product of the Year A...
23/04/2024
SipRadius transforms remote production at CABSAT with liv...
SipRadius, the specialists in live media transport and transcoding, will showcase their world-leading implementation of AV1 and JPEG-XS over transport streams a...
23/04/2024
Rafael Krux Makes Room For A Prism Sound Dream ADA-128 Co...
Composer Rafael Krux has added a Prism Sound Dream ADA-128 modular conversion system to his production studio where he creates music for commercials, trailers, ...
23/04/2024
PMC Loudspeakers Provide Reference Sound For Steven Wilso...
PMC proudly provides the ultimate large-scale Dolby Atmos audio system for the legendary musician Steven Wilson at the High End, Munich. He will share his exten...
23/04/2024
Particles emitting from a 3D rotating shape's edge
Particles emitting from a 3D rotating shape's edge Graham Quince April 22, 2024 0 Comments In Fixin' FX, people send me their problematic proj...
23/04/2024
Hollyland Technology Announces a New Line of Video Transmitters: Introducing the Pyro Series
Hollyland Technology Announces a New Line of Video Transmitters: Introducing the...
23/04/2024
Charlotte Deleste, WISC Madison Anchor, Gives Notice
Charlotte Deleste, anchor at WISC Madison, Wisconsin, is leaving the station. Her final day on the air is April 24. Deleste has spent 18 years there....
23/04/2024
Tegna Brings Caitlin Clark Effect To Local Broadcast With Fever Deal
Top WNBA draft choice Caitlin Clark will appear on local broadcast for 17 games next season in a deal between Tegna and the Indiana Fever....
23/04/2024
Skeem Saam: Monday's episode, 22 April 2024 [video]
Skeem Saam: Monday's episode, 22 April 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...
23/04/2024
Skeem Saam' May Spoiler: Inside Mr Kgomo, Eunice's romance?
Skeem Saam' May Spoiler: Inside Mr Kgomo, Eunice's romance? Skeem Saam' May teasers reveal that Melita will be jealous of Mr Kgomo and Eunice's ...
23/04/2024
Tonight on Scandal: Dintle takes a huge risk on her quest to save her daughter
Tonight on Scandal: Dintle takes a huge risk on her quest to save her daughterDon't miss Tuesday, 23 April's riveting episode of South African soapie Sc...
23/04/2024
Niels Steenstrup appointed CEO of Thales InFlyt Experience
Facebook Twitter LinkedIn We thank TK for his leadership and dedication to our customers' success. We wish him well on his retirement, said Yannick ...
23/04/2024
Thales opens a new System Testing Centre for German F126 project
Facebook Twitter LinkedIn On April 23rd 2024, Thales, the German Navy and German military procurement agency, BAAINBw (Federal Office of Bundeswehr Equipm...
22/04/2024
UKTV Ventures partners with Elder, in airtime-for-equity deal
22 April 2024 - Award-winning broadcaster UKTV has today announced it has invested in the award-winning online care marketplace, Elder, using its multi-million ...
22/04/2024
Taylor Swift's THE TORTURED POETS DEPARTMENT' Breaks Multiple Spotify Records in Less Than 24 Hours
It's a beautiful day to be a Swiftie. On April 19, Taylor Swift dropped her ...
22/04/2024
SBS marks Earth Day with Australian TV milestone as The Cook Up with Adam Liaw becomes first show to measure its carbon footprint
SBS marks Earth Day with Australian TV milestone as The Cook Up with Adam Liaw b...
22/04/2024
Adapting to Landscapes With LEE Filters
In this video, LEE Filters ambassador Jordan Banks ventures into Snowdonia National Park in Wales. Faced with less-than-ideal weather conditions, he adapts his ...
22/04/2024
The CW Will Not Renew Affiliations with Scripps Stations in Seven Markets
The Nexstar Media Group has decided not to renew affiliation agreements for The CW broadcast network with stations owned by Scripps in seven markets....
22/04/2024
Tegna's WTHR and WALV to Broadcast Indiana Fever WNBA Games
INDIANAPOLIS and Tysons, Va. In the wake of record viewing levels for the NCAA Women's Championship games, Tegna has announced that it has signed an agreeme...
22/04/2024
Digital Domain Unveils Masquerade3: Revolutionary Markerless Facial Motion Capture System
Digital Domain Unveils Masquerade3 : Revolutionary Markerless Facial Motion Cap...
22/04/2024
Pixotope brings the power of Unreal Engine to automated and news broadcast graphics
Pixotope brings the power of Unreal Engine to automated and news broadcast graph...
22/04/2024
Brand New Color Slice tool in DaVinci Resolve 19!
Brand New Color Slice tool in DaVinci Resolve 19! Kasia Jarco April 22, 2024 0 Comments In this video i would like to show you the newest Color Slice ...
22/04/2024
Apple Motion's Best-Kept Secret
Apple Motion's Best-Kept Secret Simon Ubsdell April 22, 2024 0 Comments A seriously useful technique that I have employed in many of my tutorials ...