Meet the Omnivore: Developer Builds Bots With NVIDIA Omniverse and Isaac Sim
01/08/2022
Antonio Serrano-Mu oz While still in grad school, Antonio Serrano-Mu oz has helped author papers spanning planetary gravities, AI-powered diagnosis of rheumatoid arthritis and robots that precisely track millimetric-sized walkers, like ants.
Now, the Ph.D. student in applied robotics at Mondragon University in northern Spain, is using robotics and AI in remanufacturing to tackle issues of climate change and pollution.
In short, Serrano-Mu oz is busy discovering unique ways to apply technology to complex, real-world issues - and, in his free time, he makes extensions for NVIDIA Omniverse, a platform for real-time 3D design collaboration and world simulation.
Omniverse Extensions are core building blocks that enable anyone to create and extend the functionality of Omniverse Apps to meet the specific needs of their workflows with just a few lines of Python code.
Serrano-Mu oz has created six open-source Omniverse Extensions that can be accessed on GitHub, one of which enhances the capabilities of NVIDIA Isaac Sim, an Omniverse-powered application framework for creating photorealistic, physically accurate virtual environments in which to develop, train and simulate AI robots.
Since the beginning of my Ph.D. studies, I decided to work with Isaac Sim to simulate robots, Serrano-Mu oz said. It offers a powerful, real-time simulation platform with an ultra-realistic physics engine and graphics - as well as a clean, simple application programming interface that makes it easy to interact with the whole system.
Omniverse for Robotics Simulation Serrano-Mu oz has pursued robotics for as long as he can remember. Growing up in Cuba, he always fiddled with electronics, and he fell deeper in love with technology when he began coding in college.
Robots can assist humans with strenuous, high-precision, repetitive and sometimes hazardous tasks, Serrano-Mu oz said. They have the potential to improve our lives, and I hope my work advances robotics in a way that allows us to build a better present and achieve a better future.
He believes Omniverse is crucial to his doctoral studies in applied robotics.
Performing real-time, graphically realistic simulations of robotics environments wasn't possible before Omniverse, he said. The platform opens the door to a new era of revolutionary changes in robotics, simulation and real-time collaboration.
Omniverse links specialists of all kinds - engineers, designers, content creators - for the development of simulation systems, he added. Key for this is Universal Scene Description (USD), an open source 3D scene description and extensible file framework serving as the common language for virtual worlds.
USD plays an important role in the process of authoring, composing and reading a hierarchically organized scene to create and manipulate its rendering elements and objects, Serrano-Mu oz said.
Extending Omniverse for Isaac Sim Using NVIDIA Omniverse, the developer has created robot simulations for industrial use cases and a digital twin of Mondragon University's laboratory for robotics prototyping.
A digital twin of a bench in Mondragon University's robotics lab, made with NVIDIA Omniverse. And while working on such projects, Serrano-Mu oz wanted to integrate with Isaac Sim a tool he was already familiar with: Robot Operating System, or ROS, a set of software libraries for building robot applications. So, he created an Omniverse Extension to enable just that.
The extension lets users manipulate simulated robotic systems in the Omniverse-powered Isaac Sim application via ROS control interfaces. ROS MoveIt, a motion planning framework for robots, can be used in conjunction with Isaac Sim's dynamic control extension and PhysX capabilities, which bring physical accuracy to high-fidelity robotics simulations.
It's easy to develop code without leaving the Omniverse Kit, Serrano-Mu oz said. Omniverse Extensions come with a system-wide integration API, installation, activation and reload mechanisms to augment the functionality of Omniverse Apps.
This particular extension for ROS, he added, boosts agile prototyping for robotics applications - which is further accelerated by his NVIDIA RTX 3080 Laptop GPU - making his workflow faster than ever.
Hear more from Serrano-Mu oz about using digital twins for industrial robotics by watching his NVIDIA GTC session on demand. And watch his Community Spotlight on the Omniverse Twitch channel happening Aug. 3 at 11 a.m. PT.
Join in on the Creation Creators and developers across the world can download NVIDIA Omniverse for free, and enterprise teams can use the platform for their 3D projects.
Developers like Serrano-Mu oz will join NVIDIA at SIGGRAPH, a global computer graphics conference running Aug. 8-11. Watch the Omniverse community livestream at SIGGRAPH on Tuesday, Aug. 9, at noon PT to learn how Omniverse and other design and visualization technologies are driving breakthroughs in graphics and GPU-accelerated software.
Plus, anyone can submit to the inaugural #ExtendOmniverse developer contest through Friday, Aug. 19. Create an Omniverse Extension using Omniverse Code for a chance to win an NVIDIA RTX GPU.
Check out artwork from other Omnivores and submit projects in the gallery. Connect your workflows to Omniverse with software from Adobe, Autodesk, Epic Games, Maxon, Reallusion and more.
Follow NVIDIA Omniverse on Instagram, Twitter, YouTube and Medium for additional resources and inspiration. Check out the Omniverse forums, and join our Discord server and Twitch channel to chat with the community.
LINK: | https://blogs.nvidia.com/blog/2022/08/01/omniverse-developer-antonio-s... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
09/05/2024
Scripps Appoints New President and CEO of the Scripps Howard Fund
CINCINNATI Meredith Delaney has been appointed president and CEO of the Scripps Howard Fund, the philanthropic arm of The E.W. Scripps Company....
09/05/2024
Walmart Launches the Onn. 4K Streaming Device
Following leaks earlier this month of Walmart's plans to launch a new 4K streaming box, Walmart has officially unveiled the Onn. 4K Pro, a hybrid streaming ...
09/05/2024
DirecTV Adds More CW Stations
DirecTV continues to add CW affiliates to its streaming line-up, with the addition of four stations owned by Gray Television....
09/05/2024
Takeshi Kitano's film KUBI graded with DaVinci Resolve
Takeshi Kitano's film KUBI graded with DaVinci Resolve Brie Clayton May 8, 2024 0 Comments Blackmagic Design today announced that DaVinci Resolve ...
09/05/2024
zweiB updates to latest version of R&S CLIPSTER
zweiB updates to latest version of R&S CLIPSTER Brie Clayton May 8, 2024 0 Comments Specialist in deliverables for cinema, events and trade shows Ro...
09/05/2024
Simplify Your Filmmaking with Portable Lights
Simplify Your Filmmaking with Portable Lights Sean Alami May 8, 2024 0 Comments Discover the sleek, mobile Zhiyun lights that enhance cinematic scenes...
09/05/2024
The Benefits of using an Audio Interface
The Benefits of using an Audio Interface Colin Smith May 8, 2024 0 Comments This tutorial takes you through the hardware and software benefits of usin...
09/05/2024
Mother's Day Idea from CBC
Capitol Broadcasting has a myriad of ways to celebrate Mom! In honor of Mother's Day, here are a few ideas CBC divisions have to help you honor, or remember...
09/05/2024
Lachlan Murdoch Sees Progress Toward Sports Streaming Product
Fox CEO Lachlan Murdoch said his company, The Walt Disney Co. and Warner Bros. Discovery are in a two-minute drill to get their streaming sports joint venture t...
09/05/2024
Dale Earnhardt Jr. Joins Prime Video's NASCAR Team
NASCAR legend Dale Earnhardt Jr. is joining the Prime Video broadcast booth when the streaming network begins NASCAR Cup Series coverage next year. Earnhardt Jr...
09/05/2024
Nexstar Pitches Sports on The CW, Extra Reach Via Stations (Upfronts)
If upfront advertisers are looking for reach, Nexstar Media Group believes its base of local stations gives it a unique way to achieve that goal....
09/05/2024
Pluto TV Debuts NBCUniversal Local Streaming News Channels
NBCUniversal Local's 15 NBC and Telemundo local and regional streaming news channels begin launching on Pluto TV this month, starting May 8 with five channe...
09/05/2024
Don't Tell Mom the Babysitter's Dead' Debuts on BET Plus May 16
BET Plus said it has set May 16 as the premiere date for its original movie Don't Tell Mom the Babysitter's Dead....
09/05/2024
Disney's Rita Ferro Is Banking on Sports, Streaming, Tech (Upfronts)
Heading into the upfront, the advertising market is noticeably healthier than it was a year ago, Rita Ferro, president of global advertising sales at The Walt D...
09/05/2024
Rohde & Schwarz showcases operational efficiency at MPTS
Rohde & Schwarz showcases operational efficiency at MPTS Uncompromised quality and reliability coupled with simplicity and efficiency Rohde & Schwarz will ...
08/05/2024
Saved! and Rudo y Cursi Among Films With May Anniversaries
Diego Luna's character Beto aims to play professional soccer in Carlos Cuar n's film Rudo y Cursi....
08/05/2024
SGL Carbon: Focus on global growth trends pays off
SGL Carbon had a solid start to the first quarter of 2024. Despite the slight decline in sales of 3.9% to 272.6 million (Q1 2023: 283.7 million), adjusted EBI...
08/05/2024
The results are in from Malm Arena as Semi Final 1 participants move through to the Grand Final of this year's Eurovision Song Contest
The results are in from Malm Arena as Semi Final 1 participants move through to...
08/05/2024
Powerful NITV documentary Kindred to premiere during Reconciliation Week
Powerful NITV documentary Kindred to premiere during Reconciliation Week Media releases A journey of family, friendship and home *Watch the trailer here* ...
08/05/2024
Aerojet Rocketdyne Selected by DoD to Demonstrate Powder-in, Engine-out Hypersonic Propulsion Manufacturing
Aerojet Rocketdyne delivers a broad range of capabilities to support hypersonic ...
08/05/2024
L3Harris is Advancing the Future Fleet by Delivering Integrated Solutions
Selected by Fincantieri Marinette Marine, L3Harris is the shipboard design integrator and a key partner on the Fincantieri team for delivering critical subsyste...
08/05/2024
EditShare Goes Beyond Storage at MPTS
EditShare Goes Beyond Storage at MPTS Workflow, server and delivery solutions from storyboard to screen Stand D40, London Olympia, May 15-16, 2024 - EditShar...
08/05/2024
Tegna, Indiana Fever Expand Broadcast Distribution to 11 Additional Markets
TYSONS, Va. Tegna Inc. and the Indiana Fever have announced they have expanded the broadcast distribution of 17 Fever WNBA games to 11 additional markets....
08/05/2024
Comcast Business Boosts Internet Speeds
PHILADELPHIA Comcast Business has increased Internet speeds for customers, nationwide, at no additional cost and has introduced its fastest Internet plans yet ...
08/05/2024
Clear-Com to Showcase Cutting-Edge Communication Solution...
Clear-Com , a renowned provider of professional real-time communication solutions, is thrilled to announce its participation at InfoComm 2024, the largest profe...
08/05/2024
MRMC Achieves its Second Kings Award for Enterprise
Mark Roberts Motion Control (MRMC), a Nikon company, is one of the 252 organisations recognised with a prestigious King's Award for Enterprise. Announced to...
08/05/2024
EditShare goes beyond storage at MPTS
EditShare, the technology leader that enables storytellers to create and manage collaborative workflows at every stage from storyboard to screen, is exhibiting ...
08/05/2024
Magnifi and Linius Fuse Live and Archive Content to Redef...
Magnifi by VideoVerse an AI-driven video technology company and powerful video-editing SaaS platform is pleased to announce a strategic partnership with Linius ...
08/05/2024
NVIDIA RTX GPU Connects DaVinci Resolve to Power
NVIDIA RTX GPU Connects DaVinci Resolve to Power Brie Clayton May 8, 2024 0 Comments Two of the most important questions that the Creative COW audienc...
08/05/2024
Q&A with Visiting Artist Lei Liang
Q&A with Visiting Artist Lei Liang The acclaimed composer discusses his collaboration with Boston Conservatory, his work as a research artist, and what it mea...
08/05/2024
More Stations in San Antonio Launch NextGen TV Broadcasts
A second group of stations has begun broadcasting NextGen TV signals in San Antonio, Texas....
08/05/2024
NBC Orders More Deal or No Deal Island'
NBC has ordered a second season of unscripted Deal or No Deal Island. Joe Manganiello hosts, and executive produces alongside Howie Mandel. Manganiello will ret...
08/05/2024
Tegna Names Greg Retsinas GM At KGW, Portland, Oregon
Tegna said it named Greg Retsinas as president and general manager of KGW, the NBC affiliate in Portland, Oregon, effective June 3....
08/05/2024
Measurement Company Comscore Posts $5.2 Million Loss in 1st Quarter
Comscore lost money in the first quarter as weak linear ad sales impacted its cross-platform measurement business....
08/05/2024
Funny Business as NBC Orders Happy's Place,' Renews Lopez vs. Lopez'
NBC said it bolstered its comedy slate by renewing Lopez vs. Lopez and ordering Happy's Place, starring Reba McEntire....
08/05/2024
Knuckles' Knocks Fallout' From Top of TVision Power Score Rankings
Paramount Plus's Knuckles knocked Amazon Prime Video's Fallout out of the top spot in TVision's Power Score ranking of the top show on connected TV ...
08/05/2024
Tegna Adds 11 Markets To Lineup for Indiana Fever Games
Tegna, which made a deal to broadcast 17 Indiana Fever games featuring top WNBA draft pick Caitlin Clark, said it made deals that will put the games on stations...
08/05/2024
EchoStar Loses 348,000 Pay TV Subs in 1st Quarter
EchoStar said it lost another 348,000 pay TV subscribers so far this year, closing the first quarter with 8.18 million subscribers. That total includes 6.26 mil...
08/05/2024
Fox Has Net Income of $666 Million in 3rd Quarter
Fox reported a profit for its fiscal third quarter....
08/05/2024
IPG's Kinesso Unit Adds Senior Executives to Lineup
Kinesso, the centralized tech and data unit at media agency IPG Mediabrands, named Tom Amies-Cull as global chief operating officer and Amie Owen as global chie...
08/05/2024
Post production houses adopt Cleanfeed Cinema solution
The solutions in-browser stream focuses on low latency, making it suited to low bandwidth scenarios By Matthew Corrigan Published: May 8, 2024 The solutio...
08/05/2024
TAG unveils subtitling language detection feature
Driven by algorithms, the solution performs a quality analysis informed by language-specific dictionaries By Matthew Corrigan Published: May 8, 2024 Drive...
08/05/2024
Mobilelinks acquires 2 SAT Europe to increase SNG truck fleet
The increase in fleet size will reduce travel distances, aligning with sustainability goals, said Mobilelinks By Matthew Corrigan Published: May 8, 2024 T...
08/05/2024
Arqiva adds Caroline Cardozo and James Lelyveld to technology team
The company said the new arrivals would drive collaboration and technological transformation across key business units By Matthew Corrigan Published: May 8, ...
08/05/2024
Actus Digital Set to Shine at CABSAT and Broadcast Asia
Following a successful NAB Las Vegas 2024 and winning a Best of Show Award, Actus Digital, a leading provider of Intelligent Monitoring Platforms, will bring it...
08/05/2024
TAG Revolutionizes Closed Captions and Subtitles Quality...
TAG Video Systems, a leading force in video monitoring solutions, has developed a new Language Detection feature set to transform how operators ensure quality a...
08/05/2024
Pliant Technologies Unveils New SmartBoom LITE Headset at...
Pliant Technologies, a leading provider of professional wireless intercom solutions,presents its new SmartBoom LITE Headset at InfoComm 2024 (Booth C5116). The ...
08/05/2024
Prism Sound Showcases High-Quality Audio Conversion at MP...
At the Media Production & Technology Show 2024, Prism Sound will showcase high-quality audio conversion products designed to suit the demands of professional us...