Sony Pixel Power calrec Sony

Into the Omniverse: OpenUSD Workflows Advance Physical AI for Robotics, Autonomous Vehicles

22/01/2025

Editor's note: This post is part of Into the Omniverse, a series focused on how developers, 3D practitioners and enterprises can transform their workflows using the latest advances in Universal Scene Description (OpenUSD) and NVIDIA Omniverse.

The next frontier of AI is physical AI. Physical AI models can understand instructions and perceive, interact and perform complex actions in the real world to power autonomous machines like robots and self-driving cars.

Similar to how large language models can process and generate text, physical AI models can understand the world and generate actions. To do this, these models must be trained in simulation environments to comprehend physical dynamics, like gravity, friction or inertia - and understand geometric and spatial relationships, as well as the principles of cause and effect.

Global leaders in software development and professional services are using NVIDIA Omniverse, powered by OpenUSD, to build new products and services that will accelerate the development of AI and controllable simulations to enable the creation of true-to-reality virtual worlds, known as digital twins, that can be used to train physical AI with unprecedented accuracy and detail.

Generate Exponentially More Synthetic Data With Omniverse and NVIDIA Cosmos At CES, NVIDIA announced generative AI models and blueprints that expand Omniverse integration further into physical AI applications such as robotics, autonomous vehicles and vision AI.

Among these announcements was NVIDIA Cosmos, a platform of state-of-the-art generative world foundation models, advanced tokenizers, guardrails and an accelerated video processing pipeline - all designed to accelerate physical AI development.

Developing physical AI models is a costly, resource- and time-intensive process that requires vast amounts of real-world data and testing. Cosmos' world foundation models (WFM), which predict future world states as videos based on multimodal inputs, provide an easy way for developers to generate massive amounts of photoreal, physics-based synthetic data to train and evaluate AI for robotics, autonomous vehicles and machines. Developers can also fine-tune Cosmos WFMs to build downstream world models or improve quality and efficiency for specific physical AI use cases.

When paired with Omniverse, Cosmos creates a powerful synthetic data multiplication engine. Developers can use Omniverse to create 3D scenarios, then feed the outputs into Cosmos to generate controlled videos and variations. This can drastically accelerate the development of physical AI systems such as autonomous vehicles and robots by rapidly generating exponentially more training data covering a variety of environments and interactions.

OpenUSD ensures the data in these scenarios is seamlessly integrated and consistently represented, enhancing the realism and effectiveness of the simulations.

Leading robotics and automotive companies, including 1X, Agile Robots, Agility Robotics, Figure AI, Foretellix, Fourier, Galbot, Hillbot, IntBot, Neura Robotics, Skild AI, Virtual Incision, Waabi and XPENG, along with ridesharing giant Uber, are among the first to adopt Cosmos.

Learn more about how world foundation models will advance physical AI by listening to the NVIDIA AI Podcast episode with Ming-Yu Liu, vice president of research at NVIDIA.

See Cosmos in Action for Physical AI Use Cases Cosmos WFMs are revolutionizing industries by providing a unified framework for developing, training and deploying large-scale AI models across various applications. Enterprises in the automotive, industrial and robotics sectors can harness the power of generative physical AI and simulation to accelerate innovation and operational efficiency.

Humanoid robots: The NVIDIA Isaac GR00T Blueprint for synthetic motion generation helps developers generate massive synthetic motion datasets to train humanoid robots using imitation learning. With GR00T workflows, users can capture human actions and use Cosmos to exponentially increase the size and variety of the dataset, making it more robust for training physical AI systems.

Autonomous vehicles: Autonomous vehicle (AV) simulation powered by Omniverse Sensor RTX application programming interfaces lets AV developers replay driving data, generate new ground-truth data and perform closed-loop testing to accelerate their pipelines. With Cosmos, developers can generate synthetic driving scenarios to amplify training data by orders of magnitude, accelerating physical AI model development for autonomous vehicles. Global ridesharing giant Uber is partnering with NVIDIA to accelerate autonomous mobility. Rich driving datasets from Uber, combined with Cosmos and NVIDIA DGX Cloud, can help AV partners build stronger AI models more efficiently.

Industrial settings: Mega is an Omniverse Blueprint for developing, testing and optimizing physical AI and robot fleets at scale in a USD-based digital twin before deployment in factories and warehouses. The blueprint uses Omniverse Cloud Sensor RTX APIs to simultaneously render multisensor data from any type of intelligent machine, enabling high-fidelity sensor simulation at scale. Cosmos can enhance Mega by generating synthetic edge case scenarios to amplify training data, significantly improving the robustness and efficiency of training robots in simulation. KION Group, a supply chain solutions company, is among the first to adopt Mega to drive warehouse automation in retail, consumer packaged goods, parcel services and more.

Get Plugged Into the World of OpenUSD For more on Cosmos, watch the replay of NVIDIA CEO Jensen Huang's CES keynote, and get started with Cosmos WFMs available now under an open model license on Hugging Face and the NVIDIA NGC catalog. Join the upcoming livestream on Wednesday, February 5 for a deep dive into Cosmos WFMs and physical AI work
LINK: https://blogs.nvidia.com/blog/openusd-advances-physical-ai/...
See more stories from nvidia

Most recent headlines

20/11/2025

MLB Media-Rights Shakeup: NBC's New Three-Year Deal Covers Sunday Night Baseball,' Peacock-Exclusive Games, and More

MLB Media-Rights Shakeup: NBC's New Three-Year Deal Covers Sunday Night Bas...

20/11/2025

MLB Media-Rights Shakeup: New Deal Will Bring 30 National Games to ESPN's Linear Platform, MLB.TV Exclusively to ESPN App

MLB Media-Rights Shakeup: New Deal Will Bring 30 National Games to ESPN's Li...

20/11/2025

MLB Media-Rights Shakeup: Netflix Lands Opening Night, Home Run Derby, Field of Dreams

MLB Media-Rights Shakeup: Netflix Lands Opening Night, Home Run Derby, Field of ...

20/11/2025

MLB Media-Rights Shakeup Overview: ESPN, NBCU, Netflix Ink Three-Year Deals

MLB Media-Rights Shakeup Overview: ESPN, NBCU, Netflix Ink Three-Year DealsESPN gets new 30-game package, MLB.TV; NBC extends Sunday nights; Netflix adds tentpo...

20/11/2025

SVG Students To Watch: Henry Thuss, Indiana University

SVG Students To Watch: Henry Thuss, Indiana UniversityThe Southern California product has his goals set on the front benchBy Brandon Costa, Director of Digital ...

20/11/2025

Done+Dusted's Guy Carrington on Creating the Spectacular League of Legends World Championship Opening Ceremony

Done+Dusted's Guy Carrington on Creating the Spectacular League of Legends W...

20/11/2025

FIA Extreme H World Cup Host Broadcaster Aurora Goes Inside the Production of the Hydrogen-Fuelled Motorsport

FIA Extreme H World Cup Host Broadcaster Aurora Goes Inside the Production of th...

20/11/2025

Platinum White Paper: Amagi Utilizes Cloud Production for Sports Events - Multi-Camera Live Workflow with Remote Commentary and Graphics

Platinum White Paper: Amagi Utilizes Cloud Production for Sports Events - Multi-...

20/11/2025

2025 Sports Broadcasting Hall of Fame: Marc Herklotz, Steady Hand Behind the Scenes

2025 Sports Broadcasting Hall of Fame: Marc Herklotz, Steady Hand Behind the Sce...

20/11/2025

NFL Deep Dive: How 32 Cameras at Each Stadium Drive Virtual Measurement, Boundary Replays, and Skeletal Tracking

NFL Deep Dive: How 32 Cameras at Each Stadium Drive Virtual Measurement, Boundar...

20/11/2025

Zodiac Killer Project Refuses to Kill Its Darlings With an Avant-Garde Essay Film

Charlie Shackleton attends the 2025 Sundance Film Festival premiere of Zodiac K...

20/11/2025

5 Ways to Get More out of Your Playlists on Spotify

Your playlists are personal. They're the soundtracks to your road trips, your quiet mornings, and your biggest celebrations; collections of memories and dis...

20/11/2025

Spotify, Trk mziinin efsanelerine sayg duruu niteliindeki ICON Trkiye'yi duyurdu

Spotify, uzun s redir zerine al t T rk m zik k lt r n n ikon haline gelmi ...

20/11/2025

Spotify and The Hollywood Reporter' Partner on the First-Ever Podcaster Roundtable

For the first time, Spotify has teamed up with The Hollywood Reporter to cohost ...

20/11/2025

Spotify and the ARIA Awards Mark a New Era for Australian Music

This year's ARIA Awards marked a turning point for Australian music, and Spotify was right at the heart of it. For the first time in the awards' nearly ...

20/11/2025

Cracking the Code for Resilient, Secure Space-based Communications

L3Harris has achieved NSA Cybersecurity Directorate certification for its KSV-650 space hub end cryptographic unit, ensuring secure, adaptable communications fo...

20/11/2025

Continued Commitment and Investment in Poland

L3Harris is strengthening its long-term partnership with Poland through the opening of a new facility in Warsaw to serve as a central business hub for regional ...

20/11/2025

Cinegy wins the Swedish Hockey League

15 March 2012 SHARE Facebook Twitter Linkedin Email Cinegy and Vericom are pleased to announce the recent deployment of Cinegy Archive for production and as...

20/11/2025

2012

6 September 2012 SHARE Facebook Twitter Linkedin Email FIC Turkey supplies media content to Pay TV under Fox TV Channel brands in Turkey. At the start of s...

20/11/2025

VIVA Indonesia broadcasting the World Cup Brazil 2014 with Cinegy

25 June 2014 SHARE Facebook Twitter Linkedin Email Last month VIVA finalized its Cinegy installation in order to produce and broadcast the World Cup Brazil ...

20/11/2025

2014

1 October 2014 SHARE Facebook Twitter Linkedin Email With 5 locations spread out around Baden-W rttemberg, Schw bisch Media required a scalable end to end s...

20/11/2025

Strictly Come Dancing Goes with a Cinegy Workflow

27 April 2015 SHARE Facebook Twitter Linkedin Email Cinegy, which develops and produces media asset management products that are used in flagship production...

20/11/2025

Cinegy announces new Latin America partnership

12 August 2015 SHARE Facebook Twitter Linkedin Email Munich, Germany, 26 October 2015 - Cinegy, which develops and produces software technology for digital ...

20/11/2025

2015

5 November 2015 SHARE Facebook Twitter Linkedin Email Munich, Germany 3 November 2015 - Cinegy, which develops and produces software technology for digital ...

20/11/2025

Cinegy launches Cinegy Open' initiative

12 February 2016 SHARE Facebook Twitter Linkedin Email Munich, Germany 9 February 2016 - Cinegy, which develops and produces software technology for digital...

20/11/2025

2016

22 June 2016 SHARE Facebook Twitter Linkedin Email Munich, Germany 21 June 2016 - Cinegy today announced that ABS BROADCAST, one of the largest independentl...

20/11/2025

Cinegy News - nominee of NewBay Media Awards 2016

10 January 2017 SHARE Facebook Twitter Linkedin Email Find us on page 12 of the Program Guide 2016 Tags NewBay Media Awards , Program Guide 2016 , broadc...

20/11/2025

Freeview Thailand deploys Cinegy Air PRO Bundles for multi-channel playout

15 March 2017 SHARE Facebook Twitter Linkedin Email Munich, Germany 15 March 2017 - Cinegy today announced that Thailand's Next Step direct-to-home Free...

20/11/2025

2017

12 December 2017 SHARE Facebook Twitter Linkedin Email Munich, Germany 13 December 2017 - Cinegy today announced that it is making its Cinegy Air Cloud Pack...

20/11/2025

2018

25 June 2018 SHARE Facebook Twitter Linkedin Email Munich 25th June 2018 - Cinegy today announced that Canada-based Accessible Media Inc. (AMI) has implemen...

20/11/2025

2019

27 May 2019 SHARE Facebook Twitter Linkedin Email The best quality live video from the worst networks - Haivision Although DVB and the World Wide Web are...

20/11/2025

2020

24 November 2020 SHARE Facebook Twitter Linkedin Email ATV Expand and Increase their Playout and Editing Capabilities using Cinegy Software Munich, Germany...

20/11/2025

Cinegy further commits to Eastern European market with new appointment

1 September 2021 SHARE Facebook Twitter Linkedin Email Munich, Germany, 1st September 2021: Cinegy GmbH, the premier provider of software technology for di...

20/11/2025

2021

20 September 2021 SHARE Facebook Twitter Linkedin Email ElectronicVerve continues a strong history of supporting Cinegy customers in India Munich, Germany,...

20/11/2025

2022

1 November 2022 SHARE Facebook Twitter Linkedin Email Munich, Germany, 01 November 2022: Cinegy, a premier provider of software technology for digital video...

20/11/2025

Britt Broadcast implements Cinegy Air PRO at TBC (Tanzanian Broadcasting Corporation]

31 October 2023 SHARE Facebook Twitter Linkedin Email Britt Broadcast at TBC...

20/11/2025

Oklahoma Community Television Overcomes ATSC 3.0 Translator Challenge

CINCINNATI Oklahoma Community Television (OCT) has selected GatesAir and Triveni Digital as key technology partners in an ATSC 3.0 deployment that establishes a...

20/11/2025

FCC Launches Wide-Ranging Examination of Network Affiliate Relations

WASHINGTON The Federal Communications Commission has opened a wide-ranging inquiry into the relations between broadcast networks and their affiliates that could...

20/11/2025

IAB: Creator Economy Ad Spend Now Dwarfs Ad Spend for Total Media Industry

NEW YORK Ad spend in the creator economy has more than doubled since 2021 from $13.9B to $29.5B in 2024 and that amount is projected to reach $37 billion in 202...

20/11/2025

Graduate Spotlight: Krysta Mirsik DePuy

Graduate Spotlight: Krysta Mirsik DePuy The educator from Hackettstown, New Jersey, shares how it took her 11 years to find the right graduate program for her...

20/11/2025

Rise Awards 2025 Celebrate the Industry's Best

LONDON The winners of the Rise Awards 2025, which recognize women and companies whose achievements have stood out in the media technology industry, have been an...

20/11/2025

Lionsgate, Debmar-Mercury Launch MovieSphere Gold Diginet

SANTA MONICA & NEW YORK Lionsgate's Worldwide Television Distribution Group and Debmar-Mercury have launched MovieSphere Gold in more than 30 million homes....

20/11/2025

Clear-Com Unveils New 4-Channel HelixNet Beltpack

ALAMEDA, Calif. Clear-Com has introduced its four-channel HelixNet beltpack, a next-generation advancement of its widely used two-channel model, and anticipates...

20/11/2025

Kiswe Core Aims to Simplify Cloud-Based Streaming Distribution

NEW PROVIDENCE, N.J. Streaming technology and services provider Kiswe has launched Kiswe Core, a next-generation cloud-based platform designed to simplify the s...

20/11/2025

Dolby Partners Up With Bay Area Super Bowl Host Committee

MOUNTAIN VIEW, Calif. Dolby Laboratories has signed on as an official signature partner of the Bay Area Host Committee (BAHC) for the 2026 Super Bowl and the we...

20/11/2025

Telus TV+ Expands Distribution to Samsung and LG Smart TVs

STUTTGART, Germany 3 Screen Solutions (3SS) has announced that the Canadian multiservice operator Telus has launched its Telus TV+ entertainment platform on Sam...

20/11/2025

MLB Strikes Rights Deals With ESPN, NBCUniversal, Netflix

Major League Baseball has announced deals with ESPN, NBCUniversal and Netflix covering 2026-2028 that make ESPN the exclusive distributor for MLB.TV, put regula...

20/11/2025

Berklee Presents Holiday Extravaganza: Duke Ellingtons The Nutcracker Suite and GenNext All-Stars' Noel

Berklee Presents Holiday Extravaganza: Duke Ellingtons The Nutcracker Suite and ...

20/11/2025

Space42 and EDGE Group Announce Strategic SATCOM Manufacturing Alliance at Dubai Airshow 2025

Dubai, United Arab Emirates [November 20, 2025] Space42 (ADX: SPACE42), the ...