
Editor's note: This post is part of Into the Omniverse, a series focused on how developers, 3D practitioners and enterprises can transform their workflows using the latest advances in Universal Scene Description (OpenUSD) and NVIDIA Omniverse.
The next frontier of AI is physical AI. Physical AI models can understand instructions and perceive, interact and perform complex actions in the real world to power autonomous machines like robots and self-driving cars.
Similar to how large language models can process and generate text, physical AI models can understand the world and generate actions. To do this, these models must be trained in simulation environments to comprehend physical dynamics, like gravity, friction or inertia - and understand geometric and spatial relationships, as well as the principles of cause and effect.
Global leaders in software development and professional services are using NVIDIA Omniverse, powered by OpenUSD, to build new products and services that will accelerate the development of AI and controllable simulations to enable the creation of true-to-reality virtual worlds, known as digital twins, that can be used to train physical AI with unprecedented accuracy and detail.
Generate Exponentially More Synthetic Data With Omniverse and NVIDIA Cosmos At CES, NVIDIA announced generative AI models and blueprints that expand Omniverse integration further into physical AI applications such as robotics, autonomous vehicles and vision AI.
Among these announcements was NVIDIA Cosmos, a platform of state-of-the-art generative world foundation models, advanced tokenizers, guardrails and an accelerated video processing pipeline - all designed to accelerate physical AI development.
Developing physical AI models is a costly, resource- and time-intensive process that requires vast amounts of real-world data and testing. Cosmos' world foundation models (WFM), which predict future world states as videos based on multimodal inputs, provide an easy way for developers to generate massive amounts of photoreal, physics-based synthetic data to train and evaluate AI for robotics, autonomous vehicles and machines. Developers can also fine-tune Cosmos WFMs to build downstream world models or improve quality and efficiency for specific physical AI use cases.
When paired with Omniverse, Cosmos creates a powerful synthetic data multiplication engine. Developers can use Omniverse to create 3D scenarios, then feed the outputs into Cosmos to generate controlled videos and variations. This can drastically accelerate the development of physical AI systems such as autonomous vehicles and robots by rapidly generating exponentially more training data covering a variety of environments and interactions.
OpenUSD ensures the data in these scenarios is seamlessly integrated and consistently represented, enhancing the realism and effectiveness of the simulations.
Leading robotics and automotive companies, including 1X, Agile Robots, Agility Robotics, Figure AI, Foretellix, Fourier, Galbot, Hillbot, IntBot, Neura Robotics, Skild AI, Virtual Incision, Waabi and XPENG, along with ridesharing giant Uber, are among the first to adopt Cosmos.
Learn more about how world foundation models will advance physical AI by listening to the NVIDIA AI Podcast episode with Ming-Yu Liu, vice president of research at NVIDIA.
See Cosmos in Action for Physical AI Use Cases Cosmos WFMs are revolutionizing industries by providing a unified framework for developing, training and deploying large-scale AI models across various applications. Enterprises in the automotive, industrial and robotics sectors can harness the power of generative physical AI and simulation to accelerate innovation and operational efficiency.
Humanoid robots: The NVIDIA Isaac GR00T Blueprint for synthetic motion generation helps developers generate massive synthetic motion datasets to train humanoid robots using imitation learning. With GR00T workflows, users can capture human actions and use Cosmos to exponentially increase the size and variety of the dataset, making it more robust for training physical AI systems.
Autonomous vehicles: Autonomous vehicle (AV) simulation powered by Omniverse Sensor RTX application programming interfaces lets AV developers replay driving data, generate new ground-truth data and perform closed-loop testing to accelerate their pipelines. With Cosmos, developers can generate synthetic driving scenarios to amplify training data by orders of magnitude, accelerating physical AI model development for autonomous vehicles. Global ridesharing giant Uber is partnering with NVIDIA to accelerate autonomous mobility. Rich driving datasets from Uber, combined with Cosmos and NVIDIA DGX Cloud, can help AV partners build stronger AI models more efficiently.
Industrial settings: Mega is an Omniverse Blueprint for developing, testing and optimizing physical AI and robot fleets at scale in a USD-based digital twin before deployment in factories and warehouses. The blueprint uses Omniverse Cloud Sensor RTX APIs to simultaneously render multisensor data from any type of intelligent machine, enabling high-fidelity sensor simulation at scale. Cosmos can enhance Mega by generating synthetic edge case scenarios to amplify training data, significantly improving the robustness and efficiency of training robots in simulation. KION Group, a supply chain solutions company, is among the first to adopt Mega to drive warehouse automation in retail, consumer packaged goods, parcel services and more.
Get Plugged Into the World of OpenUSD For more on Cosmos, watch the replay of NVIDIA CEO Jensen Huang's CES keynote, and get started with Cosmos WFMs available now under an open model license on Hugging Face and the NVIDIA NGC catalog. Join the upcoming livestream on Wednesday, February 5 for a deep dive into Cosmos WFMs and physical AI work
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
11/08/2026
Weekly immersive broadcasts will feature 8K 3D video, a 180-degree field of view...
11/08/2026
By Briana Brady, Social Media Manager, Production Hub
Sports content is having ...
11/08/2026
She addresses why media organizations need more than asset storage, how sports t...
11/08/2026
Remote commentary has improved significantly on these broadcasts
At a clip of ...
11/08/2026
A pair of LANTIME IMS M2000 PTP Grandmasters deliver resilient timing infrastruc...
11/08/2026
LTN has announced expanded capabilities for its Live Event Master Control offering, providing sports broadcasters, leagues, rights holders, and content owners w...
11/08/2026
WTA Ventures has appointed IMG as its managed production services partner in a multi-year agreement commencing with the 2027 season. The partnership is the late...
11/08/2026
The New York Jets and CBS New York have agreed to a multi-year extension of their partnership, keeping CBS New York as the official broadcast home of the team. ...
11/08/2026
Nielsen Holdings and DoubleVerify have announced a definitive agreement under which Nielsen will acquire DoubleVerify in an all-cash transaction with an enterpr...
11/08/2026
The Audio Engineering Society has announced the results of its 2026 Board of Dir...
11/08/2026
The CSN co-founder details its network and affiliate' model, how creator wi...
11/08/2026
Gravity Media is providing host broadcast operations for the Esports World Cup (EWC) 2026, supporting ESL FACEIT Group (EFG) in delivering the tournament to glo...
11/08/2026
TAG Video Systems has released a memory usage optimization for its MCM software that reduces the cost per channel by up to two-thirds for compressed workflows. ...
11/08/2026
SMT is expanding its technology partnership with the Cincinnati Open this year, adding new LED displays, production capabilities, and fan-facing experiences at ...
11/08/2026
The Pac-12 has announced that home Olympic sports broadcasts throughout the fall season will be available free on the conference's YouTube channel at youtub...
11/08/2026
Spreading a message of faith requires both widespread accessibility and uncompromising visual quality. Real Life Network (RLN), a free, faith-based digital stre...
11/08/2026
Taking the synergy of sports and entertainment a step further, the NFL venue in Nashville will house iterations of two iconic music clubs
The marriage of Taylo...
11/08/2026
Free library captures pro classical string section
There's no shortage of freebies in The Crow Hill Company's line-up, with their Vaults series offe...
11/08/2026
Percussion instrument introduces all-new engine
Emergence Audio have just introduced a instrument that brings together a vast collection of percussive analo...
11/08/2026
Introduces new all-in-one Spatial Panner tool
Boris FX have recently announced the latest major update for their mastering and broadcast-focused DAW softwar...
11/08/2026
Rohde & Schwarz installs millimeter wave security scanners at Airports of Thaila...
11/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/08/2026
farmerswife and Cirkus will return to IBC 2026 to showcase new tools designed to help broadcast, media and post-production teams manage workflows with greater s...
11/08/2026
LiveUs LU900Q intelligent production unit played a central role in the host broadcast operation for the Games in Glasgow (July 23 to August 2, 2026). The host b...
11/08/2026
Jigsaw24 has appointed James Morse as Client Director, Media Sales, as it deepens its focus on sports, live events and integrated production. His appointment co...
11/08/2026
Net Insight today announced that DMC Production Norway has selected its Open Live Media solution to centralize the production of Blinkfestivalen 2026. Combining...
11/08/2026
Modular HEVC and JPEG XS workflows enabled resilient, ultra-low-latency delivery for leading linear and digital media platforms across all 104 matches
Appear A...
11/08/2026
Homecoming Artist Spotlight: Fabiola M ndez The first cuatrista to graduate from Berklee talks about the community that shaped her career ahead of her Homecom...
11/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
11/08/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced Dalet Solution Suites, a new portfolio of cloud-native solutions ...
11/08/2026
Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, will showcase how media companies can prep...
11/08/2026
Transforming your audience into advocates with Kelsey Gamble 10 August 2026
Building community, harnessing fandom for marketing and activating the four stages ...
11/08/2026
Whether gamers are looking for high-octane action or a laid-back afternoon, Appl...
11/08/2026
Hosts D ith S and Kathryn Thomas rose to the occasion on Tuesday (August 11)...
11/08/2026
Every new generation of accelerated computing demands more from the infrastructure underneath it - more compute performance, higher rack density and more effici...
11/08/2026
A Day in May airs Wednesday 12 August at 9.35pm RT One and RT Player
A Day in May revisits the people and stories behind Ireland's historic marriage equa...
11/08/2026
As AI shifts from chatbots to autonomous agents, open models are serving market ...
11/08/2026
The open source ecosystem is making it easier for AI enthusiasts and developers to build, customize and run increasingly capable agents locally.
Throughout Au...
10/08/2026
Weekly immersive broadcasts will feature 8K 3D video, a 180-degree field of view...
10/08/2026
Saturation plug-in free until 20 August 2026
fedDSP have announced the launch of Raiju, a new guitar pedal-style saturation plug-in that's capable of de...
10/08/2026
New mix-comparison & feedback tool
Independent Swedish record label I/O Music have recently released a handy new tool that provides artists, engineers, prod...
10/08/2026
Additive soft synth gains free counterpart
Sound Radix have just released a free monophonic additive software synth that's based on the same engine as t...
10/08/2026
Chroma integrates MXO oscilloscopes into ATS 8000 platform, rounding out its hig...