NVIDIA Agent Toolkit Expands With New Omniverse Libraries, Putting AI Agents to Work Building Simulation-Ready Worlds

NVIDIA Agent Toolkit Expands With New Omniverse Libraries, Putting AI Agents to Work Building Simulation-Ready Worlds

Brie Clayton July 27, 2026

0 Comments

NVIDIA Agent Toolkit now includes NVIDIA Omniverse libraries, giving AI agents tools and skills to help software developers integrate physical AI capabilities into their existing applications.

New Omniverse libraries for NVIDIA RTX sensor simulation, GPU-accelerated physics simulation and simulation-ready asset validation are openly available on GitHub.

SideFX and PTC are integrating Omniverse libraries into 3D applications for physical AI, with support for cloud and local AI systems, from NVIDIA RTX Spark to NVIDIA DGX Station.

New NVIDIA blueprint for integrating Omniverse libraries in Blender.

NVIDIA has announced that NVIDIA Agent Toolkit now includes NVIDIA Omniverse libraries - a collection of software components that give AI agents tools and skills to add physical AI capabilities to existing applications and prepare 3D content for simulation.

Robots, factories and autonomous systems need to be designed, tested and trained in simulation before they operate in the real world. Preparing 3D content for simulation takes more than realistic visuals - assets need the right structure, materials, scale, labels, sensors and physical properties. With NVIDIA Omniverse libraries in NVIDIA Agent Toolkit, AI agents have the tools and skills to build workflows, inspect scenes, flag issues and prepare assets, helping developers move faster from 3D content to simulation-ready environments.

The physical AI era will be built in simulation first, said Jensen Huang, founder and CEO of NVIDIA. NVIDIA Agent Toolkit with Omniverse libraries brings AI agents into the 3D tools developers already use, helping build the simulation-ready worlds where robots, factories and autonomous systems are trained and tested long before they reach the real world.

Software makers including SideFX and PTC are integrating Omniverse libraries for agent-ready sensor simulation, physics and asset validation, helping bring agentic AI into the applications and workflows developers and technical artists already use to prepare 3D content.

Omniverse Libraries Bring Physical AI Skills to NVIDIA Agent Toolkit NVIDIA Agent Toolkit helps software makers build AI agents that connect tools, skills and data sources. Omniverse libraries extend those agents into 3D and physical AI workflows with callable tools for sensor simulation, GPU-accelerated physics and simulation-ready asset validation inside existing applications.

The new Omniverse libraries - including ovrtx, ovphysx and CAD-to-SimReady skills - are openly available on GitHub, giving AI agents tools to build workflows for inspecting scenes, testing changes and preparing 3D assets for simulation. A new blueprint for integrating Omniverse libraries in Blender is also now available on GitHub.

The libraries' key capabilities include:

NVIDIA RTX sensor simulation: ovrtx helps applications generate camera, lidar, radar and other sensor outputs from 3D scenes, so developers and AI agents can test how physical AI systems may perceive virtual environments.

Physical behavior: ovphysx uses GPU-accelerated physics to bring realistic behavior to 3D scenes using properties such as collisions, mass, friction and motion, so teams can first test how objects and systems interact in simulation.

Simulation-ready 3D objects: CAD-to-SimReady skills help convert computer-aided design (CAD) data to SimReady assets built on OpenUSD, giving 3D content the properties needed for physical AI simulation and virtual testing.

Software Makers Build With Omniverse Libraries Software makers including SideFX and PTC, as well as startups ForgeCAD, Lightwheel, Moonlake AI and Palatial, are among the first to adopt and build with Omniverse libraries, now part of NVIDIA Agent Toolkit.

SideFX is using OpenUSD workflows, as well as ovrtx and ovphysx libraries, to explore how agents can help integrate Omniverse libraries into its Houdini procedural 3D content creation workflows, giving technical artists a path to generate, test physics and prepare content for simulation.

Procedural 3D creation is essential to building the complex, controllable worlds needed for simulation, robotics and industrial AI, said Kim Davidson, president and CEO of SideFX. With NVIDIA Omniverse libraries and OpenUSD, SideFX is exploring how agent-ready tools can support Houdini workflows, helping technical artists review, test and prepare procedural content for simulation while staying in control of the creative process.

The PTC Onshape CAD and product data management (PDM) platform is using OpenUSD and ovrtx to connect cloud-native design workflows with physical simulation, helping product design content stay connected with CAD, PDM, collaboration and simulation workflows.

Engineering teams are seeking more connected ways to design, collaborate and simulate throughout the development process, said Neil Barua, president and CEO of PTC. PTC's work with NVIDIA supports that broader vision, while NVIDIA Omniverse libraries help enable simulation-ready workflows that bring validation and testing closer to where products are designed.

On display at SIGGRAPH, SimReady Blender is a sample workflow built in Blender with NVIDIA Omniverse libraries and NVIDIA NemoClaw , showing how software makers can add agent-ready simulation capabilities - including NVIDIA RTX sensor simulation, physics and validation - into existing 3D applications while keeping creators in control. This is now openly available as a blueprint for integrating Omniverse libraries in Blender.

The demo also previews how these workflows, built with Omniverse libraries as part of NVIDIA Agent Toolkit, can run locally, from compact RTX-powered systems with NVIDIA RTX Spark to NVIDIA GB300-po

LINK:	https://creativecow.net/nvidia-agent-toolkit-expands-with-new-omnivers...
	See more stories from creativecow

North America Stories