Sony Pixel Power calrec Sony

AI Gets Physical: New NVIDIA NIM Microservices Bring Generative AI to Digital Environments

29/07/2024

Millions of people already use generative AI to assist in writing and learning. Now, the technology can also help them more effectively navigate the physical world.

NVIDIA announced at SIGGRAPH generative physical AI advancements including the NVIDIA Metropolis reference workflow for building interactive visual AI agents and new NVIDIA NIM microservices that will help developers train physical machines and improve how they handle complex tasks.

These include three fVDB NIM microservices that support NVIDIA's new deep learning framework for 3D worlds, as well as the USD Code, USD Search and USD Validate NIM microservices for working with Universal Scene Description (aka OpenUSD).

The NVIDIA OpenUSD NIM microservices work together with the world's first generative AI models for OpenUSD development - also developed by NVIDIA - to enable developers to incorporate generative AI copilots and agents into USD workflows and broaden the possibilities of 3D worlds.

NVIDIA NIM Microservices Transform Physical AI Landscapes Physical AI uses advanced simulations and learning methods to help robots and other industrial automation more effectively perceive, reason and navigate their surroundings. The technology is transforming industries like manufacturing and healthcare, and advancing smart spaces with robots, factory and warehouse technologies, surgical AI agents and cars that can operate more autonomously and precisely.

NVIDIA offers a broad range of NIM microservices customized for specific models and industry domains. NVIDIA's suite of NIM microservices tailored for physical AI supports capabilities for speech and translation, vision and intelligence, and realistic animation and behavior.

Turning Visual AI Agents Into Visionaries With NVIDIA NIM Visual AI agents use computer vision capabilities to perceive and interact with the physical world and perform reasoning tasks.

Highly perceptive and interactive visual AI agents are powered by a new class of generative AI models called vision language models (VLMs), which bridge digital perception and real-world interaction in physical AI workloads to enable enhanced decision-making, accuracy, interactivity and performance. With VLMs, developers can build vision AI agents that can more effectively handle challenging tasks, even in complex environments.

Generative AI-powered visual AI agents are rapidly being deployed across hospitals, factories, warehouses, retail stores, airports, traffic intersections and more.

To help physical AI developers more easily build high-performing, custom visual AI agents, NVIDIA offers NIM microservices and reference workflows for physical AI. The NVIDIA Metropolis reference workflow provides a simple, structured approach for customizing, building and deploying visual AI agents, as detailed in the blog.

NVIDIA NIM Helps K2K Make Palermo More Efficient, Safe and Secure City traffic managers in Palermo, Italy, deployed visual AI agents using NVIDIA NIM to uncover physical insights that help them better manage roadways.

K2K, an NVIDIA Metropolis partner, is leading the effort, integrating NVIDIA NIM microservices and VLMs into AI agents that analyze the city's live traffic cameras in real time. City officials can ask the agents questions in natural language and receive fast, accurate insights on street activity and suggestions on how to improve the city's operations, like adjusting traffic light timing.

Leading global electronics giants Foxconn and Pegatron have adopted physical AI, NIM microservices and Metropolis reference workflows to more efficiently design and run their massive manufacturing operations.

The companies are building virtual factories in simulation to save significant time and costs. They're also running more thorough tests and refinements for their physical AI - including AI multi-camera and visual AI agents - in digital twins before real-world deployment, improving worker safety and leading to operational efficiencies.

Bridging the Simulation-to-Reality Gap With Synthetic Data Generation Many AI-driven businesses are now adopting a simulation-first approach for generative physical AI projects involving real-world industrial automation.

Manufacturing, factory logistics and robotics companies need to manage intricate human-worker interactions, advanced facilities and expensive equipment. NVIDIA physical AI software, tools and platforms - including physical AI and VLM NIM microservices, reference workflows and fVDB - can help them streamline the highly complex engineering required to create digital representations or virtual environments that accurately mimic real-world conditions.

VLMs are seeing widespread adoption across industries because of their ability to generate highly realistic imagery. However, these models can be challenging to train because of the immense volume of data required to create an accurate physical AI model.

Synthetic data generated from digital twins using computer simulations offers a powerful alternative to real-world datasets, which can be expensive - and sometimes impossible - to acquire for model training, depending on the use case.

Tools like NVIDIA NIM microservices and Omniverse Replicator let developers build generative AI-enabled synthetic data pipelines to accelerate the creation of robust, diverse datasets for training physical AI. This enhances the adaptability and performance of models such as VLMs, enabling them to generalize more effectively across industries and use cases.

Availability Developers can access state-of-the-art, open and NVIDIA-built foundation AI models and NIM microservices at ai.nvidia.com. The Metropolis NIM reference workflow is available in the GitHub repository, and Metropolis VIA microservices are available for download in developer preview.

OpenUSD NIM microservices are available in preview through the NVI
LINK: https://blogs.nvidia.com/blog/generative-physical-ai-nim-microservices...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

15/10/2025

Reporting that changes lives: Announcing the Young Journalist finalists 2025

Across the world, early-career reporters are interrogating systems that shape daily life, from mortuaries and classrooms to the corridors of legal education and...

15/10/2025

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open Video

St. Louis Blues Pay Tribute to Ozzy Osbourne in New Pregame Open VideoThe NHL franchise worked with production firms 2WEI and 4th Floor CreativeBy Mark J Burns,...

15/10/2025

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsorships

Cobalt Digital, G3DVu, Proxima Vision, and Telos Alliance Renew Premier Sponsors...

15/10/2025

The Remaining Native Team on the Sundance Institute Labs, Community and More

By Paige Bethmann Before my grandmother passed away in 2019, I went to visit her in the hospital where she'd been for a few weeks. When I arrived, the nurs...

15/10/2025

Spotify Celebrates Two Years of Audiobooks in Premium, Fueling Growth and Discovery Across the Publishing World

Two years ago, Spotify set out to grow the entire publishing industry by making ...

15/10/2025

DJ Levels Up With Spanish-Language Requests, Text Requests, and Personalized Prompts

People turn to DJ for a listening experience that feels personal, dynamic, and j...

15/10/2025

DJ evoluciona con solicitudes en espaol, peticiones por texto y recomendaciones personalizadas

Las personas recurren a DJ para vivir una experiencia de escucha personal, din m...

15/10/2025

Bruce Springsteen and Jeremy Allen White Unite in London for an Exclusive Spotify Conversation and Film Preview

Rock legend Bruce Springsteen and luminary actor Jeremy Allen White came togethe...

15/10/2025

Meet Spotify's RADAR Creators Global Class of 2025, the Next Wave of Podcast Talent

At Spotify, we're all about supporting rising talent and helping them connec...

15/10/2025

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS On Demand

New SBS Documentary Series THE CANCER KILLERS Premieres 4 November on SBS & SBS ...

15/10/2025

SBS celebrates the Festivals of Lights with bold, illuminating stories across the network

SBS celebrates the Festivals of Lights with bold, illuminating stories across th...

15/10/2025

Seeking Astrobiological Potential Millions of Miles from Earth

One of humanity's most profound questions continues: Is there any place in our galaxy suitable for life beyond Earth? NASA intends to find out, with the hel...

15/10/2025

Austin PBS Expands Facility-Wide Production Communications with Clear-Com

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

15/10/2025

Scality debuts industry-first AI certifications with more...

Scality, a global leader in cyber-resilient storage software for the AI era, today announced the advancement of its comprehensive AI ecosystem certification pro...

15/10/2025

2026 HPA Tech Retreat to Deliver Insight Innovation and I...

The Hollywood Professional Association (HPA) today unveiled key highlights of the 2026 HPA Tech Retreat, scheduled for Feb. 15 19 at the Westin Rancho Mirage Go...

15/10/2025

Interra Systems Drives Quality Compliance and Monetizatio...

At NAB Show New York 2025 (Stand 244), Interra Systems will showcase the future of media QC, monitoring, and captioning, highlighting its award-winning, AI- and...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transitio...

Grass Valley today announced that RMC BFM, part of the CMA-CGM Group and France's third-largest private media group, has chosen Grass Valley's productio...

15/10/2025

Appear to Showcase Next-Generation Hybrid Live Production...

Appear, the global leader in live production technology, will demonstrate how its powerful hardware and software innovations are shaping the future of hybrid, s...

15/10/2025

Rakim to Join Berklee's Hip-Hop Hall of Fame at Signature Series Concert

Rakim to Join Berklee's Hip-Hop Hall of Fame at Signature Series Concert The rap icon becomes the latest inductee, following luminaries such as Roxanne Sh...

15/10/2025

Berklee Brings Live Music to the Head of the Charles

Berklee Brings Live Music to the Head of the Charles Student artists will perform on multiple riverfront stages during the 60th anniversary of the world's...

15/10/2025

CobbTV Taps Pebble for Playout Automation

CobbTV, the government access television channel for Cobb County, Ga. recently acquired an automated playout system from Pebble, a global provider of automation...

15/10/2025

Appear to Showcase Next-Generation Hybrid Live Production at NAB Show NY

OSLO, Norway Appear, the global leader in live production technology, will demonstrate how its powerful hardware and software innovations are shaping the future...

15/10/2025

NBA Unveils Updated NBA App and Reimagined' NBA TV

NEW YORK The NBA is making major changes to the NBA App and NBA TV as it takes control of them from TNT Sports, which has long managed the league's digital ...

15/10/2025

DirecTV Announces Major Expansion of Interactive AI-Powered Features

SAN MATEO, Calif. In what promises to be a major expansion of interactive features and personalized content on the DirecTV platform, the operator and Glance hav...

15/10/2025

Roku Upgrades User Interface to Showcase Original Content

SAN JOSE, Calif. Roku has launched changes to its user interface (UI) that the streaming platform says will better showcase original programming on the platform...

15/10/2025

OpenDrives Promotes Alex Dunfey to CTO

LOS ANGELES Software-defined data storage and data services provider OpenDrives has elevated Alex Dunfey to chief technology officer, responsible for driving th...

15/10/2025

Space42 and Autonomous A2Z Partner to Advance Smart Mobility Ecosystem in the UAE

Abu Dhabi, UAE October 15, 2025: Space42 (ADX: SPACE42), the UAE-based AI-powe...

15/10/2025

Third series of Dream Car Fixers confirmed for U and U&YESTERDAY

Sheldon Nichols and Will Trickett to find and prepare more classic cars for budget conscious would-be owners from Wiser Films UKTV have recommissioned the clas...

15/10/2025

Sky celebrates Nick Cave in upcoming one-off special, The Veiled World of Nick Cave (w/t)

Wednesday 15 October 2025 Nick Cave JPEG (275 KB) Explore the creative univer...

15/10/2025

The Textorcist: Brits confess their scariest messaging moments

Wednesday 15 October 2025 From breaking up with your partner to quitting your job - new polling shows some messages are just too scary to send Over a fifth (...

15/10/2025

Rohde & Schwarz unveils compact MXO 3 oscilloscopes with 4 and 8 channels: Advanced performance meets affordability

Rohde & Schwarz unveils compact MXO 3 oscilloscopes with 4 and 8 channels: Advan...

15/10/2025

Revenge Series The Resurrected' Captivates Audiences Across Asia

Back to All News Revenge Series The Resurrected' Captivates Audiences Across Asia Entertainment 15 October 2025 GlobalTaiwan Link copied to clipboard ...

15/10/2025

Bringing the Best in VFX and Virtual Production Together as Eyeline

Back to All News Bringing the Best in VFX and Virtual Production Together as Eyeline Jeffrey Shapiro CEO, Eyeline Business 15 October 2025 GlobalCanadaInd...

15/10/2025

NESN Redefines Regional Sports Video Delivery with Harmonic

Deployed by Astound Business Solutions, Harmonic's Primary Distribution Solution Ensures Outstanding Video Quality and Seamless Ad Insertion at the Edge SA...

15/10/2025

RMC BFM Group Selects Grass Valley to Power its Transition to IP and UHD Production

Collaboration extends a trusted relationship as RMC BFM invests in scalable, fut...

15/10/2025

First look at new RT comedy-drama These Sacred Vows

Series coming in 2026 stars Tom Vaughan-Lawlor, Justine Mitchell and Jason O'Mara released today RT today released first look images of new comedy-drama ...

14/10/2025

SVG Europe Summit 2025: All Sessions Now Available to Watch on SVG PLAY

SVG Europe Summit 2025: All Sessions Now Available to Watch on SVG PLAYNetworking event that preceded IBC2025 shone a light on elite live sports innovation acro...

14/10/2025

SVG Sit-Down: Author Rich Podolsky on Writing Madden & Summerall: How They Revolutionized NFL Broadcasting'

SVG Sit-Down: Author Rich Podolsky on Writing Madden & Summerall: How They Revo...

14/10/2025

SVG All-Stars: Michael Reiners, Coordinating Producer, FloRacing

SVG All-Stars: Michael Reiners, Coordinating Producer, FloRacingThe Illinois State grad steers a vast schedule of motorsports events at tracks across the countr...

14/10/2025

Content Protection: Getting the Right Management for Your DRM

Content protection: Getting the right management for your DRM By Neal Romanek Friday, October 10, 2025 - 10:11 Print This Story Eluvio power the EPCR'...

14/10/2025

As League Takes Over Ops, NBA TV and NBA App Add 60 Games, Weekday Studio Show, Global Matchups, and More

As League Takes Over Ops, NBA TV and NBA App Add 60 Games, Weekday Studio Show, ...

14/10/2025

Time and Effort: World's Largest Student-Led Broadcast Prepares to Go On Air for 24 Hours this Week

Time and effort: World's largest student-led broadcast prepares to go On Air...

14/10/2025

The Perfect Neighbor Takes a Novel Approach to Examining America's Race and Gun Violence

(L-R) Guest, Kimberly Robinson Jones, Geeta Gandbhir, Pamela Dias, and Takema Ro...

14/10/2025

Spotify Premium bietet jetzt verlustfreies Audio fr ein detailreicheres Hrerlebnis

Lossless ist jetzt mit Spotify Premium verf gbar. Verlustfreies Audio war eine...

14/10/2025

La qualit Lossless arrive sur Spotify Premium, pour une exprience d'coute plus riche

La qualit Lossless est disponible sur Spotify Premium. Le format sans perte de...

14/10/2025

Ed Sheeran's Play' Hits the Pitch as Spotify and FC Barcelona Launch Latest El Clsico Jersey Takeover

For the seventh edition of Spotify and FC Barcelona's artist jersey series, ...

14/10/2025

Spotify Expands Managed Accounts for Young Listeners on Premium Family Plans

Spotify is committed to bringing the best listening experience to all our users, and that includes parents and families. That's why we're expanding mana...

14/10/2025

Spotify's Fiction Podcast Caso 63' Reaches an Epic Conclusion

Since its debut, the Spotify Original podcast Caso 63 has been more than just a story; it's been a cultural sensation. The science fiction thriller captivat...