Sony Pixel Power calrec Sony

NVIDIA Advances Physical AI With Accelerated Robotics Simulation on AWS

03/12/2024

Field AI is building robot brains that enable robots to autonomously manage a wide range of industrial processes. Vention creates pretrained skills to ease development of robotic tasks. And Cobot offers Proxie, an AI-powered cobot designed to handle material movement and adapt to dynamic environments, working seamlessly alongside humans.

These leading robotics startups are all making advances using NVIDIA Isaac Sim on Amazon Web Services. Isaac Sim is a reference application built on NVIDIA Omniverse for developers to simulate and test AI-driven robots in physically based virtual environments.

NVIDIA announced at AWS re:Invent today that Isaac Sim now runs on Amazon Elastic Cloud Computing (EC2) G6e instances accelerated by NVIDIA L40S GPUs. And with NVIDIA OSMO, a cloud-native orchestration platform, developers can easily manage their complex robotics workflows across their AWS computing infrastructure.

This combination of NVIDIA-accelerated hardware and software - available on the cloud - allows teams of any size to scale their physical AI workflows.

Physical AI describes AI models that can understand and interact with the physical world. It embodies the next wave of autonomous machines and robots, such as self-driving cars, industrial manipulators, mobile robots, humanoids and even robot-run infrastructure like factories and warehouses.

With physical AI, developers are embracing a three computer solution for training, simulation and inference to make breakthroughs.

Yet physical AI for robotics systems requires robust training datasets to achieve precision inference in deployment. Developing such datasets, however, and testing them in real situations can be impractical and costly.

Simulation offers an answer, as it can significantly accelerate the training, testing and deployment of AI-driven robots.

Harnessing L40S GPUs in the Cloud to Scale Robotics Simulation and Training Simulation is used to verify, validate and optimize robot designs as well as the systems and their algorithms before deployment. Simulation can also optimize facility and system designs before construction or remodeling starts for maximum efficiencies, reducing costly manufacturing change orders.

Amazon EC2 G6e instances accelerated by NVIDIA L40S GPUs provide a 2x performance gain over the prior architecture, while allowing the flexibility to scale as scene and simulation complexity grows. The instances are used to train many computer vision models that power AI-driven robots. This means the same instances can be extended for various tasks, from data generation to simulation to model training.

Using NVIDIA OSMO in the cloud allows teams to orchestrate and scale complex robotics development workflows across distributed computing resources, whether on premises or in the AWS cloud.

Isaac Sim provides access to the latest robotics simulation capabilities and the cloud, fostering collaboration. One of the critical workflows is generating synthetic data for perception model training.

Using a reference workflow that combines NVIDIA Omniverse Replicator, a framework for building custom synthetic data generation (SDG) pipelines and a core extension of Isaac Sim, with NVIDIA NIM microservices, developers can build generative AI-enabled SDG pipelines.

These include the USD Code NIM microservice for generating Python USD code and answering OpenUSD queries, and the USD Search NIM microservice for exploring OpenUSD assets using natural language or image inputs. The Edify 360 HDRi NIM microservice generates 360-degree environment maps, while the Edify 3D NIM microservice creates ready-to-edit 3D assets from text or image prompts. This eases the synthetic data generation process by reducing many tedious and manual steps, from asset creation to image augmentation, using the power of generative AI.

Rendered.ai's synthetic data engineering platform integrated with Omniverse Replicator enables companies to generate synthetic data for computer vision models used in industries from security and intelligence to manufacturing and agriculture.

SoftServe, an IT consulting and digital services provider, uses Isaac Sim to generate synthetic data and validate robots used in vertical farming with Pfeifer & Langen, a leading European food producer.

Tata Consultancy Services is building custom synthetic data generation pipelines to power its Mobility AI suite to address automotive and autonomous use cases by simulating real-world scenarios. Its applications include defect detection, end-of-line quality inspection and hazard avoidance.

Learning to Be Robots in Simulation While Isaac Sim enables developers to test and validate robots in physically accurate simulation, Isaac Lab, an open-source robot learning framework built on Isaac Sim, provides a virtual playground for building robot policies that can run on AWS Batch.

Because these simulations are repeatable, developers can easily troubleshoot and reduce the number of cycles required for validation and testing.

Several robotics developers are embracing NVIDIA Isaac on AWS to develop physical AI, such as:

Aescape's robots are able to provide precision-tailored massages by accurately modeling and tuning onboard sensors in Isaac Sim.

Cobot has used Isaac Sim with its AI-powered cobot, Proxie, to optimize logistics in warehouses, hospitals, manufacturing sites, and more.

Cohesive Robotics has integrated Isaac Sim into its software framework called Argus OS for developing and deploying robotic workcells used in high-mix manufacturing environments.

Field AI, a builder of robot foundation models, uses Isaac Sim and Isaac Lab to evaluate the performance of its models in complex, unstructured environments across industries such as construction, manufacturing, oil and gas, mining and more.

Standard Bots is simulating and validating the performance of its R01 robot used in m
LINK: https://blogs.nvidia.com/blog/physical-ai-robotics-isaac-sim-aws/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

17/01/2026

Lightware and Google enhance meeting room flexibility wit...

Lightware, an industry leader in signal management, is helping to elevate the Google Meet experience with the introduction of an integration with Taurus UCX. Th...

17/01/2026

Clear-Com Partners with NETGEAR to Deliver OEM Networking...

Clear-Com announced a strategic partnership with NETGEAR AV to offer four high-performance networking switches as original equipment manufacturer (OEM) solutio...

17/01/2026

QuickLink Expands US Reach With Midwich Distribution

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, today announced a new U.S. distribution partnership wit...

17/01/2026

NUGEN Audio Launches the Next Evolution of MasterCheck

NUGEN Audio announces the latest evolution of MasterCheck, its industry-trusted optimization plug-in for cross-platform mastering and loudness verification. Des...

17/01/2026

BHV Introduces Pro AV Market to SportsBox at ISE 2026

BHV has announced that it will highlight its new SportsBox remote vision mixer and picture processor at ISE in Booth #4H900 marking its official introduction in...

17/01/2026

Clear-Com Reveals New 4-Channel HelixNet Beltpack and Adv...

Clear-Com will return to ISE 2026 to demonstrate its latest intercom solutions for broadcast, live production, and AV professionals. Exhibiting at Stand #4P700...

17/01/2026

Grass Valley Brings Scalable Creative Freedom to Broadcas...

Grass Valley, a leading provider in live production solutions, will exhibit at ISE 2026 in Barcelona from February 3 6, presenting its vision for how modern Bro...

17/01/2026

Utelogy Advances AI and Cloud-First Innovation at ISE 202...

Utelogy Corporation, the global leader in connected workplace management, monitoring, control, automation and analytics closes out a record-breaking 2025. The c...

17/01/2026

FOR-A Europe to Demonstrate Broadcast and Pro-AV Converge...

FOR-A, a cutting-edge video broadcast technology company backed by more than 50 years experience, will showcase its innovative production solutions at ISE 2026 ...

17/01/2026

Tim Jackson Appointed Sr Director of Sales and Business D...

Techex, the UK-based expert in live video solutions over IP and cloud, today announced that Tim Jackson has joined the company as Senior Director of Sales and B...

17/01/2026

Redflag AI Joins Akamais New ISV Catalyst Program as the...

Redflag AI, an AI-powered content protection platform, and Akamai, the cybersecurity and cloud computing company that powers and protects business online, today...

17/01/2026

Encompass Digital Media Strengthens Global Operations wit...

Encompass Digital Media has today announced the appointment of David Hunter as Chief Operating Officer (COO). As a highly respected technology and operations le...

17/01/2026

Glensound highlights quality practicality and innovation...

Glensound is set to showcase its audio and intercom solutions supporting broadcast, live events and professional AV environments at ISE 2026 (stand 7H800, Fira ...

17/01/2026

Matrox Video Showcases New AV-over-IP Capabilities Drivin...

As Matrox Video marks its 50th year of innovation, the company will use ISE 2026 to showcase the latest advancements across its AV-over-IP ecosystem, highlighti...

17/01/2026

Hollywood Professional Association Unveils 2026 HPA Award...

The Hollywood Professional Association (HPA) today announced the nominees for the 2026 HPA Awards Innovation & Technology, marking an expanded evolution of the ...

17/01/2026

Sinclair Asks FCC to Approve Nexstar/Tegna Deal

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/01/2026

From Berlin to London: Amazon Prime Video Delivers NBA Europe Games to Global Audience

From Berlin to London: Amazon delivers NBA Europe games for an international aud...

16/01/2026

How Vizrt, TriCaster Helped Harvard Athletics Embrace Vertical Video and More to Serve Fans

How Vizrt, TriCaster Helped Harvard Athletics Embrace Vertical Video and More to...

16/01/2026

SVG GameDay, Ep. 1: PMY Group's Mike Bonner

SVG GameDay, Ep. 1: PMY Group's Mike BonnerThe longtime industry veteran provides insight into his approach to producing live eventsBy Kristian Hern ndez, S...

16/01/2026

Attacking the Pin: Inside the PGA TOUR's Replay Remodel With Hawk-Eye Innovations

Attacking the Pin: Inside the PGA TOUR's Replay Remodel With Hawk-Eye Innova...

16/01/2026

Back to Unrivaled: TNT Sports Reconnects With Mediapro for the League's Sophomore Season

Back to Unrivaled: TNT Sports Reconnects With Mediapro for the League's Soph...

16/01/2026

FloSports Orchestrates Mega Weekend Spotlighted by Chili Bowl Nationals, UCA & UDA College Nationals

FloSports Orchestrates Mega Weekend Spotlighted by Chili Bowl Nationals, UCA & U...

16/01/2026

Sundance Institute Names 2026 Screenwriters Lab and Screenwriters Intensive Fellows

Eleven Projects to Be Developed at Annual January Screenwriters Lab; Nine Projec...

16/01/2026

5 Audiobooks to Help You Level Up in 2026

The start of a new year brings fresh possibilities. Whether you're diving in with big goals or simply setting new intentions, audiobooks can bring inspirati...

16/01/2026

1 Year In: How Creators Are Growing Their Shows and Connecting With Audiences Through the Spotify Partner Program

In 2025 we launched the Spotify Partner Program to give creators more ways to tu...

16/01/2026

NAB Spokesman Alex Siciliano to Depart

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/01/2026

Marshall Electronics Showcases the VMV 402 3GSH Seamless...

Marshall Electronics is showcasing its VMV-402-3GSH Seamless 4X Switch at ISE 2026 (Booth 4N900). Designed for presentation systems, control rooms and remote pr...

16/01/2026

HPA Announces Innovation & Technology Award Nominees

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

16/01/2026

Graduate Spotlight: Nadia Castagna

Graduate Spotlight: Nadia Castagna The educator, who grew up in Rochester, New York, shares how she went from Berklee to collaborating on meaningful programs ...

16/01/2026

Culinary Class Wars' Returns for Season 3, Raising the Stakes With a Team-Based Showdown

Back to All News Culinary Class Wars' Returns for Season 3, Raising the St...

15/01/2026

Milano Cortina 2026: OBS CEO Yiannis Exarchos Previews Production Innovations

Milano Cortina 2026: OBS CEO Yiannis Exarchos Previews Production InnovationsFirst Person View drones, AI-based tech target greater fan engagement, efficiencyBy...

15/01/2026

Clever With Cameras: Bringing the Drama of the 2026 ISU European Figure Skating Championships to Viewers with Sunset+Vine

Clever with cameras: Bringing the drama of the 2026 ISU European Figure Skating ...

15/01/2026

No Stranger to Ice: Host Broadcaster Sunset+Vine on Pressure and Planning for the 2026 ISU European Figure Skating Championships

No stranger to ice: Host broadcaster Sunset Vine on pressure and planning for th...

15/01/2026

SVG Campus Shot Callers: Leah Gill, Associate Athletic Director, Digital Media, University of Tennessee at Chattanooga

SVG Campus Shot Callers: Leah Gill, Associate Athletic Director, Digital Media, ...

15/01/2026

National Sports Broadcaster Perspectives: What to Expect in Production in 2026

National Sports Broadcaster Perspectives: What to Expect in Production in 2026Leaders from ESPN, FOX Sports, Netflix, and Warner Bros. Discovery share their pro...

15/01/2026

From Berlin to London: Amazon Delivers NBA Europe Games for an International Audience

From Berlin to London: Amazon delivers NBA Europe games for an international aud...

15/01/2026

Sundance Institute Appoints David Linde as CEO

LOS ANGELES, CA, January 15, 2026 - The nonprofit Sundance Institute today announced the appointment of David Linde as Chief Executive Officer. Linde will assum...

15/01/2026

Excellent training at SGL Carbons Bonn site

The SGL Carbon site in Bonn has a long tradition of training. For many years, young talent has been successfully trained here, regularly achieving excellent exa...

15/01/2026

SGL Carbon and BMW Group receive JEC Innovation Award for Natural Fiber Composites Project

The JEC Composites Innovation Awards annually honor the most innovative and ambi...

15/01/2026

SGL Carbon signs long-term supply agreement with X-energy

X-energy Reactor Company, LLC ( X-energy ) and SGL Carbon LLC ( SGL ) have signed a 10-year framework agreement to provide graphite for the deployment of X-ener...

15/01/2026

Versant Completes Acquisition Of Free TV Networks

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

House Oversight Hearing on FCC Puts Chair in Spotlight

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

Radiant Media Player, Cloud DRM Partner on Integration

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

Telycam to Showcase New Mix One Video Switcher at ISE 2026

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

Pliant Names Adam Grede as Regional Sales Manager

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...

15/01/2026

NFL Wild Card Games Score With Viewers

Share Share by: Copy link Facebook X Whatsapp Pinterest Flipboard...