Sony Pixel Power calrec Sony

NVIDIA Advances Robot Learning and Humanoid Development With New AI and Simulation Tools

06/11/2024

www.1x.tech

Robotics developers can greatly accelerate their work on AI-enabled robots, including humanoids, using new AI and simulation tools and workflows that NVIDIA revealed this week at the Conference for Robot Learning (CoRL) in Munich, Germany.

The lineup includes the general availability of the NVIDIA Isaac Lab robot learning framework; six new humanoid robot learning workflows for Project GR00T, an initiative to accelerate humanoid robot development; and new world-model development tools for video data curation and processing, including the NVIDIA Cosmos tokenizer and NVIDIA NeMo Curator for video processing.

The open-source Cosmos tokenizer provides robotics developers superior visual tokenization by breaking down images and videos into high-quality tokens with exceptionally high compression rates. It runs up to 12x faster than current tokenizers, while NeMo Curator provides video processing curation up to 7x faster than unoptimized pipelines.

Also timed with CoRL, NVIDIA presented 23 papers and nine workshops related to robot learning and released training and workflow guides for developers. Further, Hugging Face and NVIDIA announced they're collaborating to accelerate open-source robotics research with LeRobot, NVIDIA Isaac Lab and NVIDIA Jetson for the developer community.

Accelerating Robot Development With Isaac Lab NVIDIA Isaac Lab is an open-source, robot learning framework built on NVIDIA Omniverse, a platform for developing OpenUSD applications for industrial digitalization and physical AI simulation.

Developers can use Isaac Lab to train robot policies at scale. This open-source unified robot learning framework applies to any embodiment - from humanoids to quadrupeds to collaborative robots - to handle increasingly complex movements and interactions.

Leading commercial robot makers, robotics application developers and robotics research entities around the world are adopting Isaac Lab, including 1X, Agility Robotics, The AI Institute, Berkeley Humanoid, Boston Dynamics, Field AI, Fourier, Galbot, Mentee Robotics, Skild AI, Swiss-Mile, Unitree Robotics and XPENG Robotics.

Project GR00T: Foundations for General-Purpose Humanoid Robots Building advanced humanoids is extremely difficult, demanding multilayer technological and interdisciplinary approaches to make the robots perceive, move and learn skills effectively for human-robot and robot-environment interactions.

Project GR00T is an initiative to develop accelerated libraries, foundation models and data pipelines to accelerate the global humanoid robot developer ecosystem.

Six new Project GR00T workflows provide humanoid developers with blueprints to realize the most challenging humanoid robot capabilities. They include:

GR00T-Gen for building generative AI-powered, OpenUSD-based 3D environments

GR00T-Mimic for robot motion and trajectory generation

GR00T-Dexterity for robot dexterous manipulation

GR00T-Control for whole-body control

GR00T-Mobility for robot locomotion and navigation

GR00T-Perception for multimodal sensing

Humanoid robots are the next wave of embodied AI, said Jim Fan, senior research manager of embodied AI at NVIDIA. NVIDIA research and engineering teams are collaborating across the company and our developer ecosystem to build Project GR00T to help advance the progress and development of global humanoid robot developers.

New Development Tools for World Model Builders Today, robot developers are building world models - AI representations of the world that can predict how objects and environments respond to a robot's actions. Building these world models is incredibly compute- and data-intensive, with models requiring thousands of hours of real-world, curated image or video data.

NVIDIA Cosmos tokenizers provide efficient, high-quality encoding and decoding to simplify the development of these world models. They set a new standard of minimal distortion and temporal instability, enabling high-quality video and image reconstructions.

Providing high-quality compression and up to 12x faster visual reconstruction, the Cosmos tokenizer paves the path for scalable, robust and efficient development of generative applications across a broad spectrum of visual domains.

1X, a humanoid robot company, has updated the 1X World Model Challenge dataset to use the Cosmos tokenizer.

NVIDIA Cosmos tokenizer achieves really high temporal and spatial compression of our data while still retaining visual fidelity, said Eric Jang, vice president of AI at 1X Technologies. This allows us to train world models with long horizon video generation in an even more compute-efficient manner.

Other humanoid and general-purpose robot developers, including XPENG Robotics and Hillbot, are developing with the NVIDIA Cosmos tokenizer to manage high-resolution images and videos.

NeMo Curator now includes a video processing pipeline. This enables robot developers to improve their world-model accuracy by processing large-scale text, image and video data.

Curating video data poses challenges due to its massive size, requiring scalable pipelines and efficient orchestration for load balancing across GPUs. Additionally, models for filtering, captioning and embedding need optimization to maximize throughput.

NeMo Curator overcomes these challenges by streamlining data curation with automatic pipeline orchestration, reducing processing time significantly. It supports linear scaling across multi-node, multi-GPU systems, efficiently handling over 100 petabytes of data. This simplifies AI development, reduces costs and accelerates time to market.

Advancing the Robot Learning Community at CoRL The nearly two dozen research papers the NVIDIA robotics team released with CoRL cover breakthroughs in integrating vision language models for improved environmental understanding and task execution, temporal robot navigati
LINK: https://blogs.nvidia.com/blog/robot-learning-humanoid-development/...
See more stories from nvidia

North America Stories

09/04/2026

BIA Increases 2026 Local Ad Forecast to $184.5 Billion

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Yospace surpasses 10 billion ads stitched in a single mon...

Yospace exceeded 10 billion dynamically stitched ads in a single month, reaching 11.6 billion as ad-supported streaming surged. Driven by a packed global sports...

09/04/2026

Bitmovin Expands Live Encoding and Observability Solution...

Bitmovin has expanded its Live Encoding and Observability solutions to provide true end to end, real time insights across live streaming workflows, from encodin...

09/04/2026

Leyra Powers the Launch of Icelandic Broadcaster RUVs Str...

Leyra has announced the launch of Icelandic public broadcaster R V's streaming service on Samsung and LG Smart TVs. R V is the first public broadcaster to d...

09/04/2026

3Play Media Launches AI Dubbing Solution for YouTube Crea...

3Play Media, a global leader in video accessibility and localization, today announced an AI Dubbing solution purpose-built for YouTube creators. The company, wh...

09/04/2026

Big Blue Marble Recognized as AWS Managed Services Provid...

Big Blue Marble, a provider of broadcast-grade, cloud-native video solutions, has been recognized as an Amazon Web Services (AWS) Managed Services Provider (MSP...

09/04/2026

PDC Cleeng and Urban Zoo partner to launch new global str...

The Professional Darts Corporation (PDC) has officially launched its revamped global streaming service, PDC TV, in collaboration with Cleeng and sports technolo...

09/04/2026

Cleeng launches industry first cross-platform AI agents t...

Cleeng, the Subscriber Retention Management (SRM ) pioneer, today announced a raft of new AI agents for its AI Assistant to accelerate decision-making and autom...

09/04/2026

Hearst Taps Merzigo to Expand Presence on YouTube, Facebook

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Fox Jumps Into Prediction Markets with Kalshi Integration

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

NAB Show: Kokusai Denki To Feature New, Affordable 4K Broadcast Camera

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Corus Taps Appear for IP-First Operations

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

2026 NAB Show Exhibitor Insights: Big Blue Marble

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

FCC Extends Audible Crawl Rule Waiver for 18 Months

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Pliant Technologies Showcases Expanded Accessories at NAB...

New Charging, Connectivity, and Mounting Solutions Now Available LAS VEGAS, APRIL 8, 2026 Pliant Technologies will highlight a range of new accessories at th...

09/04/2026

Media Links Brings Ultra Resilient IP Transport Proven at...

As live production continues its shift to IP, the challenge is no longer adoption it's reliability. At NAB Show 2026 (Booth W2033), Media Links will demon...

09/04/2026

QuickLink Launches StudioPro Town Hall at 2026 NAB Show

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, launches its new AI-powered add-on for its StudioPro p...

09/04/2026

The Hive Group Releases White Paper on the FCC Upper C-Ba...

The Hive Group has published a new white paper, No Safe Harbor: Why the FCC's Upper C-Band Auction Demands Early Action from Broadcasters ahead of NAB Sho...

09/04/2026

Saranyu Technologies Renews VisualOn Optimizer VoD Subscr...

Saranyu Technologies today announced the renewal of its Optimizer VoD subscription with VisualOn. The announcement coincides with NAB Show 2026, taking place Ap...

09/04/2026

Strength and Destiny Collide: Samson: A Tyndalston Story' Arrives in the Cloud

A timeless story of grit, faith and rebellion takes center stage as Samson: A Ty...

09/04/2026

April 08, 2026

New technique for synthesizing branched molecules could accelerate the development of future medicines Scripps Research chemists solve a longstanding problem in...

08/04/2026

SVG College Sports Media Awards 2026: Entry Deadline is Monday, April 13

The deadline to enter the 18th Annual SVG College Sports Media Awards in association with NACDA is rapidly approaching! Submit your entries to this year's c...

08/04/2026

SVG Campus Shot Callers: Trever Sheets, Senior Director, ACC Network, Virginia Tech

The Pittsburgh product helps lead more than 100 annual ESPN broadcasts as part o...

08/04/2026

SVG Sit-Down: Harmonic's Jean Macher on Turning Live Sports Content Into a Smarter Monetization Engine

Dynamic ad insertion, AI-based technologies, programmatic advertising are some o...

08/04/2026

Announcing the 2026 Fellows for the Sundance Institute Cultural Impact Residency on Sundance Collab

Seven Fellows Selected for Second Year of Residency in Honor of Social Justice L...

08/04/2026

YEP September 2025 Newsletter (2)

The September 19, 2025 YEP Newsletter highlights a group visit to the Academy Museum of Motion Pictures, where participants explored exhibits showcasing the art...

08/04/2026

Proven On Orbit: L3Harris Congratulates Missile Defense Agency for Receiving Top Defense Honor for HBTSS

The L3Harris HBTSS satellite is proven on orbit, successfully demonstrating trac...

08/04/2026

From Earth to Mars: Resilient Communications Powering the Space Economy

Image Credit: NASA. Artist rendering of a space communications satellite in orbit, representative of the resilient, multiband infrastructure supporting mission ...

08/04/2026

Precision in Practice: Flight Test Confirms Key Air-to-Air Capabilities

Latest evaluation validates image quality, Inertial Navigation System performance and long-range tracking in operational flight conditions....

08/04/2026

Gen Alpha Leads Shift to AI-Powered Entertainment Search, Discovery and Recommendations

New Gracenote study finds behavioral change well underway, but trust in AI-gener...

08/04/2026

Media Links to Focus on IP Transport Solutions at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Telestream and Mimir Integration Facilitates Real-Time Pr...

Integration eliminates ingest bottlenecks by ensuring content is immediately usable across cloud and hybrid editorial workflows. See it at NAB 2026. Nevada Cit...

08/04/2026

Dalet Announces Commercial Availability of Dalia Bringing...

Dalet, a leading technology and service provider for media-rich organizations, today announced the commercial availability of Dalia, its media-aware, agentic AI...

08/04/2026

Synamedia unveils Senza Ignite to transform deployed devi...

Leading video software provider Synamedia today announced Senza Ignite, a cloud-based platform that transforms existing connected devices through a single firmw...

08/04/2026

Appear works with Corus to transform national news contri...

Modernised architecture increases operational control and agility, while reducing cost and simplifying nationwide media transport across affiliates and news bur...

08/04/2026

LynTec to Showcase High Density Power Control Solutions f...

Company to Feature DMX Dual Relay, High-Density 48-Channel Relay Panels, and New Private Label Power Program LynTec, a leading manufacturer of innovative ele...

08/04/2026

BCE integrates BCNEXXT Vipe to power cloud playout in Med...

Broadcasting Center Europe (BCE), a European media technology and services partner, today announces a technology partnership with BCNEXXT, a Netherlands-based c...

08/04/2026

Encompass Strengthens Global Media Operations with Expans...

Encompass Digital Media today announced the expansion of its Master Control Room (MCR) facility in Riga, Latvia, establishing it as one of the most advanced and...

08/04/2026

Synamedia lights up Las Vegas with innovations that will...

Leading video solutions provider Synamedia is back at The 2026 NAB Show with innovations that connect tomorrows audiences today. On display will be a range of t...

08/04/2026

COW Jobs: Director Needed for WWII Indie Docudrama

COW Jobs: Director Needed for WWII Indie Docudrama Brie Clayton April 8, 2026 0 Comments Director Needed for WWII Indie Docudrama March 17, 2026COW ...

08/04/2026

ESPN Expands Global Reach on Disney+

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Broadcast Industry Initiatives Promise To Speed Adoption of ST 2110

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Remembering Television's Role in the U.S. Bicentennial

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Synamedia Unveils AI by Quortex

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Carrie Healey Joins NAB as Vice President of Communications

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Amagi Launches Newspulse

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Marshall Electronics Unveils CV376 NDI HX3 HDMI POV Camer...

Marshall Electronics introduces its latest POV camera with the new CV376 Compact NDI |HX3 HDMI POV Camera at NAB 2026 (Booth C8339). Designed for versatile 4K c...

08/04/2026

Zixi Showcases Interoperable Live Video Workflows and Sat...

Zixi, a leader in live video delivery and workflow orchestration, enables interoperable live video workflows across multi-vendor environments, helping broadcast...

08/04/2026

Agent from Above' Celebrates Divine Ascent to Global Ranking With Exclusive Cast and Behind-The-Scenes Photos

Back to All News Agent from Above' Celebrates Divine Ascent to Global Rank...

08/04/2026

Official Poster Revealed for 'My Two Cents,' the New Animated Series Created, Written and Directed by Zerocalcare

Back to All News Official Poster Revealed for My Two Cents, the New Animated Se...