Sony Pixel Power calrec Sony

NVIDIA Advances Robot Learning and Humanoid Development With New AI and Simulation Tools

06/11/2024

www.1x.tech

Robotics developers can greatly accelerate their work on AI-enabled robots, including humanoids, using new AI and simulation tools and workflows that NVIDIA revealed this week at the Conference for Robot Learning (CoRL) in Munich, Germany.

The lineup includes the general availability of the NVIDIA Isaac Lab robot learning framework; six new humanoid robot learning workflows for Project GR00T, an initiative to accelerate humanoid robot development; and new world-model development tools for video data curation and processing, including the NVIDIA Cosmos tokenizer and NVIDIA NeMo Curator for video processing.

The open-source Cosmos tokenizer provides robotics developers superior visual tokenization by breaking down images and videos into high-quality tokens with exceptionally high compression rates. It runs up to 12x faster than current tokenizers, while NeMo Curator provides video processing curation up to 7x faster than unoptimized pipelines.

Also timed with CoRL, NVIDIA presented 23 papers and nine workshops related to robot learning and released training and workflow guides for developers. Further, Hugging Face and NVIDIA announced they're collaborating to accelerate open-source robotics research with LeRobot, NVIDIA Isaac Lab and NVIDIA Jetson for the developer community.

Accelerating Robot Development With Isaac Lab NVIDIA Isaac Lab is an open-source, robot learning framework built on NVIDIA Omniverse, a platform for developing OpenUSD applications for industrial digitalization and physical AI simulation.

Developers can use Isaac Lab to train robot policies at scale. This open-source unified robot learning framework applies to any embodiment - from humanoids to quadrupeds to collaborative robots - to handle increasingly complex movements and interactions.

Leading commercial robot makers, robotics application developers and robotics research entities around the world are adopting Isaac Lab, including 1X, Agility Robotics, The AI Institute, Berkeley Humanoid, Boston Dynamics, Field AI, Fourier, Galbot, Mentee Robotics, Skild AI, Swiss-Mile, Unitree Robotics and XPENG Robotics.

Project GR00T: Foundations for General-Purpose Humanoid Robots Building advanced humanoids is extremely difficult, demanding multilayer technological and interdisciplinary approaches to make the robots perceive, move and learn skills effectively for human-robot and robot-environment interactions.

Project GR00T is an initiative to develop accelerated libraries, foundation models and data pipelines to accelerate the global humanoid robot developer ecosystem.

Six new Project GR00T workflows provide humanoid developers with blueprints to realize the most challenging humanoid robot capabilities. They include:

GR00T-Gen for building generative AI-powered, OpenUSD-based 3D environments

GR00T-Mimic for robot motion and trajectory generation

GR00T-Dexterity for robot dexterous manipulation

GR00T-Control for whole-body control

GR00T-Mobility for robot locomotion and navigation

GR00T-Perception for multimodal sensing

Humanoid robots are the next wave of embodied AI, said Jim Fan, senior research manager of embodied AI at NVIDIA. NVIDIA research and engineering teams are collaborating across the company and our developer ecosystem to build Project GR00T to help advance the progress and development of global humanoid robot developers.

New Development Tools for World Model Builders Today, robot developers are building world models - AI representations of the world that can predict how objects and environments respond to a robot's actions. Building these world models is incredibly compute- and data-intensive, with models requiring thousands of hours of real-world, curated image or video data.

NVIDIA Cosmos tokenizers provide efficient, high-quality encoding and decoding to simplify the development of these world models. They set a new standard of minimal distortion and temporal instability, enabling high-quality video and image reconstructions.

Providing high-quality compression and up to 12x faster visual reconstruction, the Cosmos tokenizer paves the path for scalable, robust and efficient development of generative applications across a broad spectrum of visual domains.

1X, a humanoid robot company, has updated the 1X World Model Challenge dataset to use the Cosmos tokenizer.

NVIDIA Cosmos tokenizer achieves really high temporal and spatial compression of our data while still retaining visual fidelity, said Eric Jang, vice president of AI at 1X Technologies. This allows us to train world models with long horizon video generation in an even more compute-efficient manner.

Other humanoid and general-purpose robot developers, including XPENG Robotics and Hillbot, are developing with the NVIDIA Cosmos tokenizer to manage high-resolution images and videos.

NeMo Curator now includes a video processing pipeline. This enables robot developers to improve their world-model accuracy by processing large-scale text, image and video data.

Curating video data poses challenges due to its massive size, requiring scalable pipelines and efficient orchestration for load balancing across GPUs. Additionally, models for filtering, captioning and embedding need optimization to maximize throughput.

NeMo Curator overcomes these challenges by streamlining data curation with automatic pipeline orchestration, reducing processing time significantly. It supports linear scaling across multi-node, multi-GPU systems, efficiently handling over 100 petabytes of data. This simplifies AI development, reduces costs and accelerates time to market.

Advancing the Robot Learning Community at CoRL The nearly two dozen research papers the NVIDIA robotics team released with CoRL cover breakthroughs in integrating vision language models for improved environmental understanding and task execution, temporal robot navigati
LINK: https://blogs.nvidia.com/blog/robot-learning-humanoid-development/...
See more stories from nvidia

North America Stories

31/03/2026

MeyerPro Delivers LED Production for Microsoft Ignite 2025

MeyerPro delivered the LED production for the Microsoft Ignite 2025 keynote at Chase Center in San Francisco, using more than 2,700 ROE Visual panels across mul...

31/03/2026

MC-IF Expands Membership to Include Smaller Technology Companies to Drive VVC Adoption

The Media Coding Industry Forum (MC-IF) is expanding membership outreach in 2026...

31/03/2026

ViewLift and MyOutdoorTV Launch Conversational AI Search

ViewLift and MyOutdoorTV (MOTV) have announced the launch of ViewLift Conversational AI Search on the MyOutdoorTV platform. The feature enables natural language...

31/03/2026

Atlanta Braves and Gray Media to Simulcast 25 Regular Season Games on Over-the-Air Television

The Atlanta Braves and Gray Media have announced a multi-year agreement to simul...

31/03/2026

Gravity Media to Deliver Broadcast Coverage of the Sydney Autumn Racing Carnival

Gravity Media has delivered broadcast services for TAB Golden Slipper Day at Rosehill Gardens on March 21 and will now cover The Star Championships at Royal Ran...

31/03/2026

Mileto Tecnologia Selects Synamedia Go for OTT Expansion

Synamedia has announced that Mileto Tecnologia, a Brazilian pay-TV operator, has selected the Synamedia Go platform for its OTT expansion. Mileto is also deploy...

31/03/2026

NAB 2026: KMH Integration to Present AV Casting Philosophy

KMH Integration will attend NAB Show in Las Vegas with a focus on what the company calls AV Casting - an approach built on the idea that professional AV and bro...

31/03/2026

Prime Video to Air First and Second Rounds of 2026 Masters Tournament

Prime Video will carry live coverage of the first and second rounds of the 2026 Masters Tournament, beginning at 1:00 p.m. ET on Thursday, April 9 and Friday, A...

31/03/2026

NHL, ESPN, TNT Sports and Sportsnet Launch Joint Marketing Campaign for 2026 Stanley Cup Playoffs

The NHL and its U.S. and Canadian broadcast partners have announced a collaborat...

31/03/2026

Daktronics to Install New Video Display and Show Control System at Wake Forest's Allegacy Stadium

Daktronics has partnered with Wake Forest to manufacture and install a new end z...

31/03/2026

NFL Announces Las Vegas to Host Super Bowl LXIII in 2029

The National Football League has announced that Las Vegas will host Super Bowl LXIII in 2029 at Allegiant Stadium. The announcement was made at the NFL Annual M...

31/03/2026

NFL Partners with TMRW Sports to Launch Professional Flag Football League

The NFL has announced a partnership with TMRW Sports to develop and operate a professional flag football league for women and men. The league will launch with i...

31/03/2026

Zac Brown Band and Blake Shelton Deploy Sennheiser Spectera at Las Vegas Residencies

Sennheiser's Spectera wideband bidirectional wireless system was used by bot...

31/03/2026

Sports Studio Forms Advisory Board for Free Live Sports Platform

Sports Studio Inc., the company behind Free Live Sports, has announced the formation of an Advisory Board with five media and technology executives. Each of o...

31/03/2026

PSSI Deploys Appear X Platform for Mobile Fleet and Teleport Upgrade

PSSI and Appear have announced a new phase in their collaboration, with PSSI deploying Appear's X Platform to upgrade its mobile fleet and PSSI Internationa...

31/03/2026

SVG New Sponsor Spotlight: Flowstate AI's Sahiah Shah on Transforming Video Content with Intelligent AI Agents

As sports media organization continue to seek out new ways to streamline their p...

31/03/2026

NWSL Scales Up Production Ops to Match League's Exponential Growth

With two new expansion teams and viewership/attendance on the rise, the league's production/broadcast arm and its partner NEP Connected Solutions are busier...

31/03/2026

Welcome Young Entertainment Professionals Class of 2026

By Kiera Williams Every year, a new group of emerging media and entertainment professionals steps into the HPA community - curious, talented, and ready to grow...

31/03/2026

L3Harris Sets Date for First Quarter 2026 Earnings Release

MELBOURNE, Fla., March 31, 2026 - L3Harris Technologies (NYSE: LHX) will release its first quarter 2026 financial results before the market opens on Thursday, A...

31/03/2026

Millions of Miles from Home: How Perseverance Stays Connected

Photo courtesy of NASA. An illustration shows NASA's Perseverance rover operating on the surface of Mars....

31/03/2026

L3Harris and Comtech Introduce First-of-Its-Kind Tactical SATCOM Modem

L3Harris Technologies and Comtech Telecommunications Corp. have collaborated to introduce the next evolution in resilient multi-orbit capability for today's...

31/03/2026

Nielsen data shows NZ retail brands are changing strategies to win over outdoor enthusiasts

Rebel Sport leads ad investment as brands compete for a large, active and qualit...

31/03/2026

Spectrum TV App to Launch on Amazon Fire TV Devices

Share Copy link Facebook X Linkedin Bluesky Email...

31/03/2026

CueScript to Showcase Innovations at NAB that Add Mobilit...

CueScript, a leading international developer of professional teleprompting solutions, is enhancing its platform with three innovations that elevate flexibility,...

31/03/2026

GALSNGEAR Returns to the 2026 NAB Show with Expanded Meet...

#GALSNGEAR will host a series of meetups, panel discussions, and networking events during the 2026 NAB Show, taking place April 18 22 in Las Vegas. The organi...

31/03/2026

Imagine Introduces AI Assisted Scheduling at 2026 NAB Sho...

At the 2026 NAB Show (April 19-22, Las Vegas Convention Center, Booth #N1328), Imagine Communications is introducing AI assisted scheduling capabilities within ...

31/03/2026

PSSI boosts live sports flexibility and security with the...

High-density upgrade for mobile fleet and PSSI International Teleport gives PSSI more flexibility for premium live event coverage PSSI and Appear today announc...

31/03/2026

Solid State Logic Enhances Virtualized System T Platform to Deliver Scalable Cloud and On-Prem Production for NAB 2026

Solid State Logic Enhances Virtualized System T Platform to Deliver Scalable Clo...

31/03/2026

OWC to Showcase Storage, Workflow Acceleration, and Reliability Solutions for Creatives and Post-Production Professionals at NAB 2026

OWC to Showcase Storage, Workflow Acceleration, and Reliability Solutions for Cr...

31/03/2026

PSSI Taps Appear X for Live Coverage of FIFA World Cup

Share Copy link Facebook X Linkedin Bluesky Email...

31/03/2026

OpenDrives Shows Off Sports Expertise in Sports Business...

OpenDrives, a leader in software-defined video and rich media storage management solutions, will demonstrate several new innovations at the 2026 NAB Show in Apr...

31/03/2026

SDVI to Showcase Platform Enhancements New Technology Int...

At the 2026 NAB Show, SDVI will demonstrate how its Rally media supply chain management platform continues to give media operations teams the tools they need to...

31/03/2026

Boland Communications Introduces QD4K315HDR10 QD-OLED Ser...

Boland Communications today announced that at the 2026 NAB Show, it will introduce its new QD4K315HDR10, a 31.5-inch QD-OLED monitor delivering exceptional colo...

31/03/2026

NUGEN Audio CEO Dr Paul Tapper to Lead Presentation About...

Dr. Paul Tapper, CEO of NUGEN Audio, will lead an essential industry discussion at the 2026 NAB Show, examining whether dialog intelligibility is poised to beco...

31/03/2026

BCNEXXT at NAB 2026 - Turning Industry Pressure into Oppo...

BCNEXXT will use NAB 2026 to focus on how broadcasters can turn today's operational and market pressures into opportunity. Meeting with customers in the IAB...

31/03/2026

Mediagenix Showcases Semantic Intelligence Powered Title...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, will showcase its latest innovations at th...

31/03/2026

DHD Introduces AI-Based Audio Noise Reduction to XD3 IP C...

DHD announces that AI-based audio noise reduction is now available as a powerful new option for its XD3 IP Core. Developed in cooperation with ai-coustics, audi...

31/03/2026

PTZOptics to showcase intelligent video and camera contro...

PTZOptics will showcase its vision for intelligent video and advanced camera automation at NAB Show 2026 (#N1902). Through immersive demonstrations and technolo...

31/03/2026

Experience Commerce Wins Social Media Mandate for ICONIQA...

Experience Commerce, a leading full-service digital marketing agency and part of the Cheil SWA Group, has secured the social media mandate for ICONIQA Hotels & ...

31/03/2026

Fabric to Showcase Cloud-Native Origin Platform and Next-...

Fabric, the entertainment industry's leader in data and operations solutions, will showcase a major expansion of its media technology platform at NAB 2026, ...

31/03/2026

Boland Communications Introduces New QD-OLED Series Monitors

Share Copy link Facebook X Linkedin Bluesky Email...

31/03/2026

Carr Warns NFL Over Streaming Rights, Consumer Costs

Share Copy link Facebook X Linkedin Bluesky Email...

31/03/2026

Farhan Khan Appointed FCC Chief Information Officer

Share Copy link Facebook X Linkedin Bluesky Email...

31/03/2026

Federal Judge Pauses Nexstar/Tegna Merger

Share Copy link Facebook X Linkedin Bluesky Email...

31/03/2026

Boris FX Acquires Vegas Pro, Sound Forge, and Acid Pro

Boris FX Acquires Vegas Pro, Sound Forge, and Acid Pro Jessie Electa Petrov March 30, 2026 0 Comments The acclaimed VFX developer bolsters its award-w...

31/03/2026

Berklee India Exchange Presents Anirudh Varma Collective

Berklee India Exchange Presents Anirudh Varma Collective The collective will present a workshop on Hindustani classical music and a concert in collaboration w...

31/03/2026

Efficiency at Scale: NVIDIA, Energy Leaders Accelerating PowerFlexible AI Factories to Fortify the Grid

CERAWeek - dubbed the Davos of energy - is where policymakers, producers, techno...

30/03/2026

NAB 2026: Manifold to Demonstrate 400GbE COTS FPGA Support

Manifold Technologies, a Germany-based provider of cloud infrastructure for live broadcast production, will demonstrate support for 400GbE COTS FPGA accelerator...

30/03/2026

NAB 2026: Boland Communications Introduces QD-OLED Series Monitors

Boland Communications will introduce its QD4K315HDR10, a 31.5-inch QD-OLED monitor, at NAB Show 2026 (Booth C3519, April 18-22). The company is also introducing...

30/03/2026

NAB 2026: PTZOptics to Showcase Move 4K and Horizon Platform

PTZOptics will demonstrate its Move 4K PTZ cameras and Horizon web-based control platform at NAB Show 2026 (Booth N1902). Move 4K with Horizon is now available...