Sony Pixel Power calrec Sony

NVIDIA Advances Robot Learning and Humanoid Development With New AI and Simulation Tools

06/11/2024

www.1x.tech

Robotics developers can greatly accelerate their work on AI-enabled robots, including humanoids, using new AI and simulation tools and workflows that NVIDIA revealed this week at the Conference for Robot Learning (CoRL) in Munich, Germany.

The lineup includes the general availability of the NVIDIA Isaac Lab robot learning framework; six new humanoid robot learning workflows for Project GR00T, an initiative to accelerate humanoid robot development; and new world-model development tools for video data curation and processing, including the NVIDIA Cosmos tokenizer and NVIDIA NeMo Curator for video processing.

The open-source Cosmos tokenizer provides robotics developers superior visual tokenization by breaking down images and videos into high-quality tokens with exceptionally high compression rates. It runs up to 12x faster than current tokenizers, while NeMo Curator provides video processing curation up to 7x faster than unoptimized pipelines.

Also timed with CoRL, NVIDIA presented 23 papers and nine workshops related to robot learning and released training and workflow guides for developers. Further, Hugging Face and NVIDIA announced they're collaborating to accelerate open-source robotics research with LeRobot, NVIDIA Isaac Lab and NVIDIA Jetson for the developer community.

Accelerating Robot Development With Isaac Lab NVIDIA Isaac Lab is an open-source, robot learning framework built on NVIDIA Omniverse, a platform for developing OpenUSD applications for industrial digitalization and physical AI simulation.

Developers can use Isaac Lab to train robot policies at scale. This open-source unified robot learning framework applies to any embodiment - from humanoids to quadrupeds to collaborative robots - to handle increasingly complex movements and interactions.

Leading commercial robot makers, robotics application developers and robotics research entities around the world are adopting Isaac Lab, including 1X, Agility Robotics, The AI Institute, Berkeley Humanoid, Boston Dynamics, Field AI, Fourier, Galbot, Mentee Robotics, Skild AI, Swiss-Mile, Unitree Robotics and XPENG Robotics.

Project GR00T: Foundations for General-Purpose Humanoid Robots Building advanced humanoids is extremely difficult, demanding multilayer technological and interdisciplinary approaches to make the robots perceive, move and learn skills effectively for human-robot and robot-environment interactions.

Project GR00T is an initiative to develop accelerated libraries, foundation models and data pipelines to accelerate the global humanoid robot developer ecosystem.

Six new Project GR00T workflows provide humanoid developers with blueprints to realize the most challenging humanoid robot capabilities. They include:

GR00T-Gen for building generative AI-powered, OpenUSD-based 3D environments

GR00T-Mimic for robot motion and trajectory generation

GR00T-Dexterity for robot dexterous manipulation

GR00T-Control for whole-body control

GR00T-Mobility for robot locomotion and navigation

GR00T-Perception for multimodal sensing

Humanoid robots are the next wave of embodied AI, said Jim Fan, senior research manager of embodied AI at NVIDIA. NVIDIA research and engineering teams are collaborating across the company and our developer ecosystem to build Project GR00T to help advance the progress and development of global humanoid robot developers.

New Development Tools for World Model Builders Today, robot developers are building world models - AI representations of the world that can predict how objects and environments respond to a robot's actions. Building these world models is incredibly compute- and data-intensive, with models requiring thousands of hours of real-world, curated image or video data.

NVIDIA Cosmos tokenizers provide efficient, high-quality encoding and decoding to simplify the development of these world models. They set a new standard of minimal distortion and temporal instability, enabling high-quality video and image reconstructions.

Providing high-quality compression and up to 12x faster visual reconstruction, the Cosmos tokenizer paves the path for scalable, robust and efficient development of generative applications across a broad spectrum of visual domains.

1X, a humanoid robot company, has updated the 1X World Model Challenge dataset to use the Cosmos tokenizer.

NVIDIA Cosmos tokenizer achieves really high temporal and spatial compression of our data while still retaining visual fidelity, said Eric Jang, vice president of AI at 1X Technologies. This allows us to train world models with long horizon video generation in an even more compute-efficient manner.

Other humanoid and general-purpose robot developers, including XPENG Robotics and Hillbot, are developing with the NVIDIA Cosmos tokenizer to manage high-resolution images and videos.

NeMo Curator now includes a video processing pipeline. This enables robot developers to improve their world-model accuracy by processing large-scale text, image and video data.

Curating video data poses challenges due to its massive size, requiring scalable pipelines and efficient orchestration for load balancing across GPUs. Additionally, models for filtering, captioning and embedding need optimization to maximize throughput.

NeMo Curator overcomes these challenges by streamlining data curation with automatic pipeline orchestration, reducing processing time significantly. It supports linear scaling across multi-node, multi-GPU systems, efficiently handling over 100 petabytes of data. This simplifies AI development, reduces costs and accelerates time to market.

Advancing the Robot Learning Community at CoRL The nearly two dozen research papers the NVIDIA robotics team released with CoRL cover breakthroughs in integrating vision language models for improved environmental understanding and task execution, temporal robot navigati
LINK: https://blogs.nvidia.com/blog/robot-learning-humanoid-development/...
See more stories from nvidia

North America Stories

21/10/2025

NAB New York 2025: Although AES Show Is on Its Own, Audio Will Be a Major Part of the East Coast Expo

NAB New York 2025: Although AES Show Is on Its Own, Audio Will Be a Major Part o...

21/10/2025

NAB New York 2025: Business of Broadcast and Media,' Future of Content' Are Themes for Two-Day Show

NAB New York 2025: Business of Broadcast and Media,' Future of Content'...

21/10/2025

SVG All-Stars: Ethan Folz, Senior Director, Digital Operations and Quality of Experience, DTC Products, Tech, and Operations, NBA

SVG All-Stars: Ethan Folz, Senior Director, Digital Operations and Quality of Ex...

21/10/2025

NBA on NBC/Peacock: Livestream Offers Graphic Overlays, Predictive Gaming, Ancillary Camera Angles, Real-Time Highlights

NBA on NBC/Peacock: Livestream Offers Graphic Overlays, Predictive Gaming, Ancil...

21/10/2025

NBA on NBC/Peacock: At the Front Bench With Producer Frank DiGraci and Director Pierre Moossa

NBA on NBC/Peacock: At the Front Bench With Producer Frank DiGraci and Director ...

21/10/2025

NBA on NBC/Peacock: NBC Sports, NEP Build Ultra-Flexible Production Plan That Seamlessly Blends Onsite, REMI Models

NBA on NBC/Peacock: NBC Sports, NEP Build Ultra-Flexible Production Plan That Se...

21/10/2025

What to Watch: 6 Indigenous-Led Contemporary Stories Supported by the Documentary Film Program

Indigenous storytelling has been at the heart of the work of the Sundance Instit...

21/10/2025

2026 Sundance Film Festival Announces Park City Legacy Program Featuring Archival Screenings, Special Talks, and Culmination Event

Top L-R: Mysterious Skin, American Dream Second Row L-R: Little Miss Sunshine, D...

21/10/2025

L3Harris Successfully Completes Important Milestone for Army SATCOM Program

Critical Design Review completion is a key milestone on the path toward Wideband Global Satellite Communications certification for the network in 2026, opening ...

21/10/2025

In the Undersea Domain - Reliability is Key

New Australian undersea training range to implement and improve warfighting tactics, proficiency and safety; enable joint/allied training that contributes to pr...

21/10/2025

The Gauge: Poland | September 2025

September, the beginning of autumn, brought an expected revival to the TV market, largely due to the new fall TV schedules. The time spent in front of the TV sc...

21/10/2025

Nielsen: September Football Blitz Leads to Historic Monthly Spike in Broadcast Viewership

Broadcast Booms with 20% Uptick vs. August, Achieving Largest Monthly Increase ...

21/10/2025

THE GAUGE: MEXICO SEPTEMBER 2025

During September, streaming's share of TV viewing in Mexico settled at 24.5%, a marginal shift of -0.5 share points from the previous month. Disclaimer: YU...

21/10/2025

BBright, GlobalM Successfully Trial End-to-End UHD Interoperability

RENNES, France BBright and GlobalM have conducted a technical trial validating Ultra HD interoperability across the entire contribution chain in the cloud, achi...

21/10/2025

Kokusai Denki To Debut New 4K Camera at 2025 NAB Show New York

Kokusai Denki Electric America will mark the U.S. debut of a new 4K camera at the 2025 NAB New York, Oct. 22-23. Now available, the Z-HD6500-S1 UHD/HD productio...

21/10/2025

Triveni Digital to Showcase Industrys Most Comprehensive...

Triveni Digital, a trusted leader in ATSC 1.0 and 3.0 service delivery, data broadcasting, and quality assurance solutions, will showcase its entire NEXTGEN TV ...

21/10/2025

Radio Azzurra Advances to Digital Workflow with DHD SX2 A...

Radio Azzurra FM, longest-running radio station in the province of Novara, northwest Italy, has invested in an DHD SX2 audio routing and mixing console for inte...

21/10/2025

Globecast Appoints G Morgan as EVP of Sales for Globecast...

Globecast, the leading provider of broadcast, media and entertainment managed services, has announced the appointment of G Morgan as Executive Vice President of...

21/10/2025

Visual Data Strengthens Global Leadership with Appointmen...

Visual Data announces the appointment of Maz Al-Jumaili as Senior Vice President, Worldwide Localization, to advance client engagement, strategic partnerships, ...

21/10/2025

Grup Mediapro to Deliver Prime Video NBA Coverage to the Hispanic Market

As Amazon's Prime Video prepares to launch its coverage of NBA basketball under a major new deal, Grup Mediapro has announced that it is working with the st...

21/10/2025

ADTH to Upgrade NextGen TV Receivers With Gateway Capabilities

ATLANTA Good news for consumers using an Atlanta DTH receiver to watch ATSC 3.0: with a new software update, they will be able to blanket their homes with Wi-Fi...

21/10/2025

Study: 'More Critical Than Ever for Brands to Focus on Hispanics

While recent news has been heavily focused on Hispanic migration into the U.S., The 2025 Hispanic Market Report from Claritas highlights the fact that this gr...

21/10/2025

RWS Appoints Michael Wayne as Head of Media and Entertainment

MAIDENHEAD, UK RWS has hired Michael Wayne as its head of media and entertainment in Los Angeles where he will lead the company's media localization busines...

21/10/2025

Imagine Communications Acquires Pixel Power From Rohde an...

Imagine Communications and Rohde & Schwarz today announced a definitive agreement under which Imagine will acquire Pixel Power Limited, a wholly owned subsidiar...

21/10/2025

ADTH Announces New NEXTGEN TV Gateway Receiver Implementi...

Atlanta DTH (ADTH) today announced a major update that will expand the functionality of its NEXTGEN TV receiver by enabling gateway capabilities allowing viewer...

21/10/2025

Heartland Video Systems Partners with Zixi for Resilient...

Heartland Video Systems, Inc. (HVS), a premier video systems integration, consulting, and expert ATSC 3.0 implementation firm announces that it has partnered wi...

21/10/2025

QuickLink Appoints Austin Hinton as Solutions Enablement...

QuickLink, the leading provider of award-winning video production and remote guest integration solutions, today announced the appointment of Austin Hinton as it...

21/10/2025

Miri Technologies to Unveil New Resilient Internet Platfo...

nternet connectivity startup Miri Technologies Inc. will use this week's NAB Show New York as the launch pad for its latest ground-breaking innovation, the ...

21/10/2025

Flexibly Price, Report, and Steward Deals with WO Network

In today's evolving media landscape, audience measurement isn't one-size-fits-all. With multiple measurement providers now available, networks need the ...

21/10/2025

Tribeca Films to Release Independent Comedy Serious People from Pasqual Gutierrez and Ben Mullinkosson

October 21st, 2025 Tribeca Films to Release Independent Comedy Serious People...

21/10/2025

Introducing Ivory 3 LE Uprights - Modern & Vintage

Synthogy is excited to announce the launch of Ivory 3 LE Uprights - Modern & Vintage, the latest addition to our game-changing Ivory 3 platform. This Legacy Ed...

21/10/2025

Netflix Unveils Monster Mash in Trailer of Troll 2' - the Highly Anticipated Sequel to the Global Sensation

Back to All News Netflix Unveils Monster Mash in Trailer of Troll 2' - the...

21/10/2025

For the Fans! Netflix Goes Golden Forging Unprecedented KPop Demon Hunters' Master Toy Partnerships with Mattel and Hasbro

Back to All News For the Fans! Netflix Goes Golden Forging Unprecedented KPop ...

21/10/2025

How can businesses close the AI adoption gap? Start with...

How can businesses close the AI adoption gap? Start with your recruitment teams, new LinkedIn research shows Published on Oct 21, 2025 Categories: Data and in...

20/10/2025

Inside TAMS: How Time-Addressable Media Stores Could Redefine Sports Workflows

Inside TAMS: How Time-Addressable Media Stores could redefine sports workflows By Paul Markham Friday, October 17, 2025 - 08:57 Print This Story A penalty...

20/10/2025

Transformational Production: Inside TVN's Remote Production Push for the DFL's Bundesliga 2

Transformational production: Inside TVN's remote production push for the DFL...

20/10/2025

How NBC Sports Transitioned Stamford Facility to One Format: 1080p HDR

How NBC Sports Transitioned Stamford Facility to One Format: 1080p HDRMulti-year plan harmonizes workflows, simplifies operationsBy Ken Kerschbaumer, Editorial ...

20/10/2025

NBA on NBC' Studio Production Team Is Ready for Tip-Off With Coast-to-Coast Tuesday'

NBA on NBC' Studio Production Team Is Ready for Tip-Off With Coast-to-Coast...

20/10/2025

Under Pressure: TVN CEO Markus Osthaus Considers the German Sports Broadcasting Market

Under pressure: TVN CEO Markus Osthaus considers the German sports broadcasting ...

20/10/2025

Carmen Emmi's Plainclothes Evokes the Rawness and Sensuality of New Queer Cinema

(L-R) Maria Dizzia, Carmen Emmi, and Russell Tovey attend the Plainclothes pre...

20/10/2025

The Republic of Korea Selects L3Harris for Airborne Early Warning and Control Aircraft Program

Airborne Early Warning and Control aircraft rendering...

20/10/2025

Imagine Communications Acquires Pixel Power From Rohde & Schwarz

DENVER and MUNICH Imagine Communications today announced its plans to acquire Pixel Power Ltd., a wholly owned subsidiary of Rohde & Schwarz. Financial terms of...

20/10/2025

Globecast Appoints G Morgan as EVP of Sales, Globecast Americas

LOS ANGELES G Morgan has joined Globecast, a provider of broadcast, media and entertainment managed services, as executive vice president of sales, Globecast Am...

20/10/2025

Heartland Video Systems, Zixi Partner on IP Networking for Broadcasters

PLYMOUTH, Wisc. Heartland Video Systems and Zixi have partnered to enable broadcast-quality live video delivery over any IP network....

20/10/2025

A. R. Rahman on Facing Fear and Finding the Divine

A. R. Rahman on Facing Fear and Finding the Divine In an interview with Berklee President Jim Lucchese, the Oscar-winning composer reflects on how courage and...

20/10/2025

Netflix Unveils the Teaser Trailer for 'The Crystal Cuckoo'

Back to All News Netflix Unveils the Teaser Trailer for The Crystal Cuckoo Entertainment 20 October 2025 GlobalSpain Link copied to clipboard Watch the of...

20/10/2025

NVIDIA and Google Cloud Accelerate Enterprise AI and Industrial Digitalization

NVIDIA and Google Cloud are expanding access to accelerated computing to transform the full spectrum of enterprise workloads, from visual computing to agentic a...

19/10/2025

Sins of Kujo' Comes to Life in New Live-Action Series Set for Spring 2026

Back to All News Sins of Kujo' Comes to Life in New Live-Action Series Set for Spring 2026 Entertainment 19 October 2025 GlobalJapan Link copied to cl...

18/10/2025

NESN Taps Harmonic for Primary Live Sports Distribution

New England Sports Network (NESN) has chosen Harmonic, working with Astound Business Solutions, as its enterprise technology partner to transform primary distri...