Sony Pixel Power calrec Sony

The Three Computer Solution: Powering the Next Wave of AI Robotics

23/10/2024

ChatGPT marked the big bang moment of generative AI. Answers can be generated in response to nearly any query, helping transform digital work such as content creation, customer service, software development and business operations for knowledge workers.

Physical AI, the embodiment of artificial intelligence in humanoids, factories and other devices within industrial systems, has yet to experience its breakthrough moment.

This has held back industries such as transportation and mobility, manufacturing, logistics and robotics. But that's about to change thanks to three computers bringing together advanced training, simulation and inference.

The Rise of Multimodal, Physical AI For 60 years, Software 1.0 - serial code written by human programmers - ran on general-purpose computers powered by CPUs.

Then, in 2012, Alex Krizhevsky, mentored by Ilya Sutskever and Geoffrey Hinton, won the ImageNet computer image recognition competition with AlexNet, a revolutionary deep learning model for image classification.

This marked the industry's first contact with AI. The breakthrough of machine learning - neural networks running on GPUs - jump-started the era of Software 2.0.

Today, software writes software. The world's computing workloads are shifting from general-purpose computing on CPUs to accelerated computing on GPUs, leaving Moore's law far behind.

With generative AI, multimodal transformer and diffusion models have been trained to generate responses.

Large language models are one-dimensional, able to predict the next token, in modes like letters or words. Image- and video-generation models are two-dimensional, able to predict the next pixel.

None of these models can understand or interpret the three-dimensional world. And that's where physical AI comes in.

Physical AI models can perceive, understand, interact with and navigate the physical world with generative AI. With accelerated computing, multimodal physical AI breakthroughs and large-scale physically based simulations are allowing the world to realize the value of physical AI through robots.

A robot is a system that can perceive, reason, plan, act and learn. Robots are often thought of as autonomous mobile robots (AMRs), manipulator arms or humanoids. But there are many more types of robotic embodiments.

In the near future, everything that moves, or that monitors things that move, will be autonomous robotic systems. These systems will be capable of sensing and responding to their environments.

Everything from surgical rooms to data centers, warehouses to factories, even traffic control systems or entire smart cities will transform from static, manually operated systems to autonomous, interactive systems embodied by physical AI.

The Next Frontier: Humanoids Robots Humanoid robots are an ideal general-purpose robotic manifestation because they can operate efficiently in environments built for humans, while requiring minimal adjustments for deployment and operation.

The global market for humanoid robots is expected to reach $38 billion by 2035, a more than sixfold increase from the roughly $6 billion for the period forecast nearly two years ago, according to Goldman Sachs.

Researchers and developers around the world are racing to build this next wave of robots.

Three Computers to Develop Physical AI To develop humanoid robots, three accelerated computer systems are required to handle physical AI and robot training, simulation and runtime. Two computing advancements are accelerating humanoid robot development: multimodal foundation models and scalable, physically based simulations of robots and their worlds.

Breakthroughs in generative AI are bringing 3D perception, control, skill planning and intelligence to robots. Robot simulation at scale lets developers refine, test and optimize robot skills in a virtual world that mimics the laws of physics - helping reduce real-world data acquisition costs and ensuring they can perform in safe, controlled settings.

NVIDIA has built three computers and accelerated development platforms to enable developers to create physical AI.

First, models are trained on a supercomputer. Developers can use NVIDIA NeMo on the NVIDIA DGX platform to train and fine-tune powerful foundation and generative AI models. They can also tap into NVIDIA Project GR00T, an initiative to develop general-purpose foundation models for humanoid robots to enable them to understand natural language and emulate movements by observing human actions.

Second, NVIDIA Omniverse, running on NVIDIA OVX servers, provides the development platform and simulation environment for testing and optimizing physical AI with application programming interfaces and frameworks like NVIDIA Isaac Sim.

Developers can use Isaac Sim to simulate and validate robot models, or generate massive amounts of physically-based synthetic data to bootstrap robot model training. Researchers and developers can also use NVIDIA Isaac Lab, an open-source robot learning framework that powers robot reinforcement learning and imitation learning, to help accelerate robot policy training and refinement.

Lastly, trained AI models are deployed to a runtime computer. NVIDIA Jetson Thor robotics computers are specifically designed for compact, on-board computing needs. An ensemble of models consisting of control policy, vision and language models composes the robot brain and is deployed on a power-efficient, on-board edge computing system.

Depending on their workflows and challenge areas, robot makers and foundation model developers can use as many of the accelerated computing platforms and systems as needed.

Building the Next Wave of Autonomous Facilities Robotic facilities result from a culmination of all of these technologies.

Manufacturers like Foxconn or logistics companies like Amazon Robotics can orchestrate teams of autonomous robots to
LINK: https://blogs.nvidia.com/blog/three-computers-robotics/...
See more stories from nvidia

More from Nvidia

11/12/2024

Into the Omniverse: How OpenUSD-Based Simulation and Synthetic Data Generation Advance Robot Learning

Editor's note: This post is part of Into the Omniverse, a series focused on ...

10/12/2024

AI Pioneers Win Nobel Prizes for Physics and Chemistry

Artificial intelligence, once the realm of science fiction, claimed its place at the pinnacle of scientific achievement Monday in Sweden. In a historic ceremon...

10/12/2024

Turn Down the Noise: CUDA-Q Enables Industry-First Quantum Computing Demo With Logical Qubits

Quantum computing has the potential to transform industries ranging from drug di...

09/12/2024

Crowning Achievement: NVIDIA Research Model Enables Fast, Efficient Dynamic Scene Reconstruction

Content streaming and engagement are entering a new dimension with QUEEN, an AI ...

06/12/2024

Thailand and Vietnam Embrace Sovereign AI to Drive Economic Growth

Southeast Asia is embracing sovereign AI. The prime ministers of Thailand and Vietnam this week met with NVIDIA founder and CEO Jensen Huang to discuss initiat...

05/12/2024

2025 Predictions: Enterprises, Researchers and Startups Home In on Humanoids, AI Agents as Generative AI Crosses the Chasm

From boardroom to break room, generative AI took this year by storm, stirring di...

05/12/2024

Stream Indiana Jones and the Great Circle' at Launch With RTX Power in the Cloud at up to 50% Off

GeForce NOW is wrapping a sleigh-full of gaming gifts this month, stuffing membe...

04/12/2024

NVIDIA NIM on AWS Supercharges AI Inference

Generative AI is rapidly transforming industries, driving demand for secure, high-performance inference solutions to scale increasingly complex models efficient...

03/12/2024

NVIDIA Advances Physical AI With Accelerated Robotics Simulation on AWS

Field AI is building robot brains that enable robots to autonomously manage a wide range of industrial processes. Vention creates pretrained skills to ease deve...

03/12/2024

Latest NVIDIA AI, Robotics and Quantum Computing Software Comes to AWS

Expanding what's possible for developers and enterprises in the cloud, NVIDIA and Amazon Web Services are converging at AWS re:Invent in Las Vegas this week...

03/12/2024

How AI Can Enhance Disability Inclusion, Special Education

A recent survey from the Special Olympics Global Center for Inclusion in Education shows that while a majority of students with an intellectual and developmenta...

03/12/2024

New NVIDIA Certifications Expand Professionals' Credentials in AI Infrastructure and Operations

As generative AI continues to grow, implementing and managing the right infrastr...

02/12/2024

Siemens Healthineers Adopts MONAI Deploy for Medical Imaging AI

3.6 billion. That's about how many medical imaging tests are performed annually worldwide to diagnose, monitor and treat various conditions. Speeding up th...

28/11/2024

Get the Power of GeForce-Powered Gaming in the Cloud Half Off With Black Friday Deal

Turn Black Friday into Green Thursday with a new deal on GeForce NOW Ultimate an...

27/11/2024

How RTX AI PCs Unlock AI Agents That Solve Complex Problems Autonomously With Generative AI

Editor's note: This post is part of the AI Decoded series, which demystifies...

26/11/2024

Taste of Success: Zordi Plants AI and Robotics to Grow Flavorful Strawberries Indoors

With startup Zordi, founder Gilwoo Lee's enthusiasm for robotics, healthy ea...

25/11/2024

Why Workforce Development Is Key to Reaping AI Benefits

AI is changing industries and economies worldwide. Workforce development is central to ensuring the changes benefit all of us, as Louis Stewart, head of strate...

25/11/2024

Now Hear This: World's Most Flexible Sound Machine Debuts

A team of generative AI researchers created a Swiss Army knife for sound, one that allows users to control the audio output simply using text. While some AI mo...

21/11/2024

Efficiency Meets Personalization: How AI Agents Improve Customer Service

Editor's note: This post is the first in the AI On blog series, which explores the latest techniques and real-world applications of agentic AI, chatbots and...

21/11/2024

First Star Wars Outlaws' Story Pack Hits GeForce NOW

Get ready to dive deeper into the criminal underworld of a galaxy far, far away as GeForce NOW brings the first major story pack for Star Wars Outlaws to the cl...

21/11/2024

Into the Omniverse: How Generative AI Fuels Personalized, Brand-Accurate Visuals With OpenUSD

Editor's note: This post is part of Into the Omniverse, a blog series focuse...

20/11/2024

The Need for Speed: NVIDIA Accelerates Majority of World's Supercomputers to Drive Advancements in Science and Technology

Starting with the release of CUDA in 2006, NVIDIA has driven advancements in AI ...

19/11/2024

AI at COP29: Balancing Innovation and Sustainability

As COP29 attendees gather in Baku, Azerbaijan, to tackle climate change, the role AI plays in environmental sustainability is front and center. A panel hosted ...

19/11/2024

How the Department of Energy's AI Initiatives Are Transforming Science, Industry and Government

The U.S. Department of Energy oversees national energy policy and production. As...

19/11/2024

Microsoft and NVIDIA Supercharge AI Development on RTX AI PCs

Generative AI-powered laptops and PCs are unlocking advancements in gaming, content creation, productivity and development. Today, over 600 Windows apps and gam...

19/11/2024

NVIDIA and Microsoft Showcase Blackwell Preview, Omniverse Industrial AI and RTX AI PCs at Microsoft Ignite

NVIDIA and Microsoft today unveiled product integrations designed to advance ful...

18/11/2024

From Algorithms to Atoms: NVIDIA ALCHEMI NIM Catalyzes Sustainable Materials Research for EV Batteries, Solar Panels and More

More than 96% of all manufactured goods - ranging from everyday products, like l...

18/11/2024

Foxconn Expands Blackwell Testing and Production With New Factories in U.S., Mexico and Taiwan

To meet demand for Blackwell, now in full production, Foxconn, the world's l...

18/11/2024

Hopper Scales New Heights, Accelerating AI and HPC Applications for Mainstream Enterprise Servers

Since its introduction, the NVIDIA Hopper architecture has transformed the AI an...

18/11/2024

NVIDIA Releases cuPyNumeric, Enabling Scientists to Harness GPU Acceleration at Cluster Scale

Whether they're looking at nanoscale electron behaviors or starry galaxies c...

18/11/2024

Faster Forecasts: NVIDIA Launches Earth-2 NIM Microservices for 500x Speedup in Delivering Higher-Resolution Simulations

NVIDIA today at SC24 announced two new NVIDIA NIM microservices that can acceler...

18/11/2024

AI Will Drive Scientific Breakthroughs, NVIDIA CEO Says at SC24

NVIDIA kicked off SC24 in Atlanta with a wave of AI and supercomputing tools set to revolutionize industries like biopharma and climate science. The announceme...

14/11/2024

From Seed to Stream: Farming Simulator 25' Sprouts on GeForce NOW

Grab a pitchfork and fire up the tractor - the fields of GeForce NOW are about to get a whole lot greener with Farming Simulator 25. Whether looking for a time...

14/11/2024

Open for Development: NVIDIA Works With Cloud-Native Community to Advance AI and ML

Cloud-native technologies have become crucial for developers to create and imple...

14/11/2024

NVIDIA Ranks No. 1 as Forbes Debuts List of America's Best Companies 2025

NVIDIA ranked No. 1 on Forbes magazine's new list - America's Best Companies - based on more than 60 measures in nearly a dozen categories that cover fi...

14/11/2024

Keeping an AI on Diabetes Risk: Gen AI Model Predicts Blood Sugar Levels Four Years Out

Diabetics - or others monitoring their sugar intake - may look at a cookie and w...

13/11/2024

Indonesia Tech Leaders Team With NVIDIA and Partners to Launch Nation's AI

Working with NVIDIA and its partners, Indonesia's technology leaders have launched an initiative to bring sovereign AI to the nation's more than 277 mil...

13/11/2024

2025 Predictions: AI Finds a Reason to Tap Industry Data Lakes

Since the advent of the computer age, industries have been so awash in stored data that most of it never gets put to use. This data is estimated to be in the n...

13/11/2024

Peak Training: Blackwell Delivers Next-Level MLPerf Training Performance

Generative AI applications that use text, computer code, protein chains, summaries, video and even 3D graphics require data-center-scale accelerated computing t...

12/11/2024

Japan Tech Leaders Supercharge Sovereign AI With NVIDIA AI Enterprise and Omniverse

From call centers to factories to hospitals, AI is sweeping Japan. Undergirding...

12/11/2024

Japan's Startups Drive AI Innovation With NVIDIA Accelerated Computing

Lifelike digital humans engage with audiences in real time. Autonomous systems streamline complex logistics. And AI-driven language tools break down communicati...

12/11/2024

NVIDIA and Global Consulting Leaders Speed AI Adoption Across Japan's Industries

Consulting giants including Accenture, Deloitte, EY Strategy and Consulting Co.,...

12/11/2024

Lab Confidential: Japan Research Keeps Healthcare Data Secure

Established 77 years ago, Mitsui & Co stays vibrant by building businesses and ecosystems with new technologies like generative AI and confidential computing. ...

12/11/2024

Japan Develops Next-Generation Drug Design, Healthcare Robotics and Digital Health Platforms

To provide high-quality medical care to its population - around 30% of whom are ...

12/11/2024

Japan's Market Innovators Bring Physical AI to Industries With NVIDIA AI and Omniverse

Robots transporting heavy metal at a Toyota plant. Yaskawa's robots working ...

12/11/2024

Every Industry, Every Company, Every Country Must Produce a New Industrial Revolution,' Says NVIDIA CEO Jensen Huang at AI Summit Japan

The next technology revolution is here, and Japan is poised to be a major part o...

12/11/2024

GPU's Companion: NVIDIA App Supercharges RTX GPUs With AI-Powered Tools and Features

The NVIDIA app - officially releasing today - is a companion platform for conten...

07/11/2024

Jensen Huang to Discuss AI's Future with Masayoshi Son at AI Summit Japan

NVIDIA founder and CEO Jensen Huang will join SoftBank Group Chairman and CEO Masayoshi Son in a fireside chat at NVIDIA AI Summit Japan to discuss the transfor...

07/11/2024

Welcome to GeForce NOW Performance: Priority Members Get Instant Upgrade

This GFN Thursday, the GeForce NOW Priority membership is getting enhancements and a fresh name to go along with it. The new Performance membership offers more ...

06/11/2024

Hugging Face and NVIDIA to Accelerate Open-Source AI Robotics Research and Development

At the Conference for Robot Learning (CoRL) in Munich, Germany, Hugging Face and...