NVIDIA Project GR00T

Generalist Robot 00 Technology

Project GR00T is an initiative to develop a general-purpose foundation model for humanoid robots that takes multi-modal instructions and past interactions as input and outputs robot actions. This advanced model is modular, with systems for both high-level reasoning and planning and low-level fast, accurate, and reactive motion.

Project GROOT is an active research project. Sign up below for updates and information on availability.

Apply for Early Access


See GR00T in Action


Next-Gen Robots, Powered by NVIDIA

Building Robotic Systems With Three Computers

Project GR00T uses every part of NVIDIA’s three-computer robotics stack. This includes NVIDIA AI and DGX™ for training the model, NVIDIA Isaac™ Lab for reinforcement learning, and NVIDIA JetsonThor and Isaac ROS for accelerated robot runtime.

img-alt-text

AI

NVIDIA DGX

NVIDIA DGX Cloud is an end-to-end AI platform for developers, giving you scalable capacity built on the latest NVIDIA architecture and co-engineered with the world’s leading cloud service providers.

img-alt-text

Simulation

NVIDIA Isaac Lab

This lightweight reference application is built on the NVIDIA Omniverse™ platform that’s specifically optimized for robot learning, and is pivotal for robot foundation model training. It optimizes for reinforcement, imitation, and transfer learning, and is capable of training all types of robot embodiments.

img-alt-text

Runtime

Isaac ROS on Jetson Thor

NVIDIA Isaac ROS is a collection of accelerated computing packages and AI models designed to streamline and expedite the development of advanced AI robotics applications. For humanoids, Isaac ROS is deployed on Jetson Thor, optimized for fast, humanoid cognition and action.


How It Works

Workflow for GR00T model training

Click to Enlarge

Model Operation

Project GR00T enables humanoid embodiments to perform tasks from multi-modal instructions and dynamically react to the world through self-observation.

Development and Training

The model uses multi-modal learning from a variety of data sources—including instructions, demonstrations, video, and imitation learning for robots—to acquire new skills, accelerating the development of humanoid robots.

NVIDIA Isaac Lab is ideal for training Project GR00T at scale. You can also take advantage of the NVIDIA OSMO robot cloud computing orchestration service to coordinate workflows across NVIDIA DGX™ systems for training, NVIDIA OVX™ systems for simulation, and NVIDIA IGX™ systems for hardware-in-the-loop validation.

Workflow for Isaac Lab, OSMO Service, and GR00T model

Click to Enlarge


Ecosystem


More Resources

A decorative image representing Developer Community

Explore the Community

img-alt-text

Get Training and Certification

A decorative image representing Inception for Startups

Meet the Program for Startups

    Accelerate Your Humanoid Development

    Apply for the NVIDIA Humanoid Robot Developer Program.

    Get Started

      翻译: