STK-03 · The Physical AI Stack

Nvidia Isaac and GR00T: What They Are and Why Robotics Teams Are Building on Them

A plain-English breakdown of Nvidia's Isaac simulation stack and GR00T foundation model line, and why humanoid and industrial robotics teams are standardizing on both.

Physical AI technology stack, from sensing to actuationPERCEPTIONcameras · lidar · force-torqueWORLD MODELstate estimationPOLICY / VLAplanningCONTROLROS 2 · real-time loopACTUATIONmotors · grippersSTK-03 · SIGNAL PATH

Ask five robotics engineers what “Isaac” means and you’ll get five different answers — a simulator, a set of libraries, a hardware platform, a foundation model. That confusion is itself a clue to why Nvidia’s robotics stack has become the default starting point for so many teams: it isn’t one product, it’s an entire vertical, from the chip in the robot’s head to the model deciding what its hands should do next.

What is Nvidia Isaac, exactly?

Isaac is Nvidia’s umbrella brand for physical AI development tools, and it splits into three jobs that used to require three separate vendors. Isaac Sim is the simulation environment, built on Nvidia Omniverse, where teams render photorealistic scenes and synthetic training data. Isaac Lab is the reinforcement-learning and policy-training framework that runs on top of that simulation, letting a robot fail a million times in software before it ever falls over in a warehouse. And Isaac’s runtime libraries — perception, manipulation, navigation — are what actually ships on the robot’s onboard compute, most often an Nvidia Jetson module.

So when someone says “we build on Isaac,” they usually mean some combination of: we simulate in Isaac Sim, we train policies in Isaac Lab, and we deploy on Jetson hardware running Isaac’s inference stack. It’s a pipeline, not a single tool — which is precisely what makes it attractive to a team that doesn’t want to stitch together a physics engine, a training framework, and an embedded runtime from three unrelated open-source projects.

What is GR00T, and how is it different from Isaac?

If Isaac is the workshop, GR00T is the thing being built inside it. Isaac GR00T is Nvidia’s foundation model line for general-purpose robots — first announced as GR00T N1 at GTC in San Jose on March 18, 2025, where Nvidia billed it as the world’s first open, customizable foundation model for humanoid robots. Where a traditional robot policy is trained from scratch for one arm on one task, GR00T is meant to be a starting point a team fine-tunes for their own robot and their own task, the way a language model gets fine-tuned for a specific product rather than trained from zero every time.

The line has moved fast. GR00T N1.5, an improved version of the original release, shipped on Hugging Face alongside Isaac Sim 5.0 and a developer preview of Isaac Lab 2.2 in June 2025, timed to coincide with GTC Paris at VivaTech. By April 2026, Nvidia had pushed out GR00T N1.7 as an early-access release: an openly licensed, commercially usable vision-language-action (VLA) model with 3 billion parameters, built on a Cosmos-Reason2-2B backbone, replacing N1.5 as the default in the LeRobot ecosystem. One honest caveat: Nvidia’s own material and the outlets covering it agree on the month, but no independent source we could find pins down the exact release day, so treat “April 2026” as solid and any specific date within it as unconfirmed.

How does GR00T actually work under the hood?

The original GR00T N1 architecture is a dual-system design that borrows its naming from dual-process theories of cognition. System 2 is a vision-language module that interprets the scene — what’s on the table, what the instruction means, what the robot is looking at. System 1 is a diffusion transformer that turns that interpretation into continuous, real-time motor commands. The split matters because the two jobs run at different speeds: reasoning about a scene can be relatively slow, but generating smooth joint trajectories cannot.

Training data is the other half of the story, and it’s where GR00T differs most from a conventional robotics dataset. N1 was trained on a mix of real robot trajectories, human video, and synthetic data generated in Omniverse — a deliberate bet that a robot doesn’t need to see every task performed by a robot arm if it can also learn from watching people. That bet deepened with N1.7’s EgoScale training approach, which used 20,854 hours of egocentric human video spanning more than 20 task categories. Nvidia’s own reporting on this describes something close to a scaling law for robot dexterity: going from roughly 1,000 to 20,000 hours of this video more than doubled task success rates, which is the kind of data-scaling curve that made large language models take off — now showing up in manipulation.

Why build on this stack instead of rolling your own?

Three reasons keep coming up when robotics teams explain the decision. First, simulation-to-real transfer is genuinely hard, and Isaac Lab’s tie-in with Isaac Sim means a policy trained in synthetic scenes has a documented path to real hardware rather than a research paper’s worth of custom glue code. Second, a foundation model you fine-tune is cheaper to get to a working demo than a policy you train from scratch per task, per robot. Third — and this is easy to underrate — Nvidia owns the full chain from silicon to model to simulator, so the pieces are built to fit each other by default, which is not something you get by combining an open-source physics engine, an independent VLA model, and a third party’s inference chip.

That doesn’t mean every team standardizes on all of it. Plenty use Isaac Sim for simulation while running their own policy stack, or fine-tune GR00T without touching Isaac Lab at all. The pieces are modular enough that “building on Nvidia’s stack” can mean anything from full-stack adoption to borrowing a single layer — one reason comparisons between ROS 2 deployments and Isaac’s own runtime keep coming up when teams decide what to build on.

What hardware does all of this run on?

Foundation models and photorealistic simulation are only useful if something on the robot can run inference fast enough to matter, and that’s the job of Jetson Thor. The module — sold as the T5000 and packaged in the Jetson AGX Thor developer kit — delivers up to 2,070 FP4 TFLOPS of AI compute, 128 GB of LPDDR5X memory at 273 GB/s, and a power envelope of 40 to 130 watts, which Nvidia describes as 7.5 times the AI performance and 3.5 times the energy efficiency of the previous-generation AGX Orin. The developer kit is available through authorized resellers at $3,499. For a foundation model with billions of parameters to run on-device in real time rather than round-tripping to a data center, this jump in onboard compute is not a nice-to-have — it’s the constraint that decided whether models like GR00T could ship outside a lab at all.

Layer Nvidia component What it does
Simulation Isaac Sim (built on Omniverse) Photorealistic scenes, synthetic training data
Policy training Isaac Lab Reinforcement learning and imitation learning on top of simulation
Foundation model Isaac GR00T (N1 → N1.5 → N1.7 → N2) Pretrained vision-language-action model, fine-tuned per robot/task
Onboard compute Jetson Thor (T5000 module) Runs perception and action inference on the physical robot

Who is actually building on this today?

Adoption spans both the humanoid and industrial ends of robotics. Agility Robotics, Figure AI, and Boston Dynamics use Isaac Lab to train control policies. On the industrial side, ABB, FANUC, KUKA, and Yaskawa integrate Isaac’s simulation frameworks into digital twins and virtual commissioning workflows — a pattern covered in more depth in our piece on robot simulation and digital twins. And AGIBOT, LG Electronics, Neura Robotics, and Noble Machines are deploying Isaac GR00T models directly. In Europe specifically, Agile Robots, Extend Robotics, Humanoid, idealworks, Neura Robotics, SICK, Universal Robots, Vorwerk, and Wandelbots all began integrating Isaac, Omniverse, or Nvidia’s Halos safety framework following the GTC Paris announcements in mid-2025. That’s a wide enough cross-section — humanoid startups, decades-old industrial arms, and European fleet operators — that it’s hard to call this a niche developer tool anymore; it’s closer to a shared substrate the industry is converging on, the way most web development converged on a handful of frameworks rather than everyone writing their own.

What comes next — GR00T N2 and Isaac Lab 3.0?

Nvidia has already named the next steps. GR00T N2, built on research Nvidia calls DreamZero, is slated for release before the end of 2026 and is described as more than doubling task success in new environments and tasks compared to leading VLA models — though that figure comes from Nvidia’s own announcement rather than independent benchmarking, so it’s worth treating as a vendor claim until third parties reproduce it. On the tooling side, Isaac Lab 3.0 entered early access, built on a new physics engine called Newton, co-developed with Google DeepMind and Disney Research alongside Nvidia’s PhysX SDK. Newton adds multiphysics simulation and support for more complex hand manipulation, and runs natively alongside Isaac Sim 6.0 — a sign that the harder unsolved problem in this stack right now is less “can a model reason about a task” and more “can simulation get precise enough about contact and dexterity to close the gap with the real world.” That gap is also where synthetic-to-real workflows and teleoperation-based data collection increasingly meet: simulated data alone isn’t enough, so both approaches get combined in practice.

Is this really robotics’ “ChatGPT moment”?

Nvidia CEO Jensen Huang has been careful with this framing over time. At CES 2026 he said the “ChatGPT moment” for robotics is “nearly here” — a notable softening from a year earlier, when he’d said it was “around the corner.” The distinction is subtle but real: “around the corner” is a prediction, “nearly here” is closer to a status update, and the gap between the two says something about how Nvidia itself is calibrating expectations. Whether GR00T N2 or a future release actually delivers a single unmistakable inflection point — the way ChatGPT did for text generation — remains an open question rather than a settled fact, and it’s one worth watching rather than assuming.

None of this exists in isolation from the rest of the physical AI stack; foundation models, simulation, and onboard compute are just three of the layers a working robot needs, which is why they sit alongside topics like fleet orchestration and data pipelines in our overview of the physical AI stack. For teams evaluating whether Isaac and GR00T fit their own robot — humanoid or otherwise — it’s also worth reading up on the broader category first: our guide to humanoid robots covers where foundation models like GR00T fit into that specific race, and the glossary has plain-language definitions for terms like VLA, digital twin, and sim-to-real that come up throughout this stack.

Frequently asked

Is Nvidia GR00T open source?

GR00T N1 was announced as fully open, and later releases have continued that model: GR00T N1.7 is openly licensed and commercially usable, distributed through Hugging Face and the LeRobot ecosystem rather than locked behind a proprietary API.

Do I need Nvidia Jetson hardware to use GR00T?

To run a GR00T model efficiently in real time on a physical robot, you need enough onboard AI compute, and Nvidia's own reference hardware for this is Jetson Thor. Nothing stops a team from prototyping on other hardware, but Nvidia's stack is built and benchmarked assuming Jetson-class compute at the edge.

What's the difference between Isaac Sim and Isaac Lab?

Isaac Sim is the simulation environment itself, built on Omniverse, that renders scenes and physics. Isaac Lab sits on top of it and provides the reinforcement-learning and imitation-learning framework teams use to actually train robot control policies inside those simulated scenes.

Is GR00T only for humanoid robots?

It launched specifically framed around humanoid robots and was demonstrated on humanoid platforms from Fourier and 1X, but the underlying vision-language-action approach is general enough that Nvidia and adopters have also applied it to other robot form factors, including industrial arms.

What is Newton, and how does it relate to Isaac Lab?

Newton is a new physics engine, co-developed by Nvidia with Google DeepMind and Disney Research, that powers Isaac Lab 3.0 in early access. It's built to handle multiphysics and contact-rich manipulation more accurately than previous simulation engines, and runs alongside Isaac Sim 6.0.

How much does Nvidia's robotics developer hardware cost?

The Jetson AGX Thor developer kit, which pairs the T5000 module with a full development environment, is available through authorized resellers at $3,499.

Has GR00T actually shipped in production robots yet?

Adoption is real but still early-stage: companies including AGIBOT, LG Electronics, Neura Robotics, and Noble Machines are deploying Isaac GR00T models, while others like Agility Robotics, Figure AI, and Boston Dynamics use Isaac Lab primarily for policy training rather than running GR00T models directly in shipped products.