RoboLab-120 leaderboard

NVIDIA SRL benchmark of 120 held-out tasks (65 simple, 38 moderate, 18 complex) in which policies trained on real-world data run in simulation without sim co-training. Leaderboard submissions are currently paused.

Simulation · Franka (DROID-style, inferred) · Isaac Sim 5.0 / Isaac Lab 2.2Report an error
86.0%Best · AMP1
24Models ranked
OpenSaturation
Nov 18, 2026Numbers checked
#ModelTypeScoreDateSource
1AMP1AppleAgent system86.0%Nov 17, 2026
2SenseNova-RoboRSISenseTimeAgent system57.1%Nov 17, 2026
3FLUX-mimic-xmimicWorld-action51.4%, self-reported by the authors, not a leaderboard entryNov 16, 2026
4LakesidePrIWorld-action51.0%Nov 17, 2026
5BiMind v0.5Bicameral RoboticsVLA49.2%Nov 17, 2026
6GR00T 2NVIDIAWorld-action47.4%, self-reported by the authors, not a leaderboard entryNov 2026
7Praxis-1RunwayWorld-action46.2%Nov 17, 2026
8FLUX 3 ActionBlack Forest LabsWorld-action42.9%Nov 17, 2026
9CosmicGeodesicAgent system42.3%Nov 17, 2026
10HiDream-O1-EmbodiedHiDream.aiVLA39.9%Nov 17, 2026
11Atomic-WAMZJU-APRIL & ACE RoboticsWorld-action39.6%Nov 17, 2026
12OASIS WAMUSTC & SynkrotronWorld-action39.0%Nov 17, 2026
13Cosmos3-Nano-PolicyNVIDIAWorld-action36.8%Nov 17, 2026
14PhoenixGeodesicAgent system34.4%Nov 17, 2026
15BiMind v0.1Bicameral RoboticsVLA33.3%Nov 17, 2026
16VoLoNVIDIAAgent system28.2%Nov 17, 2026
17π0.5Physical IntelligenceVLA28.0%Nov 17, 2026
18DreamZeroNVIDIAWorld-action25.7%Nov 17, 2026
19Cosmos3-Edge-PolicyNVIDIAWorld-action22.9%Nov 17, 2026
20π0-FASTPhysical IntelligenceVLA15.5%Nov 17, 2026
21GR00T N1.7NVIDIAVLA8.6%, self-reported by the authors, not a leaderboard entryNov 17, 2026
22GR00T N1.6NVIDIAVLA7.2%Nov 17, 2026
23π0Physical IntelligenceVLA5.0%Nov 17, 2026
24PaliGemma (binning)Physical IntelligenceVLA3.4%Nov 17, 2026

Metric: Success rate over 120 held-out tasks (10 episodes per task; some agentic entries ran 25). One result per model: RoboFYI re-run, then official leaderboard, then paper, then third party. Runs that deviate from the official protocol are listed on the model page but not ranked.

Wrong or missing number? Report an error