SimplerEnv Google Robot (Variant Aggregation) leaderboard
The same three Google Robot tasks as visual matching, averaged over scene variants: backgrounds, lighting, table textures, distractors and camera poses. It tests robustness rather than real-to-sim fidelity, and is reported separately from visual matching. Scores are the three-task mean, recomputed from per-task values when a paper averages in a fourth task.
Simulation · Google Robot (RT-1 / Fractal) · SAPIEN (ManiSkill2)Report an error
84.9%Best · CORAL
22Models ranked
Near saturationSaturation
Nov 18, 2026Numbers checked
| # | Model | Type | Score | Date | Source |
|---|---|---|---|---|---|
| 1 | CORALFrontier Robotics | VLA | 84.9%, self-reported by the authors, not a leaderboard entry | Mar 2026 | |
| 2 | VLA | 82.3%, self-reported by the authors, not a leaderboard entry | May 2026 | ||
| 3 | VLA | 77.4%, self-reported by the authors, not a leaderboard entry | Feb 2026 | ||
| 4 | SimVLAFrontier Robotics | VLA | 76.2%, self-reported by the authors, not a leaderboard entry | Feb 2026 | |
| 5 | VLA | 76.1%, self-reported by the authors, not a leaderboard entry | Aug 2025 | ||
| 6 | VLA | 75.7%, self-reported by the authors, not a leaderboard entry | Oct 2025 | ||
| 7 | VLA | 74.1%, self-reported by the authors, not a leaderboard entry | May 2025 | ||
| 8 | StarVLAStarVLA Team | VLA | 73.8%, self-reported by the authors, not a leaderboard entry | Apr 2026 | |
| 9 | VLA | 72.1%, self-reported by the authors, not a leaderboard entry | Aug 2025 | ||
| 10 | VLA | 70.8%, self-reported by the authors, not a leaderboard entry | Aug 2025 | ||
| 11 | VLA | 67.5%, self-reported by the authors, not a leaderboard entry | Jan 2025 | ||
| 12 | VLA | 66.2%, self-reported by the authors, not a leaderboard entry | Nov 2024 | ||
| 13 | VLA | 65.6%, reported by a third party | May 2024 | ||
| 14 | Policy | 65.3%, self-reported by the authors, not a leaderboard entry | Mar 2025 | ||
| 15 | VLA | 59.0%, reported by a third party | Aug 2025 | ||
| 16 | VLA | 58.1%, reported by a third party | Jun 2026 | ||
| 17 | VLA | 57.4%, reported by a third party | May 2024 | ||
| 18 | VLA | 54.8%, reported by a third party | Aug 2025 | ||
| 19 | VLA | 49.1%, self-reported by the authors, not a leaderboard entry | Dec 2024 | ||
| 20 | VLA | 40.0%, reported by a third party | Jan 2025 | ||
| 21 | VLA | 36.9%, reported by a third party | May 2024 | ||
| 22 | VLA | 1.6%, reported by a third party | May 2024 |
Metric: Variant-aggregation success, mean of 3 Google Robot tasks (pick coke can, move near, open/close drawer). One result per model: RoboFYI re-run, then official leaderboard, then paper, then third party. Runs that deviate from the official protocol are listed on the model page but not ranked.
Wrong or missing number? Report an error