Robotics research · Image goals / 0.1
Does it only look finished?
A goal image describes the destination. This experiment asks Jev to judge the current scene, then compares its answer with the simulator’s physical state. Missing shoes and misleading arrangements stay in the results.
Physical reference
Recorded simulator labels. A single image may not reveal hidden contact or sustained support.
Jev judgment
A remote research judgment. This page sends no images, runs no model and commands no robot.
Count the misses. Keep the clock honest.
Judgment accuracy uses the frozen, observability-aware verdict for every planned case: complete, incomplete, or unknown. A correct abstention matters when an image cannot establish hidden motion, contact or dwell. Errors and cases not run remain in the planned denominator; no score is claimed before requests are attempted. Physical false-completion and missing-target counts retain every planned negative case, with answered coverage shown separately.
| Decision check | Correct | Denominator |
|---|
| Latency scope | Timed requests | p50 | p95 | p99 | Maximum |
|---|
Timing is recorded wall-clock latency, not the robot’s reaction time or simulator timestep. Quantiles use linear interpolation and retain timed errors in the all-attempt row. A small cohort cannot establish production tail latency. Missing measurements remain unreported.
This benchmark uses synthetic simulation fixtures and a hosted decision model. It does not publish trained robot weights or demonstrate hardware transfer. The DVIDIA code license does not grant rights to the DVIDIA marks or to an external model.