Fast-tracking the path to general-purpose robots.
Label: "places cup on shelf"
Label: "glasses back to the cupboard · parked 00:49:40"
Oven on at 00:00. Checked at 01:05. Both ends linked.
The phone rings mid-task. The pause, the resume point, the return.
Glasses parked on a shelf. Back in the cupboard two hours later.
The plate drops. Nothing is re-shot.
Same job, same kitchen, 24 runs, different starting states.
The same footage cut into 30 to 60 second clips, shuffled.
The same clips, each with a written summary of what came before.
Full continuity plus our decision, obligation and state annotations.
If C wins, and wins by more as the gap widens, this data does something clips cannot. If it doesn't, you lost nothing.
episode_0412/├─ head.mp4 1920×1080 · 30 fps · 3 h 14 min├─ wrist_l.mp4 synced to head├─ wrist_r.mp4├─ decisions.jsonl one record at every branch├─ state.jsonl goal · suspended · owed · where things are├─ links.jsonl cause → consequence · fail → recover├─ subtasks.jsonl {t0, t1, phase, label}├─ hands.npz 21 keypoints × 2 hands, per frame└─ meta.json run, initial state, consent, known gaps
RLDS, LeRobot, or the schema you already use.
Reviewed by a second person. Gaps listed, not hidden.
One full episode, free, with the test run on it.
One free episode on a job you choose. We reply within five hours.
Fast-tracking the path to general-purpose robots