Contribute
Grow the benchmark
Talk to the onboarding agent: describe the robotics problem (optionally a source repository for the oracle), answer a few questions, and it builds the task, runs the oracle to measure the anchor, gates it on the real evaluator, and opens a pull request — stopping honestly if a task genuinely can't be built.
Each task on the left is one contribution, with its live status. The chat is durable — close the tab and the onboarding container keeps running; come back to see where it got to. Once a task passes the evaluator, the agent hands it off and a pull request opens for maintainer review. A finished task is one folder — task.yaml, instruction.md, oracle/ and verify/ — that passes ale lint and ale validate.
Checking session…