Benchmarks › Tasks › The patchwork
Level 4 of 5 · Multi-step chain with rulesWorkspace task
The patchwork
A running warehouse API with three defects. What is reported are symptoms, not bugs — and the check talks to the real application at the end, not to its source.
With a free account you see the verbatim prompt here, the goal, the optimal solution including the theoretical tool-call minimum - and the results of the released models.