Benchmarks › Tasks › The builder
The builder
Create 144 directories to spec. Trivial in substance — what is measured is not whether it works but what it costs: one call or a hundred and fifty.
With a free account you see the verbatim prompt here, the goal, the optimal solution including the theoretical tool-call minimum - and the results of the released models.