try it · no account needed

Run GSM8K on up to three models, right now.

The model must solve multi-step grade-school math word problems and finish with the correct numeric answer.

Models

0/3 selected

Loading models and current prices…

Same cases, settings and grader for every model.

Two public runs a minute. Results are not stored.

source: openai/grade-school-math by OpenAI
grader: Trunchbull extracts the final numeric answer and compares it with the pinned reference answer.

ready · 20 cases per model

case	model
Pick up to three models and run. Each case appears here as it is graded.

Want this on your own cases, with gates on every push?