try it · no account needed
Run ARC-Challenge on up to three models, right now.
The model must reason through challenging grade-school science questions and select the correct multiple-choice answer.
Models
0/3 selectedLoading models and current prices…
Same cases, settings and grader for every model.
Two public runs a minute. Results are not stored.
- source
- allenai/ai2_arc by Peter Clark et al.
- grader
- Trunchbull extracts the final answer letter and compares it exactly with the published ARC answer key.
ready · 20 cases per model
| case | model |
|---|---|
| Pick up to three models and run. Each case appears here as it is graded. | |
Want this on your own cases, with gates on every push?
Start free