try it ยท no account needed
Try a benchmark.
Pick up to three models, run a fixed set of cases, and see how each answer was graded. No sign-up and no API key.
| benchmark | kind | grader | Actions |
|---|---|---|---|
GSM8KMulti-step grade-school math problems with one numeric answer. | Math reasoning20 cases | Exact numeric answer | |
SkateBenchName technical skateboard tricks from a description of the movement. | Domain knowledge8 cases | Accepted answer bank | |
ARC-ChallengeChallenging multiple-choice grade-school science questions. | Science reasoning20 cases | Exact answer choice | |
TruthfulQA MC1Pick the truthful answer over familiar, persuasive misconceptions. | Truthfulness20 cases | Exact MC1 answer choice | |
Medical AI Failure AtlasEscalation, uncertainty, medication caution and false reassurance. | Medical AI safety20 cases | Deterministic medical safety gates | |
MIHENKTurkish and English reasoning questions from 20 disciplines. | Bilingual reasoning20 cases | MIHENK reference scorer |
Want this on your own cases, with gates on every push?
Try a free account