PIQA
Not yet importedTwo-choice physical commonsense problems about how everyday goals can be completed in the real world.
1 case previewchatDataset termsversion dataset
Start free
Straightforward import. Two-choice exact grading with no tools or environment provisioning.
What it measures
PIQA focuses on physical intuition: materials, tools, household actions, and plausible ways to achieve a goal. Each problem has two candidate solutions.
The evaluation contract is compact and deterministic. A Trunchbull import can remain entirely in the chat lane with fixed choice grading.
not yet imported
Not yet imported. The work is limited to pinning the public data, preserving choice order, and exact label grading.
Cases
1 previewed| id | case | runtime |
|---|---|---|
| piqa/physical-goal | Physical goal completionChoose the more physically plausible way to accomplish a stated goal. | chat |
Tools
none requiredNo model tools. Cases are answered from the prompt and checked by the grader.