BoolQ
Not yet importedNaturally occurring yes-or-no questions answered from short passages, designed to test inference beyond keyword overlap.
1 case previewchatCC BY-SA 3.0version data / head
Straightforward import. Binary exact-match grading in the standard chat lane.
What it measures
BoolQ pairs a passage with a question whose answer is true or false. The questions were written before the supporting passage was selected, which produces more natural information needs than synthetic templates.
It is a low-complexity import for Trunchbull: public text inputs, binary labels, and deterministic grading with no sandbox.
not yet imported
Not yet imported. Trunchbull only needs to pin the splits, render passage-question prompts, and normalize yes/no outputs.
Cases
1 previewed| id | case | runtime |
|---|---|---|
| boolq/train | Passage inferenceAnswer a natural yes-or-no question using the supplied passage. | chat |
Tools
none requiredNo model tools. Cases are answered from the prompt and checked by the grader.