WinoGrande
Not yet importedLarge-scale pronoun-resolution problems that require commonsense reasoning to resolve an ambiguous reference.
1 case previewchatDataset termsversion xl
Start free
Straightforward import. Static two-choice evaluation in the standard chat lane.
What it measures
WinoGrande presents sentences with a blank and two candidate referents. The correct answer depends on commonsense rather than local grammar alone.
The benchmark maps cleanly to Trunchbull's exact-choice evaluation path. No model tools, code execution, or sandbox environment are needed.
not yet imported
Not yet imported. A faithful release needs the selected split pinned and answer positions rendered without leaking labels.
Cases
1 previewed| id | case | runtime |
|---|---|---|
| winogrande/xl | Commonsense coreferenceResolve an ambiguous reference using the surrounding situation. | chat |
Tools
none requiredNo model tools. Cases are answered from the prompt and checked by the grader.