Not yet importedNo sandbox required

IFEval

Upstream publisher Google Researchgoogle-research/google-research

Verifiable instruction-following tasks that test whether a model can satisfy precise format, length, language, and content constraints.

instruction-followingformatchat

PROVENANCEUPSTREAM RECORD

Upstream source: google-research/google-research
Trunchbull port: Not packaged
Version: MASTER
Release digest: Not compiled
License: Apache-2.0

Source commit: Upstream head not pinnedPublished Indexed July 30, 2026

WHAT THIS PROJECT MEASURES

README

IFEval turns instruction following into something that can be checked rather than judged by impression. Each prompt carries one or more constraints with deterministic verification logic.

Trunchbull has indexed the upstream project but has not produced a faithful release. Importing the prompts is straightforward; parity depends on packaging the specialized constraint graders and recording their per-constraint results.

EXECUTION CONTRACT

No sandbox is required, but a faithful import needs the upstream constraint verifiers rather than a generic text grader.

TRUNCHBULL AVAILABILITY

Import status

Not yet imported

Not yet imported. Trunchbull needs to package the upstream constraint registry and expose per-instruction verification evidence.

2 CASES

Evaluation cases

ifeval/keywords

Required keywords

Chat lane

Produce a response that includes a fixed set of required terms.

ifeval/format

Exact response format

Chat lane

Follow structural constraints such as sections, bullets, or delimiters.

0 REQUESTED TOOLS

Tools

No model tools required.

Evaluation happens through the prompt and grader contract for this release.

MACHINE-READABLE PROVENANCE

Registry record

{
  "name": "IFEval",
  "catalogOwner": null,
  "source": {
    "url": "https://github.com/google-research/google-research/tree/master/instruction_following_eval",
    "version": "Upstream master",
    "commit": "Upstream head not pinned",
    "license": "Apache-2.0"
  },
  "port": null,
  "release": {
    "digest": "Not compiled",
    "lane": "chat",
    "sandboxRequired": false
  },
  "cases": [
    "ifeval/keywords",
    "ifeval/format"
  ],
  "tools": []
}

BUILD ON THIS PROJECT