Skip to Main Content
Trunchbull
Sign inSign up
PUBLIC REGISTRY
Trunchbull portNo sandbox required

SkateBench

Upstream publisher T3 ContentT3-Content/skatebench

A playful, focused test of whether AI understands skateboard tricks and can follow a precise product recommendation task.

knowledgeinstruction-followingchat
PROVENANCEIMMUTABLE RELEASE
Upstream source
T3-Content/skatebench
Trunchbull port
TrunchbullCI/examples
Version
A4D54C2
Release digest
sha256:c18b…42ef
License
MIT
Source commit: a4d54c2Published July 28, 2026

WHAT THIS PROJECT MEASURES

README

SkateBench tests small but precise pieces of domain knowledge. Cases ask a model to identify a trick from a movement description or choose the expected upload recommendation.

The Trunchbull port preserves all eight upstream cases and grades responses against accepted answer banks, with forbidden phrases checked before accepted answers.

IN PLAIN ENGLISH

SkateBench asks a deceptively human question: does the model really understand the language of skateboarding, or is it guessing from familiar words? The Trunchbull CI port keeps the benchmark small, clear, and easy to inspect, including the separate UploadThing recommendation task.

EXECUTION CONTRACT

Runs in the standard chat lane with an accepted-answer-bank grader.

QUICK ANSWERS

SkateBench, explained

What does SkateBench test?

SkateBench tests specialized skateboard terminology, trick identification, and a concise domain-specific recommendation task.

How many SkateBench cases are included?

The Trunchbull CI port preserves all eight upstream cases and evaluates them with accepted-answer and forbidden-answer rules.

TRUNCHBULL AVAILABILITY

Import status

Trunchbull port

Trunchbull maintains a complete eight-case port with accepted and forbidden answer rules.

View Trunchbull port

3 CASES

Evaluation cases

3

skatebench/tre-flip

Tre flip

Chat lane

Identify a trick from its combined rotation and flip.

skatebench/hardflip

Hardflip

Chat lane

Recognize a frontside shove-it and kickflip combination.

skatebench/upload

Safe video upload

Chat lane

Recommend the expected upload product without extra claims.

0 REQUESTED TOOLS

Tools

0

No model tools required.

Evaluation happens through the prompt and grader contract for this release.

MACHINE-READABLE PROVENANCE

Registry record

{
  "name": "SkateBench",
  "catalogOwner": null,
  "source": {
    "url": "https://github.com/T3-Content/skatebench",
    "version": "upstream a4d54c2 · complete eight-case port",
    "commit": "a4d54c2",
    "license": "MIT"
  },
  "port": {
    "url": "https://github.com/TrunchbullCI/examples/tree/main/benchmarks/skatebench",
    "maintainer": "Trunchbull"
  },
  "release": {
    "digest": "sha256:c18b…42ef",
    "lane": "chat",
    "sandboxRequired": false
  },
  "cases": [
    "skatebench/tre-flip",
    "skatebench/hardflip",
    "skatebench/upload"
  ],
  "tools": []
}

BUILD ON THIS PROJECT

Bring this benchmark into your workspace.

Sign up