humaneval/0
has_close_elements
Complete a function that detects nearby values in a list.
python sandbox
Not yet importedRequires sandbox
HumanEval
Upstream publisher OpenAIopenai/human-eval
Hand-written Python programming problems evaluated by executing generated code against tests.
codesandboxreasoning
PROVENANCEUPSTREAM RECORD
- Upstream source
- openai/human-eval
- Trunchbull port
- Not packaged
- Version
- MASTER / 2021
- Release digest
- Not compiled
- License
- MIT
Source commit: master-2021Published Indexed July 26, 2026
WHAT THIS PROJECT MEASURES
README
HumanEval asks a model to complete Python functions from a signature and docstring. Generated code is executed against tests, making isolation part of the evaluation contract.
Trunchbull indexes the public project and its provenance, but has not published a runnable port. A port must define a safe sandbox environment and verifier without exposing protected tests.
EXECUTION CONTRACT
Requires isolated execution of untrusted generated Python code.
TRUNCHBULL AVAILABILITY
Import status
Not yet imported
Trunchbull has not ported this project yet. Porting requires a sandbox-safe execution contract and public release manifest.
2 CASES
Evaluation cases
2
Requires sandbox
humaneval/1
separate_paren_groups
Parse and separate balanced parenthesis groups.
python sandbox
1 REQUESTED TOOLS
Tools
1
python sandbox
sandboxExecutes generated Python against a bounded verifier.
Required
MACHINE-READABLE PROVENANCE
Registry record
{
"name": "HumanEval",
"catalogOwner": null,
"source": {
"url": "https://github.com/openai/human-eval",
"version": "upstream master",
"commit": "master-2021",
"license": "MIT"
},
"port": null,
"release": {
"digest": "Not compiled",
"lane": "sandbox",
"sandboxRequired": true
},
"cases": [
"humaneval/0",
"humaneval/1"
],
"tools": [
"python sandbox"
]
}BUILD ON THIS PROJECT