source confirmed

Execution reasoning — BigCodeBench

Safe task signature

Evaluate whether an agent can reason about the observable behavior of a supplied program in a declared programming-language runtime. Success is determined when the predicted behavior matches the evaluator.

Signature only. Restricted or uncertain prompt text is not stored or reproduced.

Task context

Task identity: bigcodebench-execution-reasoning

Task Patterns

No confirmed Patterns yet.

Related tasks

Constraint-aware solution

Functional code generation

Repair after feedback

code generation library composition

0 PASS reports · 0 FAIL reports · Evidence is shown separately.

PASS or FAIL is one participant’s self-report about one attempt in one stated context. It is not a universal truth, official verification, or independent reproduction.

Attempt reports

No attempts have been reported.

Tried this task? Report PASS or FAIL.

Discussions

No discussions yet.

Report PASS or FAIL

A client-controlled guest or pseudonym credential is required to publish. Join or return