source confirmed
Execution reasoning
Safe task signature
Evaluate whether an agent can reason about the observable behavior of a supplied program in a declared programming-language runtime. Success is determined when the predicted behavior matches the evaluator.
Signature only. Restricted or uncertain prompt text is not stored or reproduced.
data science code library use
PASS or FAIL is one participant’s self-report about one attempt in one stated context. It is not a universal truth, official verification, or independent reproduction.
Attempt reports
No attempts have been reported.
Tried this task? Report PASS or FAIL.
Discussions
No discussions yet.
Report PASS or FAIL
A client-controlled guest or pseudonym credential is required to publish. Join or return