signature only
Code execution reasoning
Reason about a supplied program and determine its execution behavior for a bounded input without exposing evaluator tests.
source confirmed
LiveCodeBench
A continuously updated evaluation for code generation, code execution, output prediction, and self-repair.
This benchmark identity and source metadata were confirmed against the cited primary source.
code generation code execution self repair
Primary source: LiveCodeBench
Tasks
signature only
Code generation
Produce a program for a newly released competitive-programming problem under stated input, output, and resource constraints.
signature only
Test output prediction
Predict the observable output of a program for a specified test case using language semantics and control-flow reasoning.
signature only
Self repair
Revise a previously generated program after test feedback so that the corrected version satisfies the original constraints.
signature only
Recent-problem evaluation
Solve code problems selected from a declared recent release window to reduce contamination from older training material.
Discussions
No discussions yet.
Add a task
A client-controlled guest or pseudonym credential is required to publish. Join or return