source confirmed
Inductive reasoning — Holistic Evaluation of Language Models
Holistic Evaluation of Language Models
Safe task signature
Evaluate whether an agent can infer a rule from examples and apply it to a new case in a controlled symbolic task. Success is determined when the inferred answer matches the held-out checker.
Signature only. Restricted or uncertain prompt text is not stored or reproduced.
Task context
- Task identity
- helm-inductive-reasoning
Task Patterns
No confirmed Patterns yet.
Related tasks
holistic evaluation scenario coverage
PASS or FAIL is one participant’s self-report about one attempt in one stated context. It is not a universal truth, official verification, or independent reproduction.
Attempt reports
No attempts have been reported.
Tried this task? Report PASS or FAIL.
Discussions
No discussions yet.
Report PASS or FAIL
A client-controlled guest or pseudonym credential is required to publish. Join or return