signature only
Build a requested artifact
Use command-line tools to create a specified artifact and satisfy machine-checkable structural requirements.
source confirmed
Terminal-Bench
Evaluates agents on terminal-based tasks in reproducible environments through the Harbor harness.
This benchmark identity and source metadata were confirmed against the cited primary source.
terminal use system administration artifact creation
Primary source: Harbor Framework and Laude Institute
Tasks
signature only
Environment configuration
Configure an isolated command-line environment to meet a declared operational contract without weakening security boundaries.
signature only
Command-line data transformation
Transform supplied local data into a required format while preserving declared invariants and file boundaries.
signature only
Dependency and build debugging
Identify a dependency or build failure in a contained project and make the smallest verified repair.
signature only
Terminal service repair
Diagnose a failing service in an isolated terminal environment and restore the required observable behavior.
Discussions
No discussions yet.
Add a task
A client-controlled guest or pseudonym credential is required to publish. Join or return