Harness Hub
All open source

Terminal-Bench

Hard, containerized terminal tasks, scored end to end.

harbor-framework/terminal-bench

Maintained by Harbor

Terminal-Bench is the terminal-task benchmark coding agents now cite next to SWE-bench: hard, containerized tasks scored end to end. Version 2.0 runs on the Harbor evaluation framework; the 1.0 task set lives on in the org's repos.

Activity

Last push
· yesterday
Latest release
v4.1.0
· 2w ago
Last 90 days
2 releases
  1. v4.1.0

    · 2w ago

    Published dataset: https://hub.harborframework.com/datasets/terminal-bench/terminal-bench/5 Terminal-Bench 4.1 implements verifier fixes, reproducibility improvements, hardening against reward hacking. Also implements a new CPU-only dataset containing 63 tasks. Tasks added or…

  2. v4.0.0

    · 2mo ago

    Release blog: https://www.tbench.ai/news/terminal-bench-4-0 Published dataset: https://hub.harborframework.com/datasets/terminal-bench/terminal-bench/4 Tasks removed: cli-2ph-simplex erp-procurement-planning exam-pdf-eval fix-uautomizer-soundness gpt2-codegolf ico-path-patch…

  3. v3.0.0

    · 4mo ago

    Added initial 74 Tasks atrx-vep-crispr — @scaleai-bot batched-eval-parity — @tommasocerruti biped-contact-dynamics — @QingquanBao bun-sourcemap-leak — @sherifarm cad-model — @k-rl cargo-flight-dispatch — @pankajjajoo-turing cli-2ph-simplex — @sherifarm coq-block-bound —…

Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.

In the news

Today, we’re expanding GitHub Copilot Fusion with new models, available on more Copilot surfaces, and results on two public Terminal-Bench leaderboards, giving you more ways to use Fusion and compare… The post GitHub Copilot Fusion updates: more availability, benchmarks, and m...

In research (13)

Showing the 6 newest of 13 papers.

alibaba/open-code-review

Alibaba's hybrid deterministic-plus-agent code review CLI.

Maintained by Alibaba

v1.13.13released
4 pros · 4 cons

stanfordnlp/dspy

Programming, not prompting: optimize the whole pipeline.

Maintained by Stanford NLP

3.5.0released
3 pros · 4 cons
Featured

langfuse/langfuse

Open-source LLM engineering platform: traces, evals, prompts.

Maintained by Langfuse

v4.83.0released
4 pros · 5 cons

Connections

Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.

The Harness Hub newsletter

New harness companies, projects, releases and the monthly State of Harness report, in your inbox.