Harness Hub
All open source

AgentOps

Agent monitoring, session replays and failure analytics.

AgentOps-AI/agentops

Maintained by AgentOps

AgentOps records every agent session — prompts, tool calls, costs, errors — with replay and evaluation tooling for debugging agent behavior in production.

What the community says

User reports from Hacker News, Reddit, GitHub and reviews, as of Oct 29, 2026. Not our verdict.

Pros people report

  • Integrated early with OpenAI's Agents SDK for seeing handoffs and tool callsHacker News
  • Used in research pipelines (e.g. RL-tuned LangGraph SQL agent with Agent Lightning)Hacker News
  • MIT-licensed SDKGitHub

Cons people report

Best for
Quick session-level agent tracing for Python agent frameworks it supports.
Watch out for
Monkey-patching side effects on your framework version; test streaming/async paths. Community feedback is thin.

Adopting an open-source harness? Read the best-practices guide.

Activity

Last push
· 4mo ago
Latest release
0.4.21
· 1y ago
Last 90 days
0 releases
  1. 0.4.21

    · 1y ago

    What's Changed add back lib by @areibman in https://github.com/AgentOps-AI/agentops/pull/1222 updated gitignore by @areibman in https://github.com/AgentOps-AI/agentops/pull/1223 new screenshots by @areibman in https://github.com/AgentOps-AI/agentops/pull/1224 feat(sync): sync…

  2. 0.4.20

    · 1y ago

    What's Changed Add video embeds to docs by @srilaasya in https://github.com/AgentOps-AI/agentops/pull/1189 AgentOps OSS release by @areibman in https://github.com/AgentOps-AI/agentops/pull/1190 Update backend run instructions in docs by @areibman in…

  3. 0.4.19

    · 1y ago

    What's Changed docs: update examples from notebooks by @github-actions[bot] in https://github.com/AgentOps-AI/agentops/pull/1154 Create openai responses api test by @areibman in https://github.com/AgentOps-AI/agentops/pull/1156 Migrate from pyautogen to ag2 Library by…

  4. 0.4.18

    · 1y ago

    What's Changed [tests] coverage dopamine by @bboynton97 in https://github.com/AgentOps-AI/agentops/pull/1126 fix mcp docs by @michi-okahata in https://github.com/AgentOps-AI/agentops/pull/1129 Cursor/improve agno tool integrations py output d88d by @areibman in…

  5. 0.4.17

    · 1y ago

    What's Changed Add separate docs for OpenAI Agents SDKs by @areibman in https://github.com/AgentOps-AI/agentops/pull/1080 Update session management documentation to reflect current trace-based architecture by @devin-ai-integration in…

Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.

The team behind it

Agent observability, testing and session replay.

AgentOps instruments agents to record every step, cost and tool call — then lets teams replay sessions and build regression tests from real failures.

3 pros · 4 cons

alibaba/open-code-review

Alibaba's hybrid deterministic-plus-agent code review CLI.

Maintained by Alibaba

v1.13.13released
4 pros · 4 cons

stanfordnlp/dspy

Programming, not prompting: optimize the whole pipeline.

Maintained by Stanford NLP

3.5.0released
3 pros · 4 cons
Featured

langfuse/langfuse

Open-source LLM engineering platform: traces, evals, prompts.

Maintained by Langfuse

v4.83.0released
4 pros · 5 cons

Connections

Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.

Maintained by · 1

Similar entries · 4

The Harness Hub newsletter

New harness companies, projects, releases and the monthly State of Harness report, in your inbox.