Open sourcePython · ≈6.0k stars · MIT
AgentOps
Agent monitoring, session replays and failure analytics.
AgentOps records every agent session — prompts, tool calls, costs, errors — with replay and evaluation tooling for debugging agent behavior in production.
What the community says
User reports from Hacker News, Reddit, GitHub and reviews, as of Oct 29, 2026. Not our verdict.
Pros people report
- Integrated early with OpenAI's Agents SDK for seeing handoffs and tool callsHacker News
- Used in research pipelines (e.g. RL-tuned LangGraph SQL agent with Agent Lightning)Hacker News
- MIT-licensed SDKGitHub
Cons people report
- Instrumentation can break frameworks: async streaming broke in Agno until agentops.init() was removedGitHub issue AgentOps-AI/agentops#1262
- Framework-compat warnings and missed sessions reported (Google ADK, CrewAI + Azure OpenAI)GitHub issue AgentOps-AI/agentops#1257GitHub issue AgentOps-AI/agentops#907
- Overlap with first-party tracing raises the question of why you'd add itHacker News
- Best for
- Quick session-level agent tracing for Python agent frameworks it supports.
- Watch out for
- Monkey-patching side effects on your framework version; test streaming/async paths. Community feedback is thin.
Adopting an open-source harness? Read the best-practices guide.
Activity
- Last push
- · 4mo ago
- Latest release
- 0.4.21
· 1y ago - Last 90 days
- 0 releases
- · 1y ago
What's Changed add back lib by @areibman in https://github.com/AgentOps-AI/agentops/pull/1222 updated gitignore by @areibman in https://github.com/AgentOps-AI/agentops/pull/1223 new screenshots by @areibman in https://github.com/AgentOps-AI/agentops/pull/1224 feat(sync): sync…
- · 1y ago
What's Changed Add video embeds to docs by @srilaasya in https://github.com/AgentOps-AI/agentops/pull/1189 AgentOps OSS release by @areibman in https://github.com/AgentOps-AI/agentops/pull/1190 Update backend run instructions in docs by @areibman in…
- · 1y ago
What's Changed docs: update examples from notebooks by @github-actions[bot] in https://github.com/AgentOps-AI/agentops/pull/1154 Create openai responses api test by @areibman in https://github.com/AgentOps-AI/agentops/pull/1156 Migrate from pyautogen to ag2 Library by…
- · 1y ago
What's Changed [tests] coverage dopamine by @bboynton97 in https://github.com/AgentOps-AI/agentops/pull/1126 fix mcp docs by @michi-okahata in https://github.com/AgentOps-AI/agentops/pull/1129 Cursor/improve agno tool integrations py output d88d by @areibman in…
- · 1y ago
What's Changed Add separate docs for OpenAI Agents SDKs by @areibman in https://github.com/AgentOps-AI/agentops/pull/1080 Update session management documentation to reflect current trace-based architecture by @devin-ai-integration in…
Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.
The team behind it
San Francisco, CA · Est. 2023
Agent observability, testing and session replay.
AgentOps instruments agents to record every step, cost and tool call — then lets teams replay sessions and build regression tests from real failures.
Neighbours on the workbench
Go · ≈55k stars · Apache-2.0
alibaba/open-code-review
Alibaba's hybrid deterministic-plus-agent code review CLI.
Maintained by Alibaba
v1.13.13releasedPython · ≈39k stars · MIT
stanfordnlp/dspy
Programming, not prompting: optimize the whole pipeline.
Maintained by Stanford NLP
3.5.0releasedTypeScript · ≈38k stars · Other
langfuse/langfuse
Open-source LLM engineering platform: traces, evals, prompts.
Maintained by Langfuse
v4.83.0releasedConnections
Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.
Maintained by · 1
- AgentOpsStartup
Similar entries · 4
- AgentOpsStartup
- ArthurStartup
- Claude Code Agent MonitorProject
- SentrialStartup
