Open sourcePython · ≈12k stars · Elastic-2.0
Phoenix
Open-source AI observability and evals from Arize.
Phoenix traces LLM/agent runs, evaluates them (LLM-as-judge, retrieval metrics) and surfaces regressions — Arize's open-source core for debugging agents in production.
What the community says
User reports from Hacker News, Reddit, GitHub and reviews, as of Oct 29, 2026. Not our verdict.
Pros people report
- Very simple architecture with nice tracing; users report no complaints for tracingHacker News
- OpenTelemetry/OpenInference-native and runs locally; works for things like Claude Code observability via a LiteLLM proxyHacker NewsReddit (archived snapshot)
- Strong ML-observability pedigree for teams with existing ML infraDEV Community
- Maintainers responsive on licensing: clients were relicensed to Apache-2.0 after a requestGitHub issue Arize-ai/phoenix#9890
Cons people report
- Some users would use separate tools for evals, datasets and prompts rather than Phoenix'sHacker News
- Setup is harder and the UI targets data scientists more than backend devsDEV Community
- The full Arize platform is aimed at larger orgs (drift and embedding monitoring beyond what small teams need)Reddit (archived snapshot)
- Licensing nuance: parts were Elastic License 2.0, which complicated OSS compatibilityGitHub issue Arize-ai/phoenix#9890
- Best for
- Local or self-hosted OTel tracing for LLM apps, especially teams already in the Arize/ML ecosystem.
- Watch out for
- Licensing terms of the components you embed, and whether its eval/prompt features fit your workflow.
Adopting an open-source harness? Read the best-practices guide.
Activity
- Last push
- · yesterday
- Latest release
- arize-phoenix-v22.0.0
· yesterday - Last 90 days
- 20+ releases
arize-phoenix-v22.0.0arize-phoenix: v22.0.0
· yesterday22.0.0 (2026-11-20) MIGRATION Features add type column to generative_models (3047aab) cost-tracking: calculate costs for DECISION spans (#17764) (0f83453) cost-tracking: calculate costs for EMBEDDING spans (#17788) (0f39d64) cost-tracking: expose generative model type in…
arize-phoenix-v21.3.0arize-phoenix: v21.3.0
· yesterday21.3.0 (2026-11-20) Features brand: set the Arize Phoenix wordmark in Geist (#18086) (b176371) cli: add dataset label assignment commands (#17973) (0b821b2) pxi: refresh recommended models and preserve chat transcripts (#18101) (4270bce) Bug Fixes build: let the publish wheel…
- · 2d ago
Minor Changes 0b821b2: Add px dataset-labels list, add, remove, and replace commands to manage existing label assignments by dataset name or GlobalID, including explicitly clearing all assignments. Patch Changes 4270bce: Limit PXI to two recommended models per provider: Claude…
- · 2d ago
Patch Changes 02ed180: Remove Slack community links from the package README Updated dependencies [02ed180] @arizeai/phoenix-config@0.5.2 @arizeai/phoenix-otel@3.1.1
- · 2d ago
Patch Changes 02ed180: Remove Slack community links from the package README Updated dependencies [02ed180] @arizeai/phoenix-config@0.5.2
Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.
The team behind it
Berkeley, CA · Est. 2020
Observability and evaluation for AI — makers of OSS Phoenix.
Arize traces and evaluates LLM and agent systems in production; their open-source Phoenix tracer is a common instrumentation choice for agent harnesses that need to be debuggable.
Neighbours on the workbench
Go · ≈55k stars · Apache-2.0
alibaba/open-code-review
Alibaba's hybrid deterministic-plus-agent code review CLI.
Maintained by Alibaba
v1.13.13releasedPython · ≈39k stars · MIT
stanfordnlp/dspy
Programming, not prompting: optimize the whole pipeline.
Maintained by Stanford NLP
3.5.0releasedTypeScript · ≈38k stars · Other
langfuse/langfuse
Open-source LLM engineering platform: traces, evals, prompts.
Maintained by Langfuse
v4.83.0releasedConnections
Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.
Maintained by · 1
- Arize AIStartup
Similar entries · 6
- Arize AIStartup
- LaminarStartup
- LangfuseProject
- OpenLLMetryProject
- OpikProject
- RagaAI-CatalystProject
