Harness Hub
All open source

Phoenix

Open-source AI observability and evals from Arize.

Arize-ai/phoenix

Maintained by Arize AI

Phoenix traces LLM/agent runs, evaluates them (LLM-as-judge, retrieval metrics) and surfaces regressions — Arize's open-source core for debugging agents in production.

What the community says

User reports from Hacker News, Reddit, GitHub and reviews, as of Oct 29, 2026. Not our verdict.

Pros people report

Cons people report

  • Some users would use separate tools for evals, datasets and prompts rather than Phoenix'sHacker News
  • Setup is harder and the UI targets data scientists more than backend devsDEV Community
  • The full Arize platform is aimed at larger orgs (drift and embedding monitoring beyond what small teams need)Reddit (archived snapshot)
  • Licensing nuance: parts were Elastic License 2.0, which complicated OSS compatibilityGitHub issue Arize-ai/phoenix#9890
Best for
Local or self-hosted OTel tracing for LLM apps, especially teams already in the Arize/ML ecosystem.
Watch out for
Licensing terms of the components you embed, and whether its eval/prompt features fit your workflow.

Adopting an open-source harness? Read the best-practices guide.

Activity

Last push
· yesterday
Latest release
arize-phoenix-v22.0.0
· yesterday
Last 90 days
20+ releases
  1. arize-phoenix-v22.0.0arize-phoenix: v22.0.0

    · yesterday

    22.0.0 (2026-11-20) MIGRATION Features add type column to generative_models (3047aab) cost-tracking: calculate costs for DECISION spans (#17764) (0f83453) cost-tracking: calculate costs for EMBEDDING spans (#17788) (0f39d64) cost-tracking: expose generative model type in…

  2. arize-phoenix-v21.3.0arize-phoenix: v21.3.0

    · yesterday

    21.3.0 (2026-11-20) Features brand: set the Arize Phoenix wordmark in Geist (#18086) (b176371) cli: add dataset label assignment commands (#17973) (0b821b2) pxi: refresh recommended models and preserve chat transcripts (#18101) (4270bce) Bug Fixes build: let the publish wheel…

  3. @arizeai/phoenix-cli@1.24.0

    · 2d ago

    Minor Changes 0b821b2: Add px dataset-labels list, add, remove, and replace commands to manage existing label assignments by dataset name or GlobalID, including explicitly clearing all assignments. Patch Changes 4270bce: Limit PXI to two recommended models per provider: Claude…

  4. @arizeai/phoenix-client@8.0.2

    · 2d ago

    Patch Changes 02ed180: Remove Slack community links from the package README Updated dependencies [02ed180] @arizeai/phoenix-config@0.5.2 @arizeai/phoenix-otel@3.1.1

  5. @arizeai/phoenix-otel@3.1.1

    · 2d ago

    Patch Changes 02ed180: Remove Slack community links from the package README Updated dependencies [02ed180] @arizeai/phoenix-config@0.5.2

Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.

The team behind it

Observability and evaluation for AI — makers of OSS Phoenix.

Arize traces and evaluates LLM and agent systems in production; their open-source Phoenix tracer is a common instrumentation choice for agent harnesses that need to be debuggable.

4 pros · 5 cons

alibaba/open-code-review

Alibaba's hybrid deterministic-plus-agent code review CLI.

Maintained by Alibaba

v1.13.13released
4 pros · 4 cons

stanfordnlp/dspy

Programming, not prompting: optimize the whole pipeline.

Maintained by Stanford NLP

3.5.0released
3 pros · 4 cons
Featured

langfuse/langfuse

Open-source LLM engineering platform: traces, evals, prompts.

Maintained by Langfuse

v4.83.0released
4 pros · 5 cons

Connections

Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.

Maintained by · 1

Similar entries · 6

The Harness Hub newsletter

New harness companies, projects, releases and the monthly State of Harness report, in your inbox.