Harness Hub
All open source

OpenAI Evals

Framework and open registry for evaluating LLMs and LLM systems

openai/evals

Maintained by openai

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks. Maintained by OpenAI.

View on GitHub

alibaba/open-code-review

Alibaba's hybrid deterministic-plus-agent code review CLI.

Maintained by Alibaba

4 pros · 4 cons

stanfordnlp/dspy

Programming, not prompting: optimize the whole pipeline.

Maintained by Stanford NLP

3 pros · 4 cons
Featured

langfuse/langfuse

Open-source LLM engineering platform: traces, evals, prompts.

Maintained by Langfuse

4 pros · 5 cons

Connections

Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.

Maintained by · 1

  • openaiOrganisation

Sources

  1. GitHub