Quest

Test your prompts, agents and RAG — plus red-teaming.

promptfoo is an open-source testing framework for LLM apps: eval matrices, assertions, RAG metrics and an AI red-teaming scanner for vulnerabilities. Config-in-YAML, CI-friendly.

Self-hosted agent runtime with durable approvals.

Open Multi-Agent is the open-source runtime behind QM: a self-hosted TypeScript agent runtime with durable approvals and verifiable run records — 'own it, approve it, audit it' — built for multiplayer agent work.

The evaluation framework used by a national safety institute.

Inspect is the UK AI Safety Institute's open-source framework for large-scale model evaluations — tasks, solvers, scorers and tool sandboxes. The serious-science end of agent evals.