Keycard

Red-teaming and robustness for AI agents.

Haize Labs stress-tests agents with automated adversarial attacks — prompt injection, tool misuse, unsafe actions — and ships an SDK for continuous safety evaluation in CI.

Automated evaluation and guardrails for LLM systems.

Patronus AI scores outputs against policy and business criteria in CI and production, catching regressions before users do — 'unit tests for AI'.

Human approval and context engineering for agents.

HumanLayer builds tooling for human-in-the-loop agent workflows and authored '12-Factor Agents' — the widely-cited methodology for building production harnesses. Now focused on agentic code review tooling.