Open sourcePython · ≈4.3k stars · Apache-2.0
SkillEvaluator
Framework for evaluating AI agent skills and plugins.
NVIDIA/SkillEvaluator
Maintained by NVIDIA
Multi-tier framework for evaluating AI agent skills and plugins. It includes quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
Activity
- Last push
- · today
- Latest release
- v1.0.1
· 3d ago - Last 90 days
- 12 releases
v1.0.1SkillEvaluator v1.0.1
· 3d ago🎉 Introducing SkillEvaluator v1.0.1, our first complete release in the 1.0 series. Understand how your skills load, measure how they perform, and bring automated evaluation into your workflow with HarnessCheck, NeMo Gym integration, and improved agent-assisted evaluation and…
v1.0.0SkillEvaluator v1.0.0 (superseded)
· 4d agoSuperseded by SkillEvaluator v1.0.1. Use v1.0.1 for the published Python package, CI bundle, and complete release assets. Original v1.0.0 release notes SkillEvaluator v1.0.0 🎉 SkillEvaluator v1.0.0 marks our first major release. Understand how your skills load, measure how…
v0.9.0SkillEvaluator v0.9.0
· 8d agoSkillEvaluator 0.9.0 SkillEvaluator 0.9.0 expands how you build evaluation datasets, compare skill versions, and understand why an agent passed or failed. It adds controls for evaluation budgets, reusable baselines, and clearer evidence across terminal, HTML, JSON, Markdown,…
v0.8.0SkillEvaluator v0.8.0
· 2w agoSkillEvaluator 0.8.0 Tier 3 now computes every score from judge verdicts, grades accuracy on the outcome alone, and explains failing scores in the HTML report. A new tier3 feedback chat answers questions about a completed run, and opt-in policies control which models a judge…
v0.7.2SkillEvaluator v0.7.2
· 2w agoSkillEvaluator 0.7.2 Add hosted reports to an existing GitHub skill-checks workflow while keeping its shared component, folders, thresholds, and triggers. A centrally maintained component such as @v3 can now update its pinned evaluator without requiring an edit in every…
Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.
Neighbours on the workbench
TypeScript · ≈395k stars · MIT
openclaw/openclaw
The viral open-source personal AI assistant that really does things.
Maintained by OpenClaw Foundation
v2026.11.6releasedShell · ≈329k stars · MIT
mattpocock/skills
Small, composable agent skills for real engineering work.
Maintained by Matt Pocock (AI Hero)
MDX · ≈323k stars · MIT
obra/superpowers
An agentic skills framework and software methodology that works.
Maintained by Jesse Vincent (obra)
Connections
Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.
Maintained by · 1
- NVIDIAOrganisation
Sources
DisclosureAdded by Harness Hub's automated review of public metadata; not independently tested.
Verified Nov 18, 2026
