Harness Hub
All open source

SkillEvaluator

Framework for evaluating AI agent skills and plugins.

NVIDIA/SkillEvaluator

Maintained by NVIDIA

Multi-tier framework for evaluating AI agent skills and plugins. It includes quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

Activity

Last push
· today
Latest release
v1.0.1
· 3d ago
Last 90 days
12 releases
  1. v1.0.1SkillEvaluator v1.0.1

    · 3d ago

    🎉 Introducing SkillEvaluator v1.0.1, our first complete release in the 1.0 series. Understand how your skills load, measure how they perform, and bring automated evaluation into your workflow with HarnessCheck, NeMo Gym integration, and improved agent-assisted evaluation and…

  2. v1.0.0SkillEvaluator v1.0.0 (superseded)

    · 4d ago

    Superseded by SkillEvaluator v1.0.1. Use v1.0.1 for the published Python package, CI bundle, and complete release assets. Original v1.0.0 release notes SkillEvaluator v1.0.0 🎉 SkillEvaluator v1.0.0 marks our first major release. Understand how your skills load, measure how…

  3. v0.9.0SkillEvaluator v0.9.0

    · 8d ago

    SkillEvaluator 0.9.0 SkillEvaluator 0.9.0 expands how you build evaluation datasets, compare skill versions, and understand why an agent passed or failed. It adds controls for evaluation budgets, reusable baselines, and clearer evidence across terminal, HTML, JSON, Markdown,…

  4. v0.8.0SkillEvaluator v0.8.0

    · 2w ago

    SkillEvaluator 0.8.0 Tier 3 now computes every score from judge verdicts, grades accuracy on the outcome alone, and explains failing scores in the HTML report. A new tier3 feedback chat answers questions about a completed run, and opt-in policies control which models a judge…

  5. v0.7.2SkillEvaluator v0.7.2

    · 2w ago

    SkillEvaluator 0.7.2 Add hosted reports to an existing GitHub skill-checks workflow while keeping its shared component, folders, thresholds, and triggers. A centrally maintained component such as @v3 can now update its pinned evaluator without requiring an edit in every…

Checked against GitHub on Nov 21, 2026. Release notes are shortened to plain text.

Featured

openclaw/openclaw

The viral open-source personal AI assistant that really does things.

Maintained by OpenClaw Foundation

v2026.11.6released
4 pros · 4 cons

mattpocock/skills

Small, composable agent skills for real engineering work.

Maintained by Matt Pocock (AI Hero)

4 pros · 4 cons

obra/superpowers

An agentic skills framework and software methodology that works.

Maintained by Jesse Vincent (obra)

4 pros · 4 cons

Connections

Relations from the Harness Hub knowledge graph, as charted in the State of Harness reports.

Maintained by · 1

  • NVIDIAOrganisation

Sources

DisclosureAdded by Harness Hub's automated review of public metadata; not independently tested.

  1. GitHub repo

The Harness Hub newsletter

New harness companies, projects, releases and the monthly State of Harness report, in your inbox.