Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →vibeeval/eval-harness
Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles
Passed 19 of 22 test cases with the skill, and 8 of 22 without it.
and 18 more in the full report
11 fixed8 passed either way3 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 11 test cases the skill fixed. Same model, same prompt, with and without the skill.
Which slash command executes active evals and reports current status while actively implementing code for 'user-auth'?
| Checked | Without skill | With skill |
|---|---|---|
| Specifies the command /eval check user-auth | Missed | Passed |
The instructions your model reads when the skill loads.
A formal evaluation framework for Claude Code sessions, implementing eval-driven development (EDD) principles.
Eval-Driven Development treats evals as the "unit tests of AI development":
Test if Claude can do something it couldn't before:
[CAPABILITY EVAL: feature-name]
Task: Description of what Claude should accomplish
Success Criteria:
- [ ] Criterion 1
- [ ] Criterion 2
- [ ] Criterion 3
Expected Output: Description of expected result
Ensure changes don't break existing functionality:
[REGRESSION EVAL: feature-name]
Baseline: SHA or checkpoint name
Tests:
- existing-test-1: PASS/FAIL
- existing-test-2: PASS/FAIL
- existing-test-3: PASS/FAIL
Result: X/Y passed (previously Y/Y)
test cases passed, vs 8 / 22 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.