Install any skill in seconds. Free to start, no credit card required.
Get Started Free →loulanyue/eval-harness
Claude Codeセッションの正式な評価フレームワークで、評価駆動開発(EDD)の原則を実装します
Passed 21 of 22 test cases with the skill, and 12 of 22 without it.
and 11 more in the full report
9 fixed12 passed either way1 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 9 test cases the skill fixed. Same model, same prompt, with and without the skill.
I am starting work on a new feature called search-indexing. What single slash command creates the initial evaluation definition scaffold file in the project workspace?
| Checked | Without skill | With skill |
|---|---|---|
| Specifies the command `/eval define search-indexing`. | Missed | Passed |
The instructions your model reads when the skill loads.
Claude Code 工作階段的正式評估框架,實作 eval 驅動開發(EDD)原則。
Eval 驅動開發將 evals 視為「AI 開發的單元測試」:
測試 Claude 是否能做到以前做不到的事:
[CAPABILITY EVAL: feature-name]
任務:Claude 應完成什麼的描述
成功標準:
- [ ] 標準 1
- [ ] 標準 2
- [ ] 標準 3
預期輸出:預期結果描述
確保變更不會破壞現有功能:
[REGRESSION EVAL: feature-name]
基準:SHA 或檢查點名稱
測試:
- existing-test-1: PASS/FAIL
- existing-test-2: PASS/FAIL
- existing-test-3: PASS/FAIL
結果:X/Y 通過(先前為 Y/Y)
test cases passed, vs 12 / 22 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.