Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →gulmezeren2-byte/agent-evals
Measure an agent instead of vibing it: fixed task sets, seeded runs, and a rubric written before the results are seen.
Passed 22 of 22 test cases with the skill, and 17 of 22 without it.
and 4 more in the full report
5 fixed17 passed either way0 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 5 test cases the skill fixed. Same model, same prompt, with and without the skill.
I need a comprehensive plan to rigorously measure the performance of my customer service agent rather than relying on informal spot-checks. Please provide a structured evaluation document outlining the testing strategy, execution setup, and scoring methodology.
| Checked | Without skill | With skill |
|---|---|---|
| The plan specifies using a fixed set of evaluation tasks. | Passed | Passed |
| The execution setup requires setting random seeds for reproducible runs. | Missed | Passed |
| The scoring methodology requires defining the rubric prior to inspecting agent outputs. | Missed | Passed |
The instructions your model reads when the skill loads.
Measure an agent instead of vibing it: fixed task sets, seeded runs, and a rubric written before the results are seen.
test cases passed, vs 17 / 22 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.