Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →diegosouzapw/cli-eval
Create and run evaluation suites, watch live benchmark progress, view scorecards, compare model performance, and integrate eval runs with CI workflows from the CLI.
Passed 21 of 22 test cases with the skill, and 6 of 22 without it.
and 16 more in the full report
16 fixed5 passed either way0 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
A newer attempt on gemini-3.8-flash on 10/18/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.
One of 16 test cases the skill fixed. Same model, same prompt, with and without the skill.
When launching `omniroute eval suites run suite-100 --model claude-3-5-sonnet`, the CLI returns `model not found`. Which command verifies available model names?
| Checked | Without skill | With skill |
|---|---|---|
| Recommends using omniroute models with search flag | Missed | Passed |
The instructions your model reads when the skill loads.
Create and run evaluation suites, watch live benchmark progress, view scorecards, compare model performance, and integrate eval runs with CI workflows from the CLI.
npm install -g omniroute # or: npx omniroute
omniroute --version
evalExample:
omniroute eval
eval suitesExample:
omniroute eval suites
eval listExample:
omniroute eval list
eval get <suiteId>test cases passed, vs 6 / 22 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.