Manage provider connections from the CLI: list available/configured providers, add, test, test-all, validate, rotate API keys, and view per-provider metrics.
SkillScore86Maintained
Automatic
◆AI Engineer pack
Last verified 8/9/2026
What it changes
Passed 19 of 22 test cases with the skill, and 5 of 22 without it.
Without skill23%
With skill86%
Checks it passed that the model alone missed
omniroute cost
omniroute health
omniroute oauth login
and 17 more in the full report
14 fixed5 passed either way3 still failing0 broke
Pass-rate lift
+64 pp
Tokens
+99%
Agent turns
0%
Response time
-74%
Measured 8/9/2026v1 · latest is v219 of 22 cases passed with skill
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
A newer attempt on gemini-3.8-flash on 10/18/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.
See it in action
One of 14 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 14
Prompt
I need to apply rate limiting and permission constraints to an OmniRoute API key with ID key_8821. I want to limit it to 100 requests per minute and restrict permissions strictly to chat and models. What CLI subcommand updates key policies?
sets the key policy window duration parameter to minute
Missed
Passed
case-07 · gemini-3.6-flash · 8/9/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md328 linessingle file
Overview
Manage provider connections from the CLI: list available/configured providers, add, test, test-all, validate, rotate API keys, and view per-provider metrics.
Start and stop tunnel connections (ngrok, Cloudflare, custom) from the CLI. Inspect active tunnel URLs, configure authentication, and test external reachability.