Passed 10 of 20 test cases with the skill, and 10 of 20 without it.
Without skill50%
With skill50%
Checks it passed that the model alone missed
Uses the op account list command
Outlines verification using op account list command
Recommends turning on CLI Integration within 1Password desktop app settings
2 fixed16 passed either way3 still failing1 broke
Pass-rate lift
0 pp
Tokens
0%
Agent turns
0%
Response time
-21%
Model gemini-3.6-flashMeasured 8/20/2026v118 of 22 cases passed with skill · 20 comparable
Tokens, turns and time describe resource use, not a dollar price.
See it in action
A test case the skill fixed. Same model, same prompt, with and without the skill.
Prompt
I have multiple 1Password accounts signed in. Before executing an automated deployment script, I want to check which account is currently active in my CLI session.
What was checked, without and with the skill
Checked
Without skill
With skill
Uses the op account list command
Missed
Passed
case-19 · gemini-3.6-flash · 8/20/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md33 linessingle file
1password
Purpose
Set up and use 1Password CLI (op). Use when installing the CLI, enabling desktop app integration, signing in (single or multi-account), or reading/injecting/running secrets via op.
Routing
Use when: Use when the user asks to set up and use 1Password CLI op. Use when installing the CLI, enabling desktop app integration, signing in single or multi-account, or reading/injecting/running secrets via op.
Do not use when: Do not use when the request is asking for planning documents, high-level strategy, or non-executable discussion; use the relevant planning or design workflow instead.
Outputs: Outcome from 1password: task-specific result plus concrete action notes.
Success criteria: Returns concrete actions and decisions matching the requested task, with no fabricated tool-side behavior.
Trigger Examples
Positive
Use the 1password skill for this request.
Help me with 1password.
Use when the user asks to set up and use 1Password CLI op. Use when installing the CLI, enabling desktop app integration, signing in single or multi-account, or reading/injecting/running secrets via op.
1password: provide an actionable result.
Negative
Do not use when the request is asking for planning documents, high-level strategy, or non-executable discussion; use the relevant planning or design workflow instead.
Do not use 1password for unrelated requests.
This request is outside 1password scope.
This is conceptual discussion only; no tool workflow is needed.
Runtime Prompt
Current runtime prompt length: 1978 characters.
Runtime prompt is defined directly in ../1password.json.