Passed 14 of 20 test cases with the skill, and 7 of 20 without it.
Without skill36%
With skill68%
Checks it passed that the model alone missed
Runs triage with --severity HIGH
Prefixes commands with deepsec sandbox
Runs vercel env pull to refresh credentials
and 5 more in the full report
8 fixed7 passed either way6 still failing1 broke
Pass-rate lift
+32 pp
Tokens
+302%
Agent turns
0%
Response time
-35%
Model gemini-3.6-flashMeasured 8/14/2026v115 of 22 cases passed with skill · 20 comparable
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 8 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 8
Prompt
Our deepsec run failed with '401 Unauthorized' when calling the Vercel AI Gateway using OIDC authentication. What command refreshes the local OIDC credentials?
What was checked, without and with the skill
Checked
Without skill
With skill
Runs vercel env pull to refresh credentials
Missed
Passed
case-18 · gemini-3.6-flash · 8/14/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
Operate Vercel's deepsec security scanner inside a target repository safely and cost-consciously: bootstrap the .deepsec/ workspace, write a tight INFO.md, run the right scan/process/triage/revalidate/export sequence, gate PRs in CI via process --diff, and grow project-specific matchers, surfacing real, revalidated findings without runaway spend.
agent_choice: codex (upstream default; model gpt-5.5) or claude (model claude-opus-4-8). Asked once before the first paid call if not already provided.