Challenge mode reviews - rigorous questioning before approving changes.
SkillScore83Maintained
Automatic
◆Coding pack
Last verified 8/19/2026
What it changes
Passed 18 of 22 test cases with the skill, and 15 of 22 without it.
Without skill70%
With skill83%
Checks it passed that the model alone missed
Demands evidence for failure recovery
Requires supervised tasks or GenServers with timeouts
Requires verifying backward compatibility for active application code
3 fixed16 passed either way4 still failing0 broke
Pass-rate lift
+13 pp
Tokens
+48%
Agent turns
0%
Response time
-9%
Model gemini-3.6-flashMeasured 8/19/2026v119 of 23 cases passed with skill · 22 comparable
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 3 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 3
Prompt
We are removing the legacy_code column from the users table in our Phoenix application schema and migration. The team plans to deploy the database migration right before rolling out the app updates. Review this deployment order. Output contract: review findings.
What was checked, without and with the skill
Checked
Without skill
With skill
Highlights breaking changes during rolling deployments when old code runs against new schema
Passed
Passed
Requires verifying backward compatibility for active application code
Missed
Passed
case-06 · gemini-3.6-flash · 8/19/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md142 linessingle file
Challenge Mode Reviews
Rigorous, critical review patterns inspired by Boris Cherny's "Grill me" approach. Push beyond first solutions to ensure quality.
Iron Laws - Never Violate These
No approval without verification - Don't approve until all concerns addressed
Elixir/Phoenix deployment patterns — Dockerfile, fly.toml, runtime.exs, mix release, rel/ overlays. Use when configuring Fly.io, Docker, CI/CD, health checks, or production migrations.