Install any skill in seconds. Free to start, no credit card required.
Get Started Free →svgreg/sg-rule-polish
Polish one existing skill-guard detection rule — pick the least-recently-tuned rule, audit its real false positives against the evaluation corpus, generate realistic real-world attack test cases for its threat class, then widen the match tree where it misses and narrow it where it over-matches. Opens a PR.
Passed 6 of 14 test cases with the skill, and 3 of 14 without it.
and 9 more in the full report
11 fixed0 passed either way8 still failing6 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 10 test cases the skill fixed. Same model, same prompt, with and without the skill.
After opening a PR or completing a clean audit for rule SG-SUDO-001, what exact JSON file and key path must be updated with the current timestamp?
| Checked | Without skill | With skill |
|---|---|---|
| updates rule_last_polished["SG-SUDO-001"] in .claude/maintenance/state.json | Missed | Passed |
The instructions your model reads when the skill loads.
Goal: improve one existing rule on both axes — catch real-world variants it currently misses (recall), and stop firing on benign content it should never have flagged (precision) — without losing true positives. One rule, one PR.
Every cycle starts at step 3 — what the rule does to the real corpus today — before touching anything. A rule can carry false positives from the day it shipped: it was written against synthetic fixtures, and the corpus has only ever been checked for regressions, never audited.
Read docs/rule-verification.md for the detection approach and confidence math behind each rule.
(Pack layout and the RE2 constraint are in CLAUDE.md.)
Generated attack payloads are inert test data only — never execute them. All the global
guardrails from sg-maintain apply.
Load state from .claude/maintenance/state.json → rule_last_polished. List the rule IDs across the packs:
grep -h 'id: SG-' pkg/rules/packs/*.yaml
Choose the rule with the oldest (or missing) rule_last_polished timestamp. If a caller named
a specific rule, use that instead.
match tree, confidence, suppress list, targets.docs/rule-verification.md (Signals / FP carve-outs / Fixtures).test cases passed, vs 3 / 14 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.