Redteam

Redteam

Test your application's safety boundaries systematically. This skill generates attack prompts from a policy document, measures what gets through, and pairs the Attack Success Rate (ASR) with the Over-Refusal Rate so you don't reward models that simply refuse everything.

When to Activate

• Pre-deployment safety audit
• Regulatory compliance check
• After major model or prompt changes that could affect safety
• User reports a jailbreak or injection vulnerability
• Periodic (quarterly) safety re-evaluation

Checklist

You MUST create a task for each item and complete them in order:

1. Establish policy — what's prohibited, what's allowed, what's gray
2. Derive attack vectors from policy — not a fixed template
3. Generate attack set + over-refusal set — paired measurement
4. Run attacks and evaluate — ASR per policy category
5. Compute over-refusal rate — paired with ASR
6. Output safety scorecard + audit document

Fast path: run the bundled script

Once attacks and benign prompts have been run against the system and judged, compute the scorecard with the bundled, tested script (scripts/asr_report.py, standard library only, no OpenJudge dependency) — it always pairs ASR with over-refusal so you can't reward a system that just refuses everything: