Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Fan out /qa-triage across a queue of qa-labeled reports in parallel, reconcile them across reports to cluster shared root causes, present one consolidated decision gate, and — on approval — create the resulting tech issues.
.claude/skills/joshukraine-qa-triage-batch/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-05 | ✗→✓ | ▲ Improved | 203% | 0% |
| case-07 | ✗→✓ | ▲ Improved | 1068% | 0% |
| case-12 | ✗→✓ | ▲ Improved | 117% | 0% |
| case-13 | ✗→✓ | ▲ Improved | 223% | 0% |
| case-14 | ✗→✓ | ▲ Improved | 196% | 0% |
Run the open qa-labeled reports as a parallel batch: one background subagent per report runs /qa-triage's analysis to its draft, a cross-report pass reconciles all the drafts at once, and a single consolidated gate replaces the N separate per-report STOPs. On approval, the orchestrator creates the tech issues, closes the not-a-bugs, and recommends /resolve-issue for trivial-cosmetics.
Use this when a backlog of QA reports has accumulated. For a single report, use /qa-triage directly — the batch only earns its keep when there are several, because its real value is cross-report reconciliation: a single run is blind to the others, so it can't see that several reports share one root cause. A batch is the only vantage that sees all N at once.
Sibling to /autopilot-batch in the autopilot family (Phase 3). It mirrors that skill's _shape_ — announce → fan out → gate → act → report, plus the escape hatch — but its back half differs on purpose (it creates issues rather than merging PRs, gates _before_ creation rather than after, and reconciles across items). The two share conventions, not code.
Run this from the target application repository — the repo whose qa reports and app code these are (e.g. the Rails app). Not from dotfiles. You need the reports _and_ the code, because /qa-triage confirms every symptom against the source. Unlike /autopilot-batch, there is no worktree dependency — the fan-out is read-only code investigation (no server, no port 3000, no shared DB, no file writes), so all subagents share the one working tree safely. If the cwd is dotfiles (or any repo that doesn't own these reports), stop and say so.
qa-labeled report (minus any already in-flight; see Step 1).[report# …] — scope to the listed reports only (e.g. 503 511 488). Everything else is untouched. Use this to re-run a subset without re-triaging the whole backlog.Analysis runs at Opus 5; the reconcile runs at Fable. Unlike /autopilot-batch's fan-out scale — where cheaper builds under a gating review floor save real latency and limit headroom — a QA batch is low-volume (a handful of reports), so there is no cost case for going below Opus on analysis, and classification ("is this a bug or intended behavior?") is judgment work. There is no review floor behind the analysis the way /autopilot-batch has one; the human gate is the only safety net, so favor quality. The reconcile is the genuinely hard cross-report judgment — the _whole_ reason to batch — and it is a single subagent, so running it at Fable buys the best judgment exactly where it matters most, for a negligible cost delta. Earn a Sonnet-analyze split later (rule of three) only if the volume grows or an obviously-bounded report pattern emerges.
A single report that can't be confidently triaged must not halt the batch. If an analysis subagent can't reproduce the symptom in the code, or the report is genuinely ambiguous, it stops and reports — that report is surfaced at the consolidated gate as "needs your eyes," never silently dropped, and nothing is drafted for it. One uncertain report never stops the rest. Halt the _whole_ batch only for a systemic problem: the cwd is the wrong repo, or there are no open qa reports to triage.
Announce the run first: how many qa reports are open, how many are being triaged vs. skipped as already in-flight (Step 1), and that you will fan out one background subagent per report.
git pull.gh api user --jq .login. Each report's analysis needs it to decide the verification @-mention (skip the mention when author == invoker), and the orchestrator needs it again when acting.gh issue list --label qa --state open --json number,title,author,body. If scoped by arg, restrict to those numbers.Triggered by QA report #<n>). Drop those — they are being handled, not pending. Use search only to _narrow_, then confirm the exact back-reference client-side — GitHub full-text search tokenizes #<n> loosely, so it neither guarantees the exact number nor an exact phrase, and matching on it alone would both miss links and skip the wrong reports:bash # Fetch every issue carrying the back-reference phrase, then filter by exact substring. gh issue list --state all --search 'Triggered by QA report in:body' \ --json number,body \ --jq '[.[] | select(.body | contains("Triggered by QA report #<n>")) | .number]'
A non-empty result means report <n> is already linked — skip it. This mirrors /autopilot-triage's self-heal (which keys on a structured headRefName match for existing PRs), keyed here on an exact body substring instead. Report what was skipped and why.
For each report, spawn a background subagent:
model: opus, run_in_background: true. No isolation: worktree — read-only investigation, shared tree is safe./qa-triage <n> through its analysis and draft (steps 1–5) and STOP at its decision gate (step 6). Create, comment on, close, and edit nothing — you have no human to approve, and the skill's gate is exactly where you halt. Then return, as the final message, a structured triage record (not prose):text report: #<n> — <title> author: <login> (mention: <@author | skip: == invoker | skip: bot>) bucket: not-a-bug | trivial-cosmetic | one-issue | multiple root_cause: <one-line root cause grounded in the code> files: <the file(s)/surface the fix touches> ← the clustering key drafts: <for each proposed tech issue: title, full body, labels, closing plan> ambiguities: <anything to raise at the gate — or "none"> escape_hatch: <"" | "STOPPED — <why>: couldn't confirm / genuinely ambiguous">
Spawn them together so they run in parallel. Since they create nothing, there is no per-report label lifecycle to manage and no worktree to reclaim.
Wait for all analysis subagents (this is a genuine barrier — cross-report clustering needs every record). Then spawn one model: fable reconcile subagent, passing it all N structured records:
root_cause / files → one tech issue that closes _all_ of them — see the cluster closing plan in Step 5), flag duplicate drafts to collapse, and flag conflicts (two reports asking for opposite behavior). Return the clusters as suggestions with a one-line rationale each — never auto-merge. A report that doesn't cluster stays standalone.The reconcile _proposes_; the human disposes. Do not collapse drafts on the reconcile's say-so alone.
Present one board-level view — every report's classification, its drafted issue(s), and the reconcile's proposed clusters — grouped so the shared-root-cause suggestions are visible:
textCluster A — order.rb weight rounding (reconcile: high confidence) #503 one-issue fix: round shipment weight up @tester1 #511 one-issue [dup of #503 draft — collapse?] @tester2 Ungrouped #488 not-a-bug event_type unvalidated by design @tester3 #492 trivial typo in uk.yml checkout label → /resolve-issue #495 STOPPED can't reproduce in code — needs your eyes Approve / edit / decline / reclassify across the batch?
Show the full drafted body for each proposed issue (or write drafts to temp files and reference them — you need those files anyway for --body-file in Step 5). Then STOP and wait. The human may approve as-is, accept or split a cluster, edit a draft, reclassify a report, decline one (e.g. close as working-as-intended), or defer. Create, close, comment on, and edit nothing before a clear yes.
The orchestrator acts centrally (not the subagents), applying /qa-triage's closing-keyword hazard and each issue's closing plan in one place:
gh issue create --title … --body-file <tmp> --label <type>; remove the temp file after. The /qa-triage draft already carries its closing plan — a standalone Closes #<tech>, Closes #<qa> — please verify after deploy, @<author>, or, when /qa-triage split one report into several issues (the "multiple" bucket), that report's multi-PR plan where only the final issue's PR closes the report. Create those as drafted; don't rewrite them./qa-triage never sees a cluster, so the closing plan is the orchestrator's to write. Create one merged tech issue whose single PR closes the tech issue and every clustered report at once: Closes #<tech>, Closes #<qa1>, Closes #<qa2>, … — please verify after deploy, @<author1> @<author2> (each Closes keyword sits directly before its own #N; @-mention each report's author, skipping any that == invoker). This is the opposite mapping from /qa-triage's multi-PR rule (1 report → N issues) — do not conflate them./resolve-issue <qa-N> command in the report; its closing PR must still carry the report's Closes #<qa> — please verify after deploy, @<author> line.Post a batch summary:
text## QA triage batch — N reports | Report | Bucket | Action | Result | | ------ | ------ | ------ | ------ | | #503 | one-issue (cluster A) | created #560 | open — awaiting fix | | #511 | one-issue (cluster A) | folded into #560 | open — awaiting fix | | #488 | not-a-bug | closed w/ comment @tester3 | done | | #492 | trivial | → /resolve-issue 492 | recommended | | #495 | — | STOPPED — needs you | pending | - Created: <list of tech issues>. Closed: <not-a-bug reports>. Stopped: <reports needing you>. - Next: the created tech issues are ready for /autopilot-triage to vet into the autopilot queue, then /autopilot-batch to fan them out to PRs.
/qa-triage's own gate and returns a draft; all creation/closing happens once, centrally, only after the consolidated human gate. This is the load-bearing guardrail./qa-triage; this skill only orchestrates the fan-out, the reconcile, the gate, and the central act-on-approval — so improvements to /qa-triage flow through untouched. It does not implement fixes (that stays /resolve-issue → PR, optionally via /autopilot-batch), and it is a sibling skill, not a flag on /autopilot-batch — do not extract a shared batch engine (still under rule-of-three).| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-01 | fail→fail | 13,511 | 7,349 | -46% | 1 | 1 | 0% | 2,232 | 3,674 | +65% | 0 | 0 | — |
case-02 | fail→fail | 19,758 | 6,948 | -65% | 1 | 1 | 0% | 3,263 | 3,745 | +15% | 0 | 0 | — |
case-03 | fail→fail | 8,492 | 5,717 | -33% | 1 | 1 | 0% | 1,341 | 3,535 | +164% | 0 | 0 | — |
case-04 | pass→fail | 5,624 | 8,040 | +43% | 1 | 1 | 0% | 308 | 3,678 | +1094% | 0 | 0 | — |
case-05 | fail→pass | 9,166 | 10,463 | +14% | 1 | 1 | 0% | 1,594 | 4,822 | +203% | 0 | 0 | — |
case-06 | fail→fail | 18,111 | 7,854 | -57% | 1 | 1 | 0% | 3,040 | 3,618 | +19% | 0 | 0 | — |
case-07 | fail→pass | 6,509 | 2,780 | -57% | 1 | 1 | 0% | 307 | 3,586 | +1068% | 0 | 0 | — |
case-08 | fail→fail | 12,588 | 9,089 | -28% | 1 | 1 | 0% | 2,295 | 3,621 | +58% | 0 | 0 | — |
case-09 | pass→fail | 10,622 | 9,234 | -13% | 1 | 1 | 0% | 768 | 3,605 | +369% | 0 | 0 | — |
case-10 | pass→pass | 8,438 | 5,042 | -40% | 1 | 1 | 0% | 1,278 | 4,053 | +217% | 0 | 0 | — |
case-11 | pass→pass | 9,979 | 6,135 | -39% | 1 | 1 | 0% | 1,635 | 4,164 | +155% | 0 | 0 | — |
case-12 | fail→pass | 25,582 | 7,007 | -73% | 1 | 1 | 0% | 2,077 | 4,508 | +117% | 0 | 0 | — |
case-13 | fail→pass | 8,304 | 3,825 | -54% | 1 | 1 | 0% | 1,189 | 3,837 | +223% | 0 | 0 | — |
case-14 | fail→pass | 8,226 | 3,175 | -61% | 1 | 1 | 0% | 1,265 | 3,743 | +196% | 0 | 0 | — |
case-15 | pass→pass | 7,094 | 3,561 | -50% | 1 | 1 | 0% | 1,077 | 3,725 | +246% | 0 | 0 | — |
case-16 | pass→pass | 9,748 | 3,541 | -64% | 1 | 1 | 0% | 1,510 | 3,775 | +150% | 0 | 0 | — |
case-17 | pass→pass | 11,027 | 4,394 | -60% | 1 | 1 | 0% | 1,751 | 3,882 | +122% | 0 | 0 | — |
case-18 | fail→pass | 7,550 | 2,958 | -61% | 1 | 1 | 0% | 1,308 | 3,572 | +173% | 0 | 0 | — |
case-19 | pass→pass | 6,123 | 2,189 | -64% | 1 | 1 | 0% | 937 | 3,476 | +271% | 0 | 0 | — |
case-20 | fail→pass | 9,467 | 3,085 | -67% | 1 | 1 | 0% | 1,546 | 3,786 | +145% | 0 | 0 | — |
case-21 | pass→pass | 6,846 | 3,486 | -49% | 1 | 1 | 0% | 963 | 3,682 | +282% | 0 | 0 | — |
case-22 | fail→pass | 9,186 | 3,275 | -64% | 1 | 1 | 0% | 1,387 | 3,630 | +162% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 22 cases were attempted, and 15 counted toward the lift figure. The other 7 produced results that are not comparable between the two arms, so they are excluded from the headline rather than averaged into it. The headline lift of +27 percentage points is the difference between those two pass rates over the 15 comparable cases. 4 cases got worse with the skill loaded, and they are included in that figure.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
Other measured skills in the registry, with their headline benchmark lift.