Decision protocol for wiring a verify-then-fix loop around a code-editing LLM
agent. The agent edits → runs lint/test → reads the output → fixes → re-runs,
bounded by an iteration cap and an escalation rule. Activates whenever a coder
agent has a verifiable success criterion (exit code, type-checker output,
failing assertion) and the user wants the agent to converge to "green" on its
own. Framework-agnostic — wraps Aider's `--auto-lint`/`--auto-test`, an
OpenHands SWE-Bench loop, a manual LangGr
SkillScore9595 — bench 95 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+36 ptsBenchmark lift
Agent ToolingGitHub21/22 cases—0 users · lifetime · 0 times used · lifetime
Run tests and systematically fix all failing tests using smart error grouping. Use when user asks to fix failing tests, mentions test failures, runs test suite and failures occur, or requests to make tests pass.
SkillScore7878 — bench 78 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+13 ptsBenchmark lift
TestingGitHub18/23 cases—0 users · lifetime · 0 times used · lifetime
Systematically fix all failing E2E tests using a phased diagnostic approach. Classifies tests as passing, flaky, or permanently failing, then fixes them one by one with progressive scope expansion.
SkillScore7474 — bench 74 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+30 ptsBenchmark lift
TestingGitHub17/23 cases—0 users · lifetime · 0 times used · lifetime
Run tests and systematically fix all failing tests using smart error grouping. Use when user asks to fix failing tests, mentions test failures, runs test suite and failures occur, or requests to make tests pass.
SkillScore7373 — bench 73 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+18 ptsBenchmark lift
TestingGitHub16/22 cases—0 users · lifetime · 0 times used · lifetime
Run tests and systematically fix all failing tests using smart error grouping. Use when user asks to fix failing tests, mentions test failures, runs test suite and failures occur, or requests to make tests pass.
SkillScore6464 — bench 64 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+5 ptsBenchmark lift
TestingGitHub14/22 cases—0 users · lifetime · 0 times used · lifetime
Systematically identify and fix all failing tests using smart grouping strategies. Use when explicitly asks to fix tests ("fix these tests", "make tests pass"), reports test failures ("tests are failing", "test suite is broken"), or completes implementation and wants tests passing.
SkillScore7777 — bench 77 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+9 ptsBenchmark lift
TestingGitHub17/22 cases—0 users · lifetime · 0 times used · lifetime
Analyze failing tests to detect functional bugs in code. Takes repository and failing test output as input, analyzes execution behavior, assertions, and stack traces to identify suspicious code regions and root causes. Use when debugging test failures, investigating regression bugs, or understanding why tests fail. Explains the bug mechanism, identifies affected code, and suggests fixes based on test expectations vs actual behavior.
SkillScore100100 — bench — (needs a verified run with lift) · live 100 · AI — (needs ≥10 rated traces)—TestingGitHub20/22 cases100% pass Live pass · lifetime1 user · lifetime · 40 times used · lifetime
GUI desktop app only. Writes, runs, and debugs Warp integration tests using the custom Builder/TestStep framework in `crates/integration`. Use when adding a new integration test, fixing a failing integration test, wiring a test into the manual runner or nextest suite, or verifying end-to-end UI and terminal behavior in Warp.
SkillScore8282 — bench 82 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+55 ptsBenchmark lift
TestingGitHub18/22 cases—0 users · lifetime · 0 times used · lifetime
Investigate a failing integration test from a GitHub issue. Downloads logs/artifacts, analyzes the failure, examines relevant skills, and suggests fixes. TRIGGERS: investigate integration test, debug integration test, failing integration test, test failure investigation, diagnose test failure, analyze test issue
SkillScore7777 — bench 77 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+27 ptsBenchmark lift
TestingGitHub17/22 cases—0 users · lifetime · 0 times used · lifetime
Use when the user reports a bug, broken behavior, regression, failing test, or asks to investigate/root-cause/debug. Trigger on: 修个 bug, 这个 bug, 排查一下, 复现, 这个错怎么回事, 为什么 X 不工作, debug, RCA, fix this bug, investigate, reproduce. Guides root-cause debugging: reproduce with a failing test, list hypotheses, trace backward, fix only the confirmed cause, verify red-green-red, and leave a regression test. Does not symptom-patch or write commit messages.
SkillScore7777 — bench 77 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+64 ptsBenchmark lift
CodingGitHub17/22 cases—0 users · lifetime · 0 times used · lifetime
This skill should be used when the user reports a bug, describes unexpected behavior, says something is "broken", "not working", "failing", mentions an "error", "issue", or "problem" in code, or asks to "fix" something. Enforces test-driven bug fixing workflow.
SkillScore7373 — bench 73 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+14 ptsBenchmark lift
TestingGitHub16/22 cases—0 users · lifetime · 0 times used · lifetime
Orchestrate fixing a bug — reproduce it as a failing regression test, fix to green, review, and gated commit — by delegating each phase to the matching ECC agent. Use when existing behavior is broken or wrong.
SkillScore6464 — bench 64 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+59 ptsBenchmark lift
Agent ToolingGitHub22 cases—0 users · lifetime · 0 times used · lifetime
Fix failing ToolUniverse tools by diagnosing test failures, identifying root causes, implementing fixes, and validating solutions. Use when ToolUniverse tools fail tests, return errors, have schema validation issues, or when asked to debug or fix tools in the ToolUniverse framework.
SkillScore3333 — bench 33 · live — (needs ≥10 evaluated traces) · AI — (needs ≥10 rated traces)
+33 ptsBenchmark lift
CodingGitHub24 cases—0 users · lifetime · 0 times used · lifetime
Diagnose the root cause of a bug before applying the smallest correct fix. Use this skill whenever something is broken, erroring, behaving unexpectedly, or a test/build/lint is failing. Always read the actual error message and trace the relevant code before changing anything — do not apply speculative fixes. Can be invoked at any stage of development, not just during a dedicated testing phase.
NewSkillScoreNo evidence yet — run a verified benchmark or accrue evaluated production traces to earn a SkillScore.
0 ptsBenchmark lift
CodingGitHub16/22 cases—0 users · lifetime · 0 times used · lifetime
Use a failing behavioral test to guide a feature or bug fix, then implement and refactor with relevant regression checks.
NewSkillScoreNo evidence yet — run a verified benchmark or accrue evaluated production traces to earn a SkillScore.—TestingGitHub——0 users · lifetime · 0 times used · lifetime