Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Iteratively fix all failing tests until the test suite is green
| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-06 | ✗→✓ | ▲ Improved | 40% | 0% |
| case-04 | ✗→✓ | ▲ Improved | -40% | 0% |
| case-08 | ✗→✓ | ▲ Improved | -30% | 0% |
| case-12 | ✗→✓ | ▲ Improved | -17% | 0% |
| case-13 | ✗→✓ | ▲ Improved | -18% | 0% |
Before starting execution, initialize task_context.json:
json{ "task_id": "<task_id from input>", "current_step": 0, "current_step_id": null, "status": "running", "steps": { "fix_loop": "pending", "present": "pending" }, "updated_at": "<ISO timestamp>" }
Update this file after each step completes. On error, set step status to "failed" and overall status to "failed".
Type: loop Description: Run tests, analyze failures, fix source code, repeat until green
Goal: pytest exits with 0 failures (all tests pass) Max Iterations: 10
> This step executes as a loop. The body steps repeat until the goal is met or max iterations reached.
Type: script
Execution: Execute the following command:
bashcd examples/fix-loop && python3 -m pytest tests/ --tb=short 2>&1 | tail -60
Type: agent
Execution: Launch an independent agent with the following prompt file:
Look at the pytest failures from run_tests. Pick ONE source file that has failing tests and fix the bugs in that file.
Rules:
After all body steps complete, evaluate:
Goal: pytest exits with 0 failures (all tests pass)
Append a summary to iteration_history after each iteration.
After completing this step, update task_context.json:
current_step_id to "fix_loop"steps.fix_loop to "completed"Type: inline
Follow these instructions:
Generate a markdown report summarizing the fix loop results. Include:
Write the report to fix_report.md
After completing this step, update task_context.json:
current_step_id to "present"steps.present to "completed"Other measured skills in the registry, with their headline benchmark lift.