Install any skill in seconds. Free to start, no credit card required.
Get Started Free →Universal skill diagnosis and optimization tool. Detect and fix skill execution issues including context explosion, long-tail forgetting, data flow disruption, and agent coordination failures. Supports Agy CLI for deep analysis. Triggers on "skill tuning", "tune skill", "skill diagnosis", "optimize skill", "skill debug".
.claude/skills/catlog22-skill-tuning/SKILL.md| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-06 | ✗→✓ | ▲ Improved | 252% | 0% |
| case-07 | ✗→✓ | ▲ Improved | 127% | 0% |
| case-10 | ✗→✓ | ▲ Improved | 33% | 0% |
| case-11 | ✗→✓ | ▲ Improved | 20% | 0% |
| case-13 | ✗→✓ | ▲ Improved | 123% | 0% |
<required_reading> @~/.maestro/workflows/run-mode.md @~/.maestro/workflows/codex-run-mode.md </required_reading>
Autonomous diagnosis and optimization for skill execution issues.
.workflow/codebase/ARCHITECTURE.md exists, read for project contextmaestro load --type spec --category coding — load coding conventionsmaestro search "skill design optimization" --json — top 5 entries as prior context┌─────────────────────────────────────────────────────┐
│ Phase 0: Read Specs (mandatory) │
│ → problem-taxonomy.md, tuning-strategies.md │
└─────────────────────────────────────────────────────┘
↓
┌─────────────────────────────────────────────────────┐
│ Orchestrator (state-driven) │
│ Read state → Select action → Execute → Update → ✓ │
└─────────────────────────────────────────────────────┘
↓ ↓
┌──────────────────────┐ ┌──────────────────┐
│ Diagnosis Phase │ │ Agy CLI │
│ • Context │ │ Deep analysis │
│ • Memory │ │ (on-demand) │
│ • DataFlow │ │ │
│ • Agent │ │ Complex issues │
│ • Docs │ │ Architecture │
│ • Token Usage │ │ Performance │
└──────────────────────┘ └──────────────────┘
↓
┌───────────────────┐
│ Fix & Verify │
│ Apply → Re-test │
└───────────────────┘| Priority | Problem | Root Cause | Fix Strategy | |----------|---------|-----------|--------------| | P0 | Authoring Violation | Intermediate files, state bloat, file relay | eliminate_intermediate, minimize_state | | P1 | Data Flow Disruption | Scattered state, inconsistent formats | state_centralization, schema_enforcement | | P2 | Agent Coordination | Fragile chains, no error handling | error_wrapping, result_validation | | P3 | Context Explosion | Unbounded history, full content passing | sliding_window, path_reference | | P4 | Long-tail Forgetting | Early constraint loss | constraint_injection, checkpoint_restore | | P5 | Token Consumption | Verbose prompts, state bloat | prompt_compression, lazy_loading |
See specs/problem-taxonomy.md for:
See specs/tuning-strategies.md for:
| Step | Action | Orchestrator Decision | Output | |------|--------|----------------------|--------| | 1 | action-init | status='pending' | Backup, session created | | 2 | action-analyze-requirements | After init | Required dimensions + coverage | | 3 | Diagnosis (6 types) | Focus areas | state.diagnosis.{type} | | 4 | action-agy-analysis | Critical issues OR user request | Deep findings | | 5 | action-generate-report | All diagnosis complete | state.final_report | | 6 | action-propose-fixes | Issues found | state.proposed_fixes] | | 7 | action-apply-fix | Pending fixes | Applied + verified | | 8 | action-complete | Quality gates pass | session.status='completed' |
| Category | Actions | Purpose | |----------|---------|---------| | Setup | action-init | Initialize backup, session state | | Analysis | action-analyze-requirements | Decompose user request via Agy CLI | | Diagnosis | action-diagnose-{context,memory,dataflow,agent,docs,token_consumption} | Detect category-specific issues | | Deep Analysis | action-agy-analysis | Agy CLI: complex/critical issues | | Reporting | action-generate-report | Consolidate findings → final_report | | Fixing | action-propose-fixes, action-apply-fix | Generate + apply fixes | | Verify | action-verify | Re-run diagnosis, check gates | | Exit | action-complete, action-abort | Finalize or rollback |
Full action details: phases/actions/
Single source of truth: {run_dir}/outputs/skill-tuning-{ts}/state.json
json{ "status": "pending|running|completed|failed", "target_skill": { "name": "...", "path": "..." }, "diagnosis": { "context": {...}, "memory": {...}, "dataflow": {...}, "agent": {...}, "docs": {...}, "token_consumption": {...} }, "issues": [{"id":"...", "severity":"...", "category":"...", "strategy":"..."}], "proposed_fixes": [...], "applied_fixes": [...], "quality_gate": "pass|fail", "final_report": "..." }
See phases/state-schema.md for complete schema.
See phases/orchestrator.md for:
bash# Basic skill diagnosis /skill-tuning "Fix memory leaks in my skill" # Deep analysis with Agy /skill-tuning "Architecture issues in async workflow" # Focus on specific areas /skill-tuning "Optimize token consumption and fix agent coordination" # Custom issue /skill-tuning "My skill produces inconsistent outputs"
After completion, review:
{run_dir}/outputs/skill-tuning-{ts}/state.json - Full state with final_reportstate.final_report - Markdown summary (in state.json)state.applied_fixes - List of applied fixes with verification results| Document | Purpose | |----------|---------| | specs/problem-taxonomy.md | Classification + detection patterns | | specs/tuning-strategies.md | Fix implementation guide | | specs/dimension-mapping.md | Dimension ↔ Spec mapping | | specs/quality-gates.md | Quality verification criteria | | phases/orchestrator.md | Workflow orchestration | | phases/state-schema.md | State structure definition | | phases/actions/ | Individual action implementations |
| Case | Status | Duration (ms) | Turns | Tokens | Tool calls | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Without | With | Δ | Without | With | Δ | Without | With | Δ | Without | With | Δ | ||
case-20 | fail→fail | 12,893 | 2,551 | -80% | 1 | 1 | 0% | 1,256 | 2,134 | +70% | 0 | 0 | — |
case-01 | fail→fail | 20,488 | 6,374 | -69% | 1 | 1 | 0% | 2,975 | 2,020 | -32% | 0 | 0 | — |
case-02 | fail→fail | 18,048 | 5,308 | -71% | 1 | 1 | 0% | 3,302 | 2,024 | -39% | 0 | 0 | — |
case-03 | fail→fail | 22,647 | 6,362 | -72% | 1 | 1 | 0% | 3,833 | 1,967 | -49% | 0 | 0 | — |
case-04 | pass→pass | 13,479 | 17,282 | +28% | 1 | 1 | 0% | 2,583 | 4,951 | +92% | 0 | 0 | — |
case-05 | pass→pass | 13,246 | 7,370 | -44% | 1 | 1 | 0% | 2,208 | 3,274 | +48% | 0 | 0 | — |
case-06 | fail→pass | 16,387 | 9,941 | -39% | 1 | 1 | 0% | 985 | 3,464 | +252% | 0 | 0 | — |
case-07 | fail→pass | 15,965 | 2,093 | -87% | 1 | 1 | 0% | 888 | 2,018 | +127% | 0 | 0 | — |
case-08 | fail→fail | 7,643 | 1,850 | -76% | 1 | 1 | 0% | 1,291 | 1,951 | +51% | 0 | 0 | — |
case-09 | pass→pass | 9,937 | 5,190 | -48% | 1 | 1 | 0% | 1,445 | 2,620 | +81% | 0 | 0 | — |
case-10 | fail→pass | 13,069 | 4,198 | -68% | 1 | 1 | 0% | 1,889 | 2,519 | +33% | 0 | 0 | — |
case-11 | fail→pass | 10,881 | 3,707 | -66% | 1 | 1 | 0% | 1,926 | 2,307 | +20% | 0 | 0 | — |
case-12 | pass→pass | 8,431 | 2,689 | -68% | 1 | 1 | 0% | 1,290 | 2,125 | +65% | 0 | 0 | — |
case-13 | fail→pass | 7,776 | 3,641 | -53% | 1 | 1 | 0% | 1,055 | 2,355 | +123% | 0 | 0 | — |
case-14 | pass→pass | 6,170 | 3,377 | -45% | 1 | 1 | 0% | 925 | 2,165 | +134% | 0 | 0 | — |
case-15 | pass→pass | 9,349 | 3,941 | -58% | 1 | 1 | 0% | 1,328 | 2,268 | +71% | 0 | 0 | — |
case-16 | fail→pass | 12,491 | 6,624 | -47% | 1 | 1 | 0% | 2,163 | 2,739 | +27% | 0 | 0 | — |
case-17 | pass→pass | 12,695 | 5,003 | -61% | 1 | 1 | 0% | 1,784 | 2,454 | +38% | 0 | 0 | — |
case-18 | fail→pass | 6,896 | 3,206 | -54% | 1 | 1 | 0% | 1,061 | 2,144 | +102% | 0 | 0 | — |
case-19 | fail→pass | 20,092 | 1,685 | -92% | 1 | 1 | 0% | 757 | 1,922 | +154% | 0 | 0 | — |
case-21 | fail→pass | 10,651 | 3,926 | -63% | 1 | 1 | 0% | 1,693 | 2,301 | +36% | 0 | 0 | — |
case-22 | pass→pass | 10,885 | 4,042 | -63% | 1 | 1 | 0% | 1,679 | 2,345 | +40% | 0 | 0 | — |
DecimalAI ran this skill against gemini-3.6-flash twice over the same eval suite — once with the skill loaded and once without — and compared the two runs case by case. 22 cases were attempted, and 16 counted toward the lift figure. The other 6 produced results that are not comparable between the two arms, so they are excluded from the headline rather than averaged into it. The headline lift of +41 percentage points is the difference between those two pass rates over the 16 comparable cases.
Without the skill loaded, the model failed this case. With it loaded, the same prompt on the same model passed. This is one improved case from the latest verified run; every case, including any that regressed, is in the table above.
Other measured skills in the registry, with their headline benchmark lift.