Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →When a real test is too rare, large, or irreversible, run a controlled counterfactual: isolate one variable, fix conditions, trace the mechanistic chain, and bound what the result implies.
| Test case | Without → With | Effect | Δ tokens | Δ turns |
|---|---|---|---|---|
| case-02 | ✗→✓ | ▲ Improved | -52% | 0% |
| case-03 | ✗→✓ | ▲ Improved | -29% | 0% |
| case-05 | ✗→✓ | ▲ Improved | 3% | 0% |
| case-06 | ✗→✓ | ▲ Improved | 18% | 0% |
| case-13 | ✗→✓ | ▲ Improved | -15% | 0% |
When empiricism is out of reach, run a disciplined counterfactual: one isolated change, fixed conditions, step-by-step mechanism, and a hard bound on implications.
Emit a thought-experiment record:
question: what behavior or decision is under testisolated_variable: single change vs control worldinitial_conditions: frozen state and non-changesconsequence_chain: ordered mechanistic stepsinvariants: what still holdsbreak_points: first requirement failures and critical assumptionsimplication_bound: actions/checks justified by the chain onlydiscriminating_check: cheapest real observation to confirm or kill the weak linkOther measured skills in the registry, with their headline benchmark lift.