Install any skill in seconds. Free to start, no credit card required.
Get Started Free →yogsoth-ai/falsification-first-stress-test
Campaign: Truth-seeking adversarial validation for scientific research artifacts (NOT publication defense). Core question: Where have we fooled ourselves, and is each load-bearing claim even falsifiable? Win-condition is INVERTED from survival/resilience to active refutation. Methods: Popper falsificationism, Lakatos Proofs and Refutations, Mayo severe testing, Platt strong inference.
Passed 18 of 21 test cases with the skill, and 6 of 21 without it.
and 21 more in the full report
13 fixed6 passed either way3 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 12 test cases the skill fixed. Same model, same prompt, with and without the skill.
We are conducting an exhaustive, deep (L scope) stress test on a complex multi-agent economics paper containing 20 propositions. What are the exact budget parameters for claims attacked, refutation attempts, severe tests, and external evidence searches?
| Checked | Without skill | With skill |
|---|---|---|
| Limits the attack scope to 14 load-bearing claims. | Missed | Passed |
| Allocates 7 refutation attempts per claim. | Missed | Passed |
| Allocates 4 severe tests per claim. | Missed | Passed |
| Allocates 12 external evidence searches. | Missed | Passed |
The instructions your model reads when the skill loads.
Core question: Where have we fooled ourselves — and is each load-bearing claim even falsifiable?
This campaign is a deliberate inversion of publication-oriented stress testing. In a publication frame, the artifact is a thing to be defended; success = it survives debate and gets hardened. That frame optimizes for persuasiveness and is actively dangerous for truth-seeking research: it rewards a claim for being un-attackable, which is exactly the failure mode of an unfalsifiable theory. Here the artifact is a suspect. We WANT to break it, because breaking it teaches us something true and cheap (compute/thought) before we spend expensive effort (sandbox, wet-lab) on a false premise. Confidence is not assumed and defended down; it is EARNED up, only by surviving honest assault.
Every load-bearing claim exits in exactly one bucket:
| Bucket | Meaning | Action |
|---|---|---|
| BROKEN | A concrete refutation (counterexample / disagreeing case / failed derivation) was found. | Revise the claim or demote it. Record what the refutation taught. |
| CORROBORATED | The claim was stated falsifiably, attacked severely, and held. | Raise confidence. Record WHAT was forbidden-and-held (the more it forbids, the stronger). |
| UNFALSIFIABLE | No statement of the claim could be found that some observation/computation could refute. | RED FLAG. Demote to conjecture or relabel (e.g. "isomorphism"→"analogy"). |
| Claim/artifact type | Primary strategy | Secondary |
|---|---|---|
| a beautiful unification / elegant backbone | elegance-trap-probe | adversarial-debate-truthseeking |
| an isomorphism claim (A ≅ B ≅ …) | isomorphism-falsification | adversarial-stress-testing (sibling campaign) |
| load-bearing propositions | counterfactual-probing (sibling campaign) | adversarial-stress-testing (sibling campaign) |
| an "N paths independently converged" claim | independent-convergence-audit | red-team-truthseeking |
| a validator / sandbox design | circular-validation-audit | red-team-truthseeking |
| any sharp claim | red-team-truthseeking | adversarial-debate-truthseeking |
test cases passed, vs 6 / 21 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.