Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →lingxling/ab-test-setup
Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.
Passed 21 of 24 test cases with the skill, and 18 of 24 without it.
and 3 more in the full report
4 fixed17 passed either way2 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 4 test cases the skill fixed. Same model, same prompt, with and without the skill.
During an active A/B test on our checkout button copy experiment, our engineering lead noticed a minor typo on Variant B's copy and wants to update Variant B's design mid-test to fix it. How should mid-test variant modifications be handled?
| Checked | Without skill | With skill |
|---|---|---|
| Prohibits modifying variant implementations mid-experiment. | Missed | Passed |
| Recommends restarting or aborting the test if a variant change is necessary. | Passed | Passed |
The instructions your model reads when the skill loads.
Ensure every A/B test is valid, rigorous, and safe before a single line of code is written.
You must have:
A valid hypothesis includes:
Before designing variants or metrics, you MUST:
test cases passed, vs 18 / 24 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.