Install any skill in seconds. Free to start, no credit card required.
Get Started Free →runkids/skillshare-cli-e2e-test
Run isolated E2E tests in devcontainer from ai_docs/tests runbooks.
Passed 17 of 20 test cases with the skill, and 5 of 20 without it.
and 19 more in the full report
13 fixed6 passed either way3 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
A newer attempt on gemini-3.6-flash on 10/2/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.
One of 13 test cases the skill fixed. Same model, same prompt, with and without the skill.
I'm drafting an automated runbook step to remove a Skillshare CLI extension non-interactively using `ss uninstall`. Should I add `--yes` or `-y` to skip the interactive confirmation prompt?
| Checked | Without skill | With skill |
|---|---|---|
| Rejects the --yes flag in favor of using --force or -f for non-interactive uninstall. | Missed | Passed |
| --force | Passed | Passed |
The instructions your model reads when the skill loads.
Run isolated E2E tests in devcontainer. $ARGUMENTS specifies runbook name or "new".
Before acting, run python3 scripts/ai-context.py testing. The topic is the source of truth for isolation, runbook quality and reporting rules; this skill retains the execution flow and mdproof recipes.
Confirm devcontainer is running and get container ID:
CONTAINER=$(docker compose -f .devcontainer/docker-compose.yml ps -q skillshare-devcontainer)
docker compose -f .devcontainer/docker-compose.yml up -dCONTAINER is set for all subsequent docker exec calls.Confirm Linux binary is available:
docker exec $CONTAINER bash -c \
'/workspace/.devcontainer/ensure-skillshare-linux-binary.sh && ss version'
Confirm mdproof is installed:
docker exec $CONTAINER /workspace/.devcontainer/ensure-mdproof.sh
This auto-installs from GitHub release, or falls back to /workspace/bin/mdproof (local dev binary).
Check for lessons learned from previous runs:
test -f /workspace/.mdproof/lessons-learned.md && cat /workspace/.mdproof/lessons-learned.md
If the file exists, read it before writing or debugging runbooks — it contains known gotchas and assertion patterns.
docker exec $CONTAINER mdproof --dry-run --report json /workspace/ai_docs/tests/
This returns JSON with every runbook's steps, commands, and expected assertions — no manual markdown parsing needed. Use this to understand what each runbook covers.test cases passed, vs 5 / 20 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.