Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →athola/challenge
Presents adaptive codebase challenge questions with multiple-choice and trace exercises.
Passed 13 of 19 test cases with the skill, and 3 of 19 without it.
and 10 more in the full report
11 fixed4 passed either way7 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 11 test cases the skill fixed. Same model, same prompt, with and without the skill.
After evaluating an answer submitted for an existing active quiz question stored on disk, what must happen to that pending state file?
| Checked | Without skill | With skill |
|---|---|---|
| The file at .gauntlet/state/pending_challenge.json is removed or updated | Missed | Passed |
The instructions your model reads when the skill loads.
Present challenges from the knowledge base and evaluate answers.
gauntlet:extract)gauntlet:onboard)Before generating a challenge, register the in-loop variation provider so we do not call out to the Anthropic API just to spawn a sibling Claude (issue #464). Outside Claude Code this is a no-op and the default Anthropic provider remains active.
from gauntlet.providers.in_loop import (
register_in_loop_provider_if_inside_claude_code,
)
register_in_loop_provider_if_inside_claude_code()
Load state: read .gauntlet/knowledge.json and developer
progress
Check for pending challenge: if
.gauntlet/state/pending_challenge.json exists, evaluate the
developer's most recent message as an answer before generating
a new one
Generate challenge: use adaptive weighting to select a knowledge entry and challenge type
Present challenge: show the question with context
Evaluate answer: score the response (pass/partial/fail)
test cases passed, vs 3 / 19 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.