Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →yya007/crawl-sources
Crawl all SkillFinder data sources (SkillsMP, ClawHub, SkillHub, Anthropic marketplace, GitHub topics) and write fresh raw JSONL files to data/raw/. Runs crawlers in parallel; supports incremental resume and per-source limits.
Passed 12 of 20 test cases with the skill, and 4 of 20 without it.
and 8 more in the full report
9 fixed4 passed either way9 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 9 test cases the skill fixed. Same model, same prompt, with and without the skill.
Before starting any crawling subprocesses, what directory setup step must be performed to hold raw results?
| Checked | Without skill | With skill |
|---|---|---|
| Executes directory creation for data/raw | Missed | Passed |
The instructions your model reads when the skill loads.
Crawl all skill registries and refresh the raw data files in data/raw/.
This skill covers the crawl step only — it does not normalize, embed, or
rebuild the index. Run update-index afterward to turn fresh raw data into a
searchable index.
GITHUB_TOKEN env var set (required by SkillsMP, ClawHub, and topic crawlers)pip install -r requirements-dev.txtWhen this skill triggers, determine scope from the user's request:
| User says | Scope |
|---|---|
| "crawl everything" / "all sources" | Run all five crawlers (default) |
| "crawl skillsmp" / "crawl github" | SkillsMP only |
| "crawl clawhub" / "crawl openclaw" | ClawHub only |
| "crawl skillhub" | SkillHub only |
| "crawl marketplace" / "crawl anthropic" | Marketplace only |
| "crawl topics" / "crawl github topics" | Topic crawler only |
| "quick test" / "limit N" | Add --limit N to each crawler |
echo "${GITHUB_TOKEN:0:4}..."
If empty, stop:
"Set
GITHUB_TOKENbefore crawling:export GITHUB_TOKEN=ghp_..."
mkdir -p data/raw
test cases passed, vs 4 / 20 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.