Install any skill in seconds. Free to start, no credit card required.
Get Started Free →agricidaniel/seo-technical
Technical SEO audit across 9 categories: crawlability, indexability, security, URL structure, mobile, Core Web Vitals, structured data, JavaScript rendering, and IndexNow protocol.
Passed 18 of 20 test cases with the skill, and 10 of 20 without it.
and 9 more in the full report
9 fixed11 passed either way2 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
This benchmark measured an earlier version of the skill.
A newer attempt on gemini-3.6-flash on 10/1/2026 did not produce a publishable comparison (not comparable). The snapshot above is the previously measured run.
One of 9 test cases the skill fixed. Same model, same prompt, with and without the skill.
We want to configure `CLAUDE_SEO_LOCAL_TARGETS` to audit a local staging service running at `localhost:3000`. Does this allowlisted host mechanism permit Playwright rendering and automated redirect following to external domains during the crawl?
| Checked | Without skill | With skill |
|---|---|---|
| States that allowlisted local targets permit raw HTTP fetches for the primary URL. | Missed | Passed |
| Notes that Playwright rendering and redirect targets remain refused under local target policy. | Missed | Passed |
The instructions your model reads when the skill loads.
"${CLAUDE_PLUGIN_ROOT}/scripts/claude-seo" run sitemap_discovery.py <url> --json; require a
valid entry in found, and report stale or unsafe robots.txt declarations
separately from working fallback locations/crawling/ipranges/ and googlebot.json was renamed common-crawlers.json.As of 2025-2026, AI companies actively crawl the web to train models and power AI search. Managing these crawlers via robots.txt is a critical technical SEO consideration.
Known AI crawlers (the authoritative table, with robots.txt behaviour per crawler, is in seo-geo):
| Crawler | Company | robots.txt token | Purpose |
|---|---|---|---|
| GPTBot | OpenAI | GPTBot | Model training (NOT ChatGPT Search) |
| OAI-SearchBot | OpenAI | OAI-SearchBot | ChatGPT Search citability |
| ChatGPT-User | OpenAI | ChatGPT-User | Real-time browsing (user-triggered) |
| ClaudeBot | Anthropic | ClaudeBot | Model training (NOT Claude search citability) |
| Claude-SearchBot | Anthropic | Claude-SearchBot | Claude search-result citability |
| PerplexityBot | Perplexity | PerplexityBot | Perplexity search index (not model training) |
| Bytespider | ByteDance | Bytespider | Model training |
| Google-Extended | Google-Extended | Gemini training and grounding, and training of the models behind Search gen-AI features (no effect on Search inclusion or ranking) | |
| Applebot-Extended | Apple | Applebot-Extended | Apple Intelligence training opt-out (NOT Siri/Spotlight/Safari) |
| CCBot | Common Crawl | CCBot | Open dataset |
test cases passed, vs 10 / 20 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.