Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

Get Started Free →

Olostep - Web Scraping & Crawling API · gooseworks-ai | DecimalAI

researchby gooseworks-ai

Olostep - Web Scraping & Crawling API

gooseworks-ai/web-scraping-olostep

Source gooseworks-ai/goose-skills ↗License MIT

Web scraping, crawling, and AI-powered answer extraction at scale

SkillScore77Maintained

Automatic

Data Engineer pack

Last verified 8/16/2026

What it changes

Passed 14 of 18 test cases with the skill, and 3 of 18 without it.

Without skill18%

With skill77%

Checks it passed that the model alone missed

Uses endpoint path /v1/maps
Uses endpoint path /v1/crawls
Uses endpoint path /v1/scrapes

and 15 more in the full report

13 fixed4 passed either way5 still failing0 broke

Pass-rate lift: +59 pp
Tokens: +140%
Agent turns: 0%
Response time: -59%

Model gemini-3.6-flashMeasured 8/16/2026v117 of 22 cases passed with skill · 18 comparable

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/gooseworks-ai-web-scraping-olostep/SKILL.md https://app.decimal.ai/s/gooseworks-ai-web-scraping-olostep/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add gooseworks-ai-web-scraping-olostep, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/gooseworks-ai-web-scraping-olostep/ and pins it in .decimal/skills.lock

decimalai skills add gooseworks-ai-web-scraping-olostep

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/gooseworks-ai-web-scraping-olostep/SKILL.md https://app.decimal.ai/s/gooseworks-ai-web-scraping-olostep/SKILL.md

Raw file: /s/gooseworks-ai-web-scraping-olostep/SKILL.md ↗ · machine-readable summary at /s/gooseworks-ai-web-scraping-olostep.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 13 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 13

Prompt

If the credentials configuration file at ~/.gooseworks/credentials.json is missing on my system, what command should I run to log in?

What was checked, without and with the skill
Checked	Without skill	With skill
Instructs the user to execute npx gooseworks login	Missed	Passed

case-19 · gemini-3.6-flash · 8/16/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md235 linessingle file

Olostep - Web Scraping & Crawling API

Setup

Read your credentials from ~/.gooseworks/credentials.json:

export GOOSEWORKS_API_KEY=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json'))['api_key'])")
export GOOSEWORKS_API_BASE=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json')).get('api_base','https://api.gooseworks.ai'))")

If ~/.gooseworks/credentials.json does not exist, tell the user to run: npx gooseworks login

All endpoints use Bearer auth: -H "Authorization: Bearer $GOOSEWORKS_API_KEY"

Powerful web scraping, crawling, and AI-powered content extraction.

Capabilities

Create Scrape: Initiate a web page scrape
Create Answer: The AI will perform actions like searching and browsing web pages to find the answer to the provided task
Maps: This endpoint allows users to get all the urls on a certain website
Start Crawl: Starts a new crawl
Start Batch: Starts a new batch
Batch Items: Retrieves the list of items processed for a batch
Crawl Info: Fetches information about a specific crawl
Crawl Pages: Fetches the list of pages for a specific crawl
Get Answer: This endpoint retrieves a previously completed answer by its ID
Get Scrape: Can be used to retrieve response for a scrape
Batch Info: Retrieves the status and progress information about a batch
Retrieve Content: Retrieve page content of processed batches and crawls urls

Usage

Create Scrape

Initiate a web page scrape

Parameters:

url_to_scrape* (string) - The URL to start scraping from.
wait_before_scraping (integer) - Time to wait in milliseconds before starting the scraping.

Track record

Benchmark

14 / 18

test cases passed, vs 3 / 18 without

Adoption

Users: 3
Times used: 65

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 8/3/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

gooseworks-ai / goose-skills

skills/research-tools/capabilities/web-scraping-olostep/SKILL.md

View on GitHub ↗

License MITImported 8/3/2026Version v1

Other skills for the same job

Published skills whose descriptions closely match this one, with their headline benchmark lift.

gooseworks-ai/web-scrapingScrape websites, extract structured data, and automate browsers. Use when asked to scrape, extract, crawl, parse, or pull data from web pages or any URL.Close match+75 pp pass-rate lift

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

Olostep - Web Scraping & Crawling API

Setup

Capabilities

Usage

Create Scrape

Track record

Benchmark

Adoption

SkillSafety

Source

Other skills for the same job

Related skills