Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →loulanyue/data-scraper-agent
Build a fully automated AI-powered data collection agent for any public source — job boards, prices, news, GitHub, sports, anything. Scrapes on a schedule, enriches data with a free LLM (Gemini Flash), stores results in Notion/Sheets/Supabase, and learns from user feedback. Runs 100% free on GitHub Actions.
Passed 20 of 22 test cases with the skill, and 12 of 22 without it.
and 14 more in the full report
9 fixed11 passed either way1 still failing1 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 9 test cases the skill fixed. Same model, same prompt, with and without the skill.
I am writing a Python REST client to call free-tier Gemini models for automated text scoring. I need rate-limit resilience so that when model quota limits (HTTP 429) are encountered, the code automatically tries fallback models in sequence. Write the Python function and list the specific fallback model array.
| Checked | Without skill | With skill |
|---|---|---|
| Lists gemini-2.0-flash-lite as the primary model in the sequence | Missed | Passed |
| Places gemini-2.0-flash after gemini-2.0-flash-lite in the fallback chain | Missed | Passed |
| Includes gemini-flash-lite-latest at the end of the fallback chain | Missed | Passed |
The instructions your model reads when the skill loads.
Build a production-ready, AI-powered data collection agent for any public data source. Runs on a schedule, enriches results with a free LLM, stores to a database, and improves over time.
Stack: Python · Gemini Flash (free) · GitHub Actions (free) · Notion / Sheets / Supabase
Every data scraper agent has three layers:
COLLECT → ENRICH → STORE
│ │ │
Scraper AI (LLM) Database
runs on scores/ Notion /
schedule summarises Sheets /
& classifies Supabase
| Layer | Tool | Why |
|---|---|---|
| Scraping | requests + BeautifulSoup | No cost, covers 80% of public sites |
| JS-rendered sites | playwright (free) | When HTML scraping fails |
| AI enrichment | Gemini Flash via REST API | 500 req/day, 1M tokens/day — free |
| Storage | Notion API | Free tier, great UI for review |
| Schedule | GitHub Actions cron | Free for public repos |
| Learning | JSON feedback file in repo | Zero infra, persists in git |
test cases passed, vs 12 / 22 without
Published skills whose descriptions closely match this one, with their headline benchmark lift.
More skills from the same source and nearby in the registry, with their headline benchmark lift.