Loading skill
Install any skill in seconds. Free to start, no credit card required.
Get Started Free →varnan-tech/yc-jobs-scraper
Scrape daily job listings from YCombinator's Workatastartup platform without duplicates.
Passed 19 of 21 test cases with the skill, and 7 of 21 without it.
and 11 more in the full report
13 fixed7 passed either way2 still failing0 broke
Tokens, turns and time describe resource use, not a dollar price.
One of 13 test cases the skill fixed. Same model, same prompt, with and without the skill.
What is the exact filename and path used for the SQLite database where scraped jobs and companies are stored?
| Checked | Without skill | With skill |
|---|---|---|
| Identifies scripts/jobs.db | Missed | Passed |
The instructions your model reads when the skill loads.
This skill provides a robust architecture for scraping jobs from YCombinator and workatastartup.com. It is designed to run automatically, bypass login bottlenecks, and maintain state to never scrape duplicate jobs.
The scraper uses a hybrid approach to maximize reliability and minimize bot detection:
scripts/auth.js uses Playwright to let a human log in once and saves the session to scripts/state.json.scripts/db.js uses better-sqlite3 to manage scripts/jobs.db. It tracks every company_slug and job_id ever seen.scripts/scraper.js loads state.json, visits YC query URLs, and extracts company slugs from the hidden Inertia.js data-page JSON payload./companies/[slug]) to extract jobs from the backend JSON payload to ensure we get the real job_id for accurate deduplication.ycombinator.com/companies/[slug]/jobs.If this is the first time running the scraper in an environment, or if node_modules is missing:
cd @path/scripts
npm install
npx playwright install
If scripts/state.json is missing or expired, the scraper will fail. You must instruct the human user to run the authentication script manually:
cd @path/scripts
node auth.js
Tell the user a browser will open, and they must log in. Playwright will automatically save the cookies/tokens to state.json.
To scrape for new companies and jobs:
cd @path/scripts
node scraper.js
This script will output exactly how many new companies and new jobs were found. Because of jobs.db, running it multiple times consecutively will result in 0 new jobs found.
test cases passed, vs 7 / 21 without
More skills from the same source and nearby in the registry, with their headline benchmark lift.