Progressive four-tier URL content scraping with automatic fallback strategy. USE WHEN user says "scrape this URL", "fetch this page", "get content from", "can't access this site", "use Bright Data", "pull content from URL", or needs to retrieve web content that may have bot detection or access restrictions.
SkillScore59Maintained
Automatic
◆Data Engineer pack
Last verified 8/20/2026
What it changes
Passed 10 of 17 test cases with the skill, and 7 of 17 without it.
Without skill41%
With skill59%
Checks it passed that the model alone missed
Identifies Playwright browser automation as Tier 3
Specifies Markdown as the required conversion format
Escalates to Bright Data MCP service for CAPTCHA resolution
and 1 more in the full report
4 fixed9 passed either way9 still failing0 broke
Pass-rate lift
+18 pp
Tokens
+51%
Agent turns
0%
Response time
-38%
Model gemini-3.6-flashMeasured 8/20/2026v113 of 22 cases passed with skill · 17 comparable
Tokens, turns and time describe resource use, not a dollar price.
See it in action
One of 4 test cases the skill fixed. Same model, same prompt, with and without the skill.
1 of 4
Prompt
If fetching https://data-site.io fails at Tier 1 and Tier 2, what specific tool constitutes Tier 3 in the standard 4-tier scraping workflow?
What was checked, without and with the skill
Checked
Without skill
With skill
Identifies Playwright browser automation as Tier 3
Missed
Passed
case-07 · gemini-3.6-flash · 8/20/2026 · answers are capped and redacted
What's inside
The instructions your model reads when the skill loads.
SKILL.md145 linessingle file
Workflow Routing (SYSTEM PROMPT)
CRITICAL: This workflow implements progressive escalation for URL content retrieval.
When user requests scraping/fetching URL content:
Examples: "scrape this URL", "fetch this page", "get content from [URL]", "pull content from this site", "retrieve [URL]", "can't access this site", "this site is blocking me", "use Bright Data to fetch"
→ READ: ${PAI_DIR}/skills/brightdata/workflows/four-tier-scrape.md
→ EXECUTE: Four-tier progressive scraping workflow (WebFetch → Curl → Browser Automation → Bright Data MCP)
When to Activate This Skill
Direct Scraping Requests (Categories 1-4)
"scrape this URL", "scrape [URL]", "scrape this page"
"fetch this URL", "fetch [URL]", "fetch this page", "fetch content from"
"pull content from [URL]", "pull this page", "pull from this site"
"get content from [URL]", "retrieve [URL]", "retrieve this page"