sk Skill · charlieviettq
"algo-seo-crawl"
"Implement a web crawler pipeline covering URL discovery, fetching, parsing, and storage. Use this skill when the user needs to build a site crawler, audit website structure, or collect web data systematically — even if they say 'scrape a website', 'crawl all pages', or 'site audit spider'.".
Open on skills.sh ↗read 2026-09-15
- installs 8w
- 0
- 30-day movement
- starts with the next reading
- Related entries
- 1
- Connections
- 3
jsonPython
- Host repository
- charlieviettq/awesome-agent-skill
- Allowed tools
- Read, Glob, Grep
- Host stars
- 26
- Host language
- Python