sk Skill · techhorizonlabs
geo-crawlers
AI crawler access analysis. Checks robots.txt, meta tags, and HTTP headers to determine which AI crawlers can access the site. Provides a complete access map and recommendations for maximizing AI visibility while maintaining appropriate control.
Open on skills.sh ↗read 2026-09-16
- installs 8w
- 0
- 30-day movement
- starts with the next reading
- Related entries
- 3
- Connections
- 6
markdownPython
- Host repository
- techhorizonlabs/thl-open
- Allowed tools
- Read, Grep, Glob, Bash, WebFetch, Write
- Host stars
- 16
- Host language
- Python