MCP MCP server · io.github.nolindnaidoo
io.github.nolindnaidoo/scrape-le
Analyse robots.txt content and report whether a path may be crawled.
- host stars
- 1
- 30-day movement
- starts with the next reading
- Related entries
- 2
- Connections
- 0
npmlocalstdio
- Runs
- installed — on your machine
- Transport
- stdio
- Packaged as
- npm:scrape-le-mcp
- Install
- npx -y scrape-le-mcp
- Version
- 2.2.5
- Last release
- 2026-08-14