MCP MCP server · io.github.us
io.github.us/fastcrw
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
- host stars
- 1,051
- 30-day movement
- +217/day
- Related entries
- 1
- Connections
- 0
remotestreamable-http
fastCRW is an open-source, self-hostable Rust web crawler and search tool exposed to AI agents via an MCP server over streamable HTTP. It scrapes, crawls, maps, and searches the web, and can also run as a CLI or Python SDK against a hosted Cloud option.
You want fast, low-footprint crawling and search the author claims beats Firecrawl and Crawl4AI on a public 1,000-URL dataset, runnable locally with no account.
Use it to
- Set up the MCP server in your AI tools with crw setup
- Scrape and crawl pages for agent context
- Map and search websites
- Self-host the Rust binary locally
- Migrate existing Firecrawl workflows
For Developers building AI agents that need web data
- Runs
- hosted — you connect to it
- Transport
- streamable-http
- Version
- 1.0.0
- Last release
- 2026-06-28
topicsweb-crawlerscrapingsearchrustself-hostedai-agents