BigHugger
GH Repository · D4Vinci

Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

stars
81,048
30-day movement
+1,261420/day
Related entries
62
Connections
2
dockerPythonmcp-serverai-scrapingaiautomationcrawlercrawlingcrawling-pythondata-extractionplaywrightxpathpythonweb-scraperscrapingmcpdataselectorsweb-scrapingwebscrapingstealthweb-scraping-python

Scrapling is a Python web scraping framework described as adaptive, covering single requests up to full-scale crawls. It ships an MCP server manifest, so it can also be exposed to AI agents as a scraping tool, and its topics indicate Playwright-based browsing, stealth features, and selector/XPath support.

Reach for it when you want one Python framework that handles both simple fetches and large crawls, with agent access via MCP.

Use it to

  • Scrape single pages or run full crawls
  • Expose scraping as an MCP tool for AI agents
  • Extract data using selectors and XPath
  • Automate browser-based scraping with Playwright
  • Scrape sites that resist bots with stealth features

For Python developers building scrapers or AI agents

Role
mcp-server
Language
Python
Licence
BSD-3-Clause
Forks
8,184
Open issues
2
Last push
2026-09-14
Latest release
v0.1 · 2024-10-13
topicsweb-scrapingcrawlerplaywrightmcp-serverdata-extractionpython