GH Repository ยท paulpierre
markdown-crawler
A multithreaded ๐ธ๏ธ web crawler that recursively crawls a website and creates a ๐ฝ markdown file for each page, designed for LLM RAG
- stars
- 471
- 30-day movement
- +10/day
- Related entries
- 60
- Connections
- 1
html-to-markdownhtml2mdpythonllmmarkdown-parserllmopsmarkdownmarkdown-crawlerragweb-scrapermarkdown-scrapermd-crawlerhtml-to-markdown-converterPython
- Role
- rag
- Language
- Python
- Licence
- MIT
- Forks
- 54
- Open issues
- 5
- Last push
- 2026-06-26
- Latest release
- markdown-crawler-0.0.4 ยท 2023-10-24