sk Skill · volcengine
vs-crawler
Crawl websites (news, blogs, papers, GitHub, product docs, RSS feeds) into a fixed-schema JSONL file, then create a dataset and a searchable application in Viking AI Search. Supports one-time crawl and scheduled recurring crawl with automatic incremental sync.
Open on skills.sh ↗read 2026-09-19
- installs 8w
- 0
- 30-day movement
- starts with the next reading
- Related entries
- 1
- Connections
- 0
TypeScriptjsonworkflowrss crawlerdocs crawlergithub crawlerpaper crawlernews crawlercontent ingestionscheduled crawlblog crawlerweb crawler
- Host repository
- volcengine/SearchCLI
- Category
- workflow
- Compatible with
- codex, agents, external-agent
- Host stars
- 1,181
- Host language
- TypeScript