Skip to main content

domain-scoped-site-crawler-for-markdown-datasets

Crawl a website from one or more start URLs, staying on the same domain, and get back clean Markdown, text, or HTML per page with title, description, and crawl depth. Built for feeding LLM, RAG, or knowledge-base pipelines. Output fields: url, title, depth, wordCount, httpStatusCode and more, as ...

Install this skill

or
domain-scoped-site-crawler-for-markdown-datasets5 files

Comments

Sign in to leave a comment.

No comments yet. Be the first to comment!
Installation guide →
GitHub Stars 8
Rate this skill
Categoryproductivity
UpdatedNovember 11, 2026
bolvein-firex/scraping-skills