domain-scoped-site-crawler-for-markdown-datasets
Crawl a website from one or more start URLs, staying on the same domain, and get back clean Markdown, text, or HTML per page with title, description, and crawl depth. Built for feeding LLM, RAG, or knowledge-base pipelines. Output fields: url, title, depth, wordCount, httpStatusCode and more, as ...
Install this skill
or
78/100
Security score
The domain-scoped-site-crawler-for-markdown-datasets skill was audited on Nov 11, 2026 and we found 6 security issues across 2 threat categories. Review the findings below before installing.
Categories Tested
Security Issues
low line 88
Command substitution pattern
SourceSKILL.md
| 86 | |
| 87 | ```bash |
| 88 | RUN=$(curl -s -X POST "https://api.apify.com/v2/acts/vexaloom-labs~domain-scoped-site-crawler-for-markdown-datasets/runs" \ |
| 89 | -H "Authorization: Bearer $APIFY_TOKEN" -H "Content-Type: application/json" \ |
| 90 | -d @references/example-input.json) |
low line 91
Command substitution pattern
SourceSKILL.md
| 89 | -H "Authorization: Bearer $APIFY_TOKEN" -H "Content-Type: application/json" \ |
| 90 | -d @references/example-input.json) |
| 91 | RUN_ID=$(echo "$RUN" | jq -r '.data.id'); DATASET=$(echo "$RUN" | jq -r '.data.defaultDatasetId') |
| 92 | curl -s "https://api.apify.com/v2/actor-runs/$RUN_ID?waitForFinish=60" -H "Authorization: Bearer $APIFY_TOKEN" | jq -r '.data.status' |
| 93 | curl -s "https://api.apify.com/v2/datasets/$DATASET/items?format=json" -H "Authorization: Bearer $APIFY_TOKEN" > output.json |
medium line 77
Curl to non-GitHub URL
SourceSKILL.md
| 75 | |
| 76 | ```bash |
| 77 | curl -s -X POST "https://api.apify.com/v2/acts/vexaloom-labs~domain-scoped-site-crawler-for-markdown-datasets/run-sync-get-dataset-items" \ |
| 78 | -H "Authorization: Bearer $APIFY_TOKEN" \ |
| 79 | -H "Content-Type: application/json" \ |
medium line 88
Curl to non-GitHub URL
SourceSKILL.md
| 86 | |
| 87 | ```bash |
| 88 | RUN=$(curl -s -X POST "https://api.apify.com/v2/acts/vexaloom-labs~domain-scoped-site-crawler-for-markdown-datasets/runs" \ |
| 89 | -H "Authorization: Bearer $APIFY_TOKEN" -H "Content-Type: application/json" \ |
| 90 | -d @references/example-input.json) |
medium line 92
Curl to non-GitHub URL
SourceSKILL.md
| 90 | -d @references/example-input.json) |
| 91 | RUN_ID=$(echo "$RUN" | jq -r '.data.id'); DATASET=$(echo "$RUN" | jq -r '.data.defaultDatasetId') |
| 92 | curl -s "https://api.apify.com/v2/actor-runs/$RUN_ID?waitForFinish=60" -H "Authorization: Bearer $APIFY_TOKEN" | jq -r '.data.status' |
| 93 | curl -s "https://api.apify.com/v2/datasets/$DATASET/items?format=json" -H "Authorization: Bearer $APIFY_TOKEN" > output.json |
| 94 | ``` |
medium line 93
Curl to non-GitHub URL
SourceSKILL.md
| 91 | RUN_ID=$(echo "$RUN" | jq -r '.data.id'); DATASET=$(echo "$RUN" | jq -r '.data.defaultDatasetId') |
| 92 | curl -s "https://api.apify.com/v2/actor-runs/$RUN_ID?waitForFinish=60" -H "Authorization: Bearer $APIFY_TOKEN" | jq -r '.data.status' |
| 93 | curl -s "https://api.apify.com/v2/datasets/$DATASET/items?format=json" -H "Authorization: Bearer $APIFY_TOKEN" > output.json |
| 94 | ``` |
| 95 |
Scanned on Nov 11, 2026
View Security DashboardGitHub Stars 8
Rate this skill
Categoryproductivity
UpdatedNovember 11, 2026
bolvein-firex/scraping-skills