Skip to main content

web-crawling

Automates web scraping and data extraction from JavaScript-rendered pages using various tools like Playwright and Scrapy.

Install this skill

or
88/100

Security score

The web-crawling skill was audited on Jun 3, 2026 and we found 12 security issues across 1 threat category. Review the findings below before installing.

Categories Tested

Security Issues

low line 39

External URL reference

SourceSKILL.md
39await page.goto('https://example.com');
low line 55

External URL reference

SourceSKILL.md
55await page.goto('https://example.com');
low line 69

External URL reference

SourceSKILL.md
69await page.goto('https://example.com/data');
low line 86

External URL reference

SourceSKILL.md
86await page.goto('https://example.com/spa');
low line 102

External URL reference

SourceSKILL.md
102await page.goto('https://example.com', { waitUntil: 'networkidle0' });
low line 111

External URL reference

SourceSKILL.md
111katana -u https://example.com -silent -d 3
low line 116

External URL reference

SourceSKILL.md
116katana -u https://example.com -silent -d 2 -jsonl
low line 121

External URL reference

SourceSKILL.md
121katana -u https://example.com -headless -d 2 -silent
low line 126

External URL reference

SourceSKILL.md
126scrapy fetch --nolog https://example.com | python3 -c "
low line 147

External URL reference

SourceSKILL.md
147crawler.run(['https://example.com']);
low line 155

External URL reference

SourceSKILL.md
155katana -u https://example.com -silent -d 2 | grep '/blog/' | head -5 | while read url; do
low line 174

External URL reference

SourceSKILL.md
174katana -u https://example.com -silent -d 2 -jsonl > crawl.jsonl
Scanned on Jun 3, 2026
View Security Dashboard
Installation guide →