Launch Check: crawlee.dev
← Launch Check · Download CSV
https://crawlee.dev/ · 2026-10-18T08:50:06.647Z · launchcheck/1.0
critical0
high0
medium1
low2
info1
Scope: 25 page(s) crawled · 150 of 2551 links checked · 7 client JS file(s) scanned · sitemap: 4866 URLs · homepage HTTP 200 in 153 ms.
Issues
| Severity | Area | Detail |
|---|
| medium | security-headers | No Content-Security-Policy: weaker protection against XSS / injected scripts. |
| low | security-headers | X-Content-Type-Options: nosniff missing. |
| low | security-headers | Referrer-Policy missing: full URLs may leak to third parties. |
| info | security-headers | Permissions-Policy not set. |
Meta & social preview
| Title | Crawlee · Build reliable crawlers. Fast. |
| Description | Crawlee helps you build and maintain your crawlers. It's open source, but built by developers who scrape millions of pages every day for a living. |
| Canonical | https://crawlee.dev/ |
| og:title | Crawlee for JavaScript · Build reliable crawlers. Fast. |
| og:image | https://crawlee.dev/img/crawlee-og.png |
| twitter:card | summary_large_image |
| Viewport | width=device-width, initial-scale=1.0 |
| lang | en |
| h1 count | 1 |
| robots meta | missing |
Security headers
strict-transport-security | ✅ max-age=31556952 |
content-security-policy | ❌ missing |
x-content-type-options | ❌ missing |
referrer-policy | ❌ missing |
permissions-policy | ❌ missing |
x-frame-options | ✅ SAMEORIGIN |
Read-only check: only public pages were requested (GET/HEAD), with limited concurrency, respecting robots.txt for crawling. Secret-pattern matches are shown masked and may include false positives; verify before rotating keys. Not a penetration test.