Stealth Website Crawler
Pricing
Pay per usage
Crawl websites protected by Cloudflare, DataDome, and other anti-bot systems. Extract clean text or markdown for AI/LLM pipelines. Like Website Content Crawler, but for sites that block you.
Pricing
Pay per usage
Rating
0.0
(0)
Developer
Nocturne
Actor stats
0
Bookmarked
3
Total users
1
Monthly active users
3 days ago
Last modified
Categories
Share
Sequence of actions to perform on each page. If provided, runs in interactive mode. Types: click, fill, type, scroll, hover, select, wait, screenshot, javascript, extractHtml, extractContent, captureNetwork, humanActivity, mouseMove.
Record JSON/API responses made by the page. Useful for intercepting data APIs.
Maximum pages to crawl (crawl mode only).
How many links deep to follow from start URLs. 0 = start URLs only.
Format for extracted content.
Follow same-domain links to discover more pages (crawl mode).
Only crawl URLs matching these glob patterns. Example: https://example.com/blog/*
Skip URLs matching these glob patterns. Example: /login
CSS selector to wait for before processing each page. Useful for JS-heavy sites.
Capture a screenshot of each page. Stored in key-value store.
Block images, media, fonts, and stylesheets to reduce proxy bandwidth and speed up crawling.
Cookies to set before crawling. Format: [{name, value, domain, path}]
Number of pages to load simultaneously. Lower = safer stealth, higher = faster.
Max time to wait for a page to load.
Number of retry attempts for failed pages. Failed pages are not charged.
