Enhanced Deep Content Crawler
Pricing
$10.00 / 1,000 results
Enhanced Deep Content Crawler
A fast, Python-powered web crawler with smart content extraction, JS support, metadata capture, and duplicate detection. Ideal for SEO, content migration, and e-commerce scraping. Reliable, scalable, and easy to customize.
0.0 (0)
Pricing
$10.00 / 1,000 results
0
Total users
3
Monthly users
3
Runs succeeded
>99%
Last modified
7 days ago
Base URL
baseUrl
stringRequired
The starting URL for the crawler
Default value of this property is "https://cookcollectivekitchen.com/"
Maximum Pages
maxPages
integerOptional
The maximum number of pages to crawl (max: 1000)
Default value of this property is 100
Maximum Depth
maxDepth
integerOptional
The maximum depth of links to follow (max: 10)
Default value of this property is 3
Content Selector (Advanced)
contentSelector
stringOptional
CSS selector for extracting specific content (leave 'body' for automatic detection)
Default value of this property is "body"
Exclude URL Patterns
excludePatterns
arrayOptional
Regular expressions to exclude URLs (e.g., ["..pdf$", "/admin/."])
Default value of this property is []
Use Browser (JavaScript Support)
useBrowser
booleanOptional
Enable JavaScript rendering with Playwright (slower but handles dynamic content)
Default value of this property is true