Enhanced Deep Content Crawler avatar
Enhanced Deep Content Crawler

Pricing

$10.00 / 1,000 results

Go to Store
Enhanced Deep Content Crawler

Enhanced Deep Content Crawler

Developed by

Gideon Nesh

Gideon Nesh

Maintained by Community

A fast, Python-powered web crawler with smart content extraction, JS support, metadata capture, and duplicate detection. Ideal for SEO, content migration, and e-commerce scraping. Reliable, scalable, and easy to customize.

0.0 (0)

Pricing

$10.00 / 1,000 results

0

Total users

3

Monthly users

3

Runs succeeded

>99%

Last modified

7 days ago

Base URL

baseUrlstringRequired

The starting URL for the crawler

Default value of this property is "https://cookcollectivekitchen.com/"

Maximum Pages

maxPagesintegerOptional

The maximum number of pages to crawl (max: 1000)

Default value of this property is 100

Maximum Depth

maxDepthintegerOptional

The maximum depth of links to follow (max: 10)

Default value of this property is 3

Content Selector (Advanced)

contentSelectorstringOptional

CSS selector for extracting specific content (leave 'body' for automatic detection)

Default value of this property is "body"

Exclude URL Patterns

excludePatternsarrayOptional

Regular expressions to exclude URLs (e.g., ["..pdf$", "/admin/."])

Default value of this property is []

Use Browser (JavaScript Support)

useBrowserbooleanOptional

Enable JavaScript rendering with Playwright (slower but handles dynamic content)

Default value of this property is true

Maximum Retries

maxRetriesintegerOptional

Number of retry attempts for failed requests

Default value of this property is 3

Request Timeout (ms)

requestTimeoutintegerOptional

Timeout for each request in milliseconds

Default value of this property is 30000