Enhanced Deep Content Crawler

Pricing

$10.00 / 1,000 results

Enhanced Deep Content Crawler

A fast, Python-powered web crawler with smart content extraction, JS support, metadata capture, and duplicate detection. Ideal for SEO, content migration, and e-commerce scraping. Reliable, scalable, and easy to customize.

Pricing

$10.00 / 1,000 results

Rating

1.0

(1)

Developer

Gideon Nesh

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

5 months ago

Last modified

Base URL

baseUrlstringRequired

The starting URL for the crawler

Default value of this property is "https://cookcollectivekitchen.com/"

Maximum Pages

maxPagesintegerOptional

The maximum number of pages to crawl (max: 1000)

Default value of this property is 100

Maximum Depth

maxDepthintegerOptional

The maximum depth of links to follow (max: 10)

Default value of this property is 3

Content Selector (Advanced)

contentSelectorstringOptional

CSS selector for extracting specific content (leave 'body' for automatic detection)

Default value of this property is "body"

Exclude URL Patterns

excludePatternsarrayOptional

Regular expressions to exclude URLs (e.g., ["..pdf$", "/admin/."])

Default value of this property is []

Use Browser (JavaScript Support)

useBrowserbooleanOptional

Enable JavaScript rendering with Playwright (slower but handles dynamic content)

Default value of this property is true

Maximum Retries

maxRetriesintegerOptional

Number of retry attempts for failed requests

Default value of this property is 3

Request Timeout (ms)

requestTimeoutintegerOptional

Timeout for each request in milliseconds

Default value of this property is 30000

Website Content Crawler Fast

timelody/website-content-crawler-fast

Scraping data from every single web page.

timelody

5.0

Pro Web Content Crawler (With Images)

assertive_analogy/pro-web-content-crawler

Pro Web Content Crawler is a powerful tool that digs deep into web content and images. It handles complex sites, dynamic pages, and hidden content, making it perfect for extracting both data and images. Customizable and API-ready for your unique data needs.

Gideon Nesh

209

5.0

Web Crawler

rigelbytes/webcrawler

This web crawler is designed to provide users with complete flexibility by allowing them to use their **own proxies**. The scraper collects all pages from the website and returns extracts the **MetaData**, **Title**, and **Content** of the page in MarkDown.

Rigel Bytes

Web Crawler & Semantic Schema-Enhanced Extractor

devil_port369-owner/web-crawler

Depth-controlled web crawler that transforms websites into structured analytics-ready data. Starting from one or more URLs, it crawls internal links up to a configurable depth and outputs detailed JSON records per page

DataFusionX

5.0

Deep Website Content Crawler

6sigmag/deep-website-content-crawler

Scrape Failed Killer! A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

801

4.1

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

2.7K

4.3

AI Website Content Markdown Scraper

quaking_pail/ai-website-content-markdown-scraper

This Apify Actor, "Website Content Crawler with Markdown Extraction," is designed to perform a comprehensive crawl of specified websites, extract their text content, convert it into Markdown format, and store it in a structured dataset. The extracted content is suitable for feeding LLMs.

AI_Builder

838

3.9

Fast Scraper

danielherman/fast-scraper

Fast Scraper is a blazingly fast web scraper powered by Rust on the backend. It allows you to scrape static HTML pages extremely quickly while using only <128 MB of memory. With this scraper, you can maximize the efficiency of your credits on Apify.

Daniel Herman

Html to Markdown Converter

antonio_espresso/html-to-markdown-converter

Crawl a target URL and convert its HTML content into clean, structured Markdown with optional heading-based chunking.

Antonio Blago

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.