30 minutes trial then $25.00/month - No credit card required now

RegExp Scraper

ib4ngz/regexp-scraper

30 minutes trial then $25.00/month - No credit card required now

This actor scrapes data from a list of provided URLs using regular expressions for precise and customizable pattern matching. It can handle both static and dynamic web pages and supports depth-based crawling to explore links and extract data from multiple levels of the web.

Developer

Iqbal R

Actor Metrics

1 monthly user
No reviews yet
1 bookmark
>99% runs succeeded
Created in Jan 2025
Modified 2 months ago

Categories

Start URLs

startUrlsarrayRequired

URLs to start with.

Maximum Depth

maxDepthintegerOptional

The maximum depth for crawling.

Default value of this property is 1

Regex Patterns

patternsstringRequired

Patterns to search in the HTML content. Each pattern should be on a new line.

Crawler Type

crawlerTypeEnumOptional

Select the type of crawler to use.

Value options:

"Crawlee + Cheerio": string"Crawlee + Puppeteer + Chrome": string

Default value of this property is "Crawlee + Cheerio"

Proxy configuration

proxyConfigurationobjectOptional

Select proxies to be used by your crawler.

Minimum Concurrency

minConcurrencyintegerOptional

The minimum number of concurrent requests or pages being processed.

Default value of this property is 1

Maximum Concurrency

maxConcurrencyintegerOptional

The maximum number of concurrent requests or pages being processed.

Default value of this property is 10

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.8k

4.7/5

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

78.4k

4.5/5

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.7k

5.0/5

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

1.1k

4.3/5

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

5.0/5

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

41.1k

Twitter (X.com) Scraper Unlimited: No Rate-Limits

apidojo/twitter-scraper-lite

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.