Pricing

$15.00/month + usage

Go to Store

Web Crawler

Try for free

rigelbytes/webcrawler

Developed by

Rigel Bytes

This web crawler is designed to provide users with complete flexibility by allowing them to use their **own proxies**. The scraper collects all pages from the website and returns extracts the **MetaData**, **Title**, and **Content** of the page in MarkDown.

0.0 (0)

Pricing

$15.00/month + usage

Monthly users

Runs succeeded

>99%

Last modified

a month ago

Developer tools Integrations Other

Have any issues or feedback?

This is where you can communicate with the creator of the Actor: discuss a bug, submit a feature request, or just provide feedback.

Create new issue

Pricing

Pricing model

Rental

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

3 days

Price

$15.00

Pro Web Content Crawler (With Images)

assertive_analogy/pro-web-content-crawler

Pro Web Content Crawler is a powerful tool that digs deep into web content and images. It handles complex sites, dynamic pages, and hidden content, making it perfect for extracting both data and images. Customizable and API-ready for your unique data needs.

Gideon Nesh

Incremental Web Crawler

flamboyant_leaf/IncrementalCrawler-v2

The Incremental Crawler efficiently fetches URLs of recently added or updated web pages on a target site, optimizing resources by focusing only on new content. Ideal for keeping up with the latest updates, it integrates seamlessly into workflows for content monitoring and analysis.

AIRabbit

Algolia Webcrawler

jancurn/algolia-webcrawler

Crawls a website using one or more sitemaps and imports the data to Algolia search index. The text content is identified using simple CSS selectors.

Jan Čurn

Dealroom Scraper

saswave/dealroom-scraper

Dealroom company scraper. Collect data from companies using their url / domain name. Dealroom web crawler extract data about social networks, similarweb website traffic, funding rounds, investments, team members, KPI revenues and more ..

SASWAVE

Similarweb scraper

saswave/similarweb-scraper

Extract similarweb informations from multiple input format. Web crawler for similarweb.com website. Get data like total visits, bounce rate, traffic sources, competitors, top countries, company info .. Do market research, track potential competitors, or for other research and analytics on companies.

SASWAVE

Loopnet Scraper

getdataforme/loopnet-scraper

The LoopNet Scraper is a web crawler that extracts commercial real estate listings from LoopNet. It collects key details such as price, location, size, property type, and listing status. The scraper efficiently handles pagination and dynamic content, providing up-to-date insights.

GetDataForMe

Forrent Scraper

getdataforme/forrent-scraper

The ForRent Scraper is a web crawler that extracts rental listings from ForRent. It gathers key details such as rent price, location, size, number of bedrooms, bathrooms, and listing status. The scraper handles dynamic content and pagination, providing accurate, up-to-date rental insights.

GetDataForMe

Rent Scraper

getdataforme/rent-scraper

The Rent Scraper is a web crawler that extracts rental listings from Rent.com. It collects key details such as rent price, location, size, number of bedrooms, bathrooms, and listing status. The scraper efficiently handles dynamic content, providing accurate, up-to-date rental insights.

GetDataForMe

1stdibs scraper

saswave/1stdibs-scraper

1stdibs web crawler. With the 1stdibs.com scraper, extract art product details from a search url. Collect object informations and store contact infos. phone, address and more

SASWAVE

Point2homes Scraper

getdataforme/point2homes-scraper

The Point2Homes Scraper is a web crawler that extracts real estate listings from Point2Homes. It gathers key details like price, location, size, bedrooms, bathrooms, and listing status. The scraper handles pagination and dynamic content, providing up-to-date, accurate insights.

GetDataForMe