Crawler Orchestra

Example Process Crawl Results

apify/example-process-crawl-results

Iterates through all results from a crawler run and count them. Needs to be called from the crawler's finish webhook by adding an URL to finish the webhook of your crawler. Use this actor as a starting point to develop custom post-processing of data from the crawler.

Apify

17

Counts the current page visits inside an act.

Juan Gaitán Villamizar

66

MySQL Insert

petr_cermak/MySQL-insert

This act takes a crawler execution and inserts it's results into a remote MySQL database.

Petr Cermak

56

Bandcamp Crawler

service-paradis/bandcamp-crawler

The Bandcamp.com crawler is a web scraping tool that allows you to extract data from the Bandcamp music platform. With this crawler, you can get information about albums, tracks, and much more. The crawler is built on top of Apify SDK, and you can run it both on the Apify platform and locally.

Alexandre Paradis

28

This act takes a crawler execution and inserts it's results into a remote PostgreSQL database.

Petr Cermak

29

This acts takes crawler execution results and deduplicates them.

Petr Cermak

10

Kijiji Crawler

service-paradis/kijiji-crawler

The Kijiji crawler is a web scraping tool that allows you to extract data from the Kijiji selling platform. With this crawler, you can get information search results and local advertisement details.

Alexandre Paradis

22

Datasets Compare

petr_cermak/datasets-compare

Act for comparing crawler execution results. By default the final result set will contain only new and updated records.

Petr Cermak

21

a scraper/crawler API which Scrape/Crawl hotels information from www.Kayak.com