Pricing

Pay per usage

Try for free

Go to Apify Store

Example Process Crawl Results

Try for free

Iterates through all results from a crawler run and count them. Needs to be called from the crawler's finish webhook by adding an URL to finish the webhook of your crawler. Use this actor as a starting point to develop custom post-processing of data from the crawler.

Pricing

Pay per usage

Rating

4.5

(2)

Developer

Apify

Actor stats

Bookmarked

Total users

Monthly active users

15 days ago

Last modified

example-process-crawl-results

A webhook-triggered actor that post-processes results from another actor run.

Add this actor's run URL as the finish webhook of your actor. When the actor finishes, it calls this actor with the run ID. The actor then fetches all dataset results in paginated batches, counts them, and saves the total alongside the run details as OUTPUT.

Input

Field	Type	Description
`runId`	string	ID of the actor run to process

Output

Saved to OUTPUT in the default Key-Value Store and to the dataset:

{ "runId": "abc123", "runStatus": "SUCCEEDED", "totalItems": 42 }

Use this as a template for custom post-processing logic (data transformation, notifications, exports) after an actor run completes.

Send Legacy PhantomJS Crawler Results

drobnikj/send-crawler-results

This actor downloads results from Legacy PhantomJS Crawler task and sends them to email as attachments. It is designed to run from finish webhook.

Jakub Drobník

Website Content Crawler

rupom888/website-content-crawler

Syed Rupom

Web Crawler

rigelbytes/webcrawler

This web crawler is designed to provide users with complete flexibility by allowing them to use their **own proxies**. The scraper collects all pages from the website and returns extracts the **MetaData**, **Title**, and **Content** of the page in MarkDown.

Rigel Bytes

Bandcamp Crawler

service-paradis/bandcamp-crawler

The Bandcamp.com crawler is a web scraping tool that allows you to extract data from the Bandcamp music platform. With this crawler, you can get information about albums, tracks, and much more. The crawler is built on top of Apify SDK, and you can run it both on the Apify platform and locally.

Alexandre Paradis

Kijiji Crawler

service-paradis/kijiji-crawler

The Kijiji crawler is a web scraping tool that allows you to extract data from the Kijiji selling platform. With this crawler, you can get information search results and local advertisement details.

Alexandre Paradis

AI Crawler Policy Auditor

junipr/ai-crawler-policy-auditor

Audit robots and AI crawler policy signals for AI crawler access, blocking, and site-readiness.

junipr

AI Website Content Crawler

ilborso/ai-website-content-crawler

A super fast website crawler for Agentic AI integration

Fabio Borsotti

5.0

Google Search SERP Crawler

radiant_martian/google-search-serp-crawler

This is a Google Search crawler with comprehensive information categorized for your AI agent or RPA use.

Stephen

Google Maps Crawler

netleo/google-maps-crawler

Google Maps Crawler extracts data about places and reviews from Google Maps. The actor can be used to find related places and reviews for a given starting place.

netleo

104

1.9