You can access the Crawler Orchestra programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

$echo '{}' |
<apify call juansgaitan/crawler-orchestra --silent --output-dataset

Crawler Orchestra API through CLI

The Apify CLI is the official tool that allows you to use Crawler Orchestra locally, providing convenience functions and automatic retries on errors.

Install the Apify CLI

$npm i -g apify-cli
$apify login

Other API clients include:

Crawler Orchestra API in Python

Crawler Orchestra API in JavaScript

Crawler Orchestra OpenAPI definition

Crawler Orchestra API

Example Process Crawl Results

apify/example-process-crawl-results

Iterates through all results from a crawler run and count them. Needs to be called from the crawler's finish webhook by adding an URL to finish the webhook of your crawler. Use this actor as a starting point to develop custom post-processing of data from the crawler.

Apify

4.5

Page Visits Counter

juansgaitan/counter

Counts the current page visits inside an act.

Juan Gaitán Villamizar

Ulta Review Crawler

webscrapewizard/my-actor

WebScraperWizard

MySQL Insert

petr_cermak/MySQL-insert

This act takes a crawler execution and inserts it's results into a remote MySQL database.

Petr Cermak

PostgreSQL Insert

petr_cermak/PostgreSQL-insert

This act takes a crawler execution and inserts it's results into a remote PostgreSQL database.

Petr Cermak

Bandcamp Crawler

service-paradis/bandcamp-crawler

The Bandcamp.com crawler is a web scraping tool that allows you to extract data from the Bandcamp music platform. With this crawler, you can get information about albums, tracks, and much more. The crawler is built on top of Apify SDK, and you can run it both on the Apify platform and locally.

Alexandre Paradis

Crawler Results Deduplicate

petr_cermak/crawler-results-deduplicate

This acts takes crawler execution results and deduplicates them.

Petr Cermak

Kijiji Crawler

service-paradis/kijiji-crawler

The Kijiji crawler is a web scraping tool that allows you to extract data from the Kijiji selling platform. With this crawler, you can get information search results and local advertisement details.

Alexandre Paradis