Legacy PhantomJS Crawler

Pricing

Pay per usage

Try for free

Go to Apify Store

Legacy PhantomJS Crawler

Try for free

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Pricing

Pay per usage

Rating

5.0

(6)

Developer

Apify

Maintained by Apify

Actor stats

Bookmarked

837

Total users

Monthly active users

2 months ago

Last modified

Categories

Developer tools

Open source

You can access the Legacy PhantomJS Crawler programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

$echo '{
<  "startUrls": [
<    {
<      "key": "START",
<      "value": "https://www.example.com/"
<    }
<  ],
<  "crawlPurls": [
<    {
<      "key": "MY_LABEL",
<      "value": "https://www.example.com/[.*]"
<    }
<  ],
<  "clickableElementsSelector": "a:not([rel=nofollow])",
<  "pageFunction": "function pageFunction(context) {\\n    // called on every page the crawler visits, use it to extract data from it\\n    var $ = context.jQuery;\\n    var result = {\\n        title: $('\''title'\'').text(),\\n        myValue: $('\''TODO'\'').text()\\n    };\\n    return result;\\n}\\n",
<  "interceptRequest": "function interceptRequest(context, newRequest) {\\n    // called whenever the crawler finds a link to a new page,\\n    // use it to override default behavior\\n    return newRequest;\\n}\\n"
<}' |
<apify call apify/legacy-phantomjs-crawler --silent --output-dataset

Legacy PhantomJS Crawler - Crawl websites, extract data API through CLI

The Apify CLI is the official tool that allows you to use Legacy PhantomJS Crawler locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using NPM:

$npm install -g apify-cli

Other API clients include:

Legacy PhantomJS Crawler API in Python

Legacy PhantomJS Crawler API in JavaScript

Legacy PhantomJS Crawler OpenAPI definition

Legacy PhantomJS Crawler API

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

3.6K

4.9

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

10K

4.7

Send Legacy PhantomJS Crawler Results

drobnikj/send-crawler-results

This actor downloads results from Legacy PhantomJS Crawler task and sends them to email as attachments. It is designed to run from finish webhook.

Jakub Drobník

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

11K

4.9

Vanilla JS Scraper

mstephen190/vanilla-js-scraper

Scrape the web using familiar JavaScript methods! Crawls websites using raw HTTP requests, parses the HTML with the JSDOM package, and extracts data from the pages using Node.js code. Supports both recursive crawling and lists of URLs. This actor is a non jQuery alternative to CheerioScraper.

Matthias Stephens

497

Example Code Runner (Playwright)

apify/example-code-runner-playwright

Generic Actor to run code examples from the documentation via "Run on Apify" links.

Apify

1.9K

4.6

SuperScraper API

apify/super-scraper-api

Generic REST API for scraping websites: send a URL and get back HTML. This Actor is a drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

Apify

809

4.1

URL Redirects

manishrc/url-redirect

Actor that takes a list of URLs and provides a list of loaded URLs after redirects

Manish Chiniwalar

360

Simple HTTP Status Code Checker

onescales/simple-http-status-code-checker

This Apify Actor allows you to check in bulk HTTP status codes and redirects for a list of URL's. It's a useful tool for SEO audits, website maintenance, and link checking.

One Scales

182

5.0

HTTP Status Codes and URL Checker

antonio_espresso/website-status-code-crawler

A HTTP Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizing technical SEO.