You can access the Scrapy Cloud Runner programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "spiderName": "page_meta",
10    "startUrls": [{ "url": "https://apify.com" }],
11    "spiderArgs": [{
12            "key": "category",
13            "value": "books",
14        }],
15}
16
17# Run the Actor and wait for it to finish
18run = client.actor("solutionssmart/scrapy-cloud-runner").call(run_input=run_input)
19
20# Fetch and print Actor results from the run's dataset (if there are any)
21print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
22for item in client.dataset(run["defaultDatasetId"]).iterate_items():
23    print(item)
24
25# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Scrapy Cloud Runner – Run Python Scrapy Spiders on Apify API in Python

The Apify API client for Python is the official library that allows you to use Scrapy Cloud Runner API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Scrapy Cloud Runner API in JavaScript

Scrapy Cloud Runner API through CLI

Scrapy Cloud Runner OpenAPI definition

Scrapy Cloud Runner API

AI Search Visibility Tracker — ChatGPT, Perplexity, Gemini

highbrow_fame/ai-search-visibility-tracker

Track brand citations in ChatGPT, Perplexity, Gemini, Google AI Overviews. Multilingual (24 languages incl. Hungarian, German, French, Polish, Czech). Bring-your-own-key — start FREE with Gemini's free tier. Daily diff. Pay-per-query, no monthly minimums. Cheapest GEO/AEO tracker on Apify.

yestrue

Train Your Local LLM for Business & Finance - DataPro

omissive_aurora/train-your-local-llm-for-business-finance---datapro

Train your local LLM for business and finance with Ultimate DataPro. Scrapes live stock prices, SEC EDGAR filings, options chains, and financial news - then auto-builds Alpaca/ShareGPT fine-tuning datasets. Export as JSONL, CSV, or Parquet. Push to HuggingFace Hub.

d.leigh hunte

Cybersecurity Intelligence Directory Scraper

jonfr0/cybersecurity-intelligence-scraper

Scrapes the Cybersecurity Intelligence Supplier Directory (cybersecurityintelligence.com) for company profiles including name, website, description, location, phone, and category tags.

Jon Froemming

Sales Navigator Scraper By Filters

bestscrapers/sales-navigator-scraper-by-filters

Find and scrape LinkedIn Sales Navigator leads with advanced filters.

Linkedin Scrapers

365

s1jobs.com scraper

memo23/s1jobs-scraper

Scrape Scottish job postings (all sectors) from s1jobs.com — title, salary, employer, location, real lat/lng coordinates, posted/closing dates, full description, structured skills, and the actual recruiter apply URL or apply email. Works with any listing or vacancy URL. JSON or CSV out.

Muhamed Didovic

Shopify Scraper Pro

crawlerbros/shopify-scraper-pro

Scrape any Shopify store(s) at scale: products, collections, search, on-sale tracking, multi-store batches. Filters: price/vendor/type/tags/title/sale/availability/date. Multi-endpoint fallback. HTTP-only, no auth, no proxy.

Crawler Bros

5.0

(21)

Bilibili Scraper - Chinese Video Intelligence

zhorex/bilibili-scraper

Extract Chinese Gen-Z video sentiment, danmaku reactions, and creator analytics from Bilibili (哔哩哔哩) — China's largest video platform with 300M+ users. Built for AI training, Chinese consumer equity research, and brand monitoring. Danmaku/coins/favorites included. No login required.

Sami

All-in one Linkedin Scraper

get-leads/linkedin-scraper

LinkedIn scraper — 8 modes: Profiles, Companies, Jobs, Posts, Search, Search Profiles, Profile Complete, Company Employees. Premium residential proxy (~95% success rate) + email discovery (11 patterns + Hunter.io). From $1/1K — up to 75% cheaper. MCP-ready for AI agents.

Japi Cricket

522

Facebook & Instagram Ad Library Scraper [NO LOGIN] ✅

unseenuser/meta-ads

Extract every active ad across Meta - Facebook and Instagram. Pull full creatives, copy, CTAs, run dates, and EU spend/impression data. No Meta account, no Marketing API, no developer app required. Built for growth marketers, agencies, and e-commerce brands.

Unseen User

5.0

(3)

🧩 Shopify Apps Spy + Product Scraper

kazkn/shopify-scraper-apps-spy

Detect which apps any Shopify store has installed (Klaviyo, Recharge, Yotpo, Privy + 30 more). Plus full product catalog & reviews. No login. 5x cheaper.

KazKN

E-Commerce Product Description Rewriter

trovevault/ecommerce-product-description-rewriter

Scrapes product descriptions from any e-commerce URL, grades them against SEO best practices (0–100), then rewrites them with AI to eliminate duplicate content penalties and improve search rankings.