Deprecated

Pricing

Pay per usage

See alternative Actors

Go to Store

Scrapy Executor

Deprecated

See alternative Actors

Developed by

Apify

Run Scrapy spiders written in Python on the Apify platform.

0.0 (0)

Pricing

Pay per usage

Total users

190

Monthly users

Runs succeeded

>99%

Last modified

2 years ago

Developer tools

Open source

Scrapy spider

scrapyCodestringRequired

Paste your scrapy spider here. If your spider is separated into multiple files, see Readme for instructions.

Proxy

proxyConfigobjectOptional

Proxy servers let you bypass website protections, avoid IP address blocking and view content for other countries. Try to use the proxy if you are experiencing timeout errors.

Default value of this property is {}

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

81k

4.5

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

1.3k

4.3

Best Linkedin Jobs Scrapy

lads.yc/easy-linkedin-jobs-scrapy

Easy way to get jobs and details

YC W

Scrapy Books Example

vdusek/scrapy-books-example

Example of Python Scrapy project. It scrapes book data from https://books.toscrape.com/.

Vlada Dusek

🔥Apollo Scraper - Scrape upto 50k Leads

code_crafter/apollo-io-scraper

Scrape up to 50,000 leads per search URL.

Code Pioneer

23.4k

3.8

Instant web data scraper - Scrape any website

curious_coder/instant-web-scraper

Scrape any public and private website data by providing just URL and optionally cookies and proxy information. This scraper is similar to instant data scraper but runs on cloud and can be used as API too!

Curious Coder

1.1k

3.9

App Store Data Extractor - Scrape reviews too!

epctex/appstore-scraper

Discover a vast collection of apps, movies, podcasts, reviews, and more on iTunes and the App Store. Extract comprehensive data including images, ISBN, author, description, title, language, user ratings, and reviews focused on countries without limitations. Unlimited and extremely fast!

epctex

547

1.0

Twitter Tweet Reply Scrape | $0.25/1K Tweets | Pay-Per Result

kaitoeasyapi/twitter-reply

🚀 Instantly scrape Twitter/X replies & conversations with Pay only $0.25/1K tweets. Get complete reply chains, user info & engagement metrics. Perfect for sentiment analysis, market research & competitor tracking. 100% reliable data extraction, no API needed!

Kaito Easy API

160

5.0

Scrape Emails And Social Media Links With Just a Query

lead.gen.labs/scrape-emails-and-social-media-links-with-just-a-query

Get Emails And Social Media Links With Just a Query !!!!! The actor will take a query and some parameter as input and scrape contact details with just a query. ACTOR IS FREE FOR LIMITED TIME.

LeadGen Labs

140

LinkedIn Scrape: Profiles, Posts, Messages, Reactions, Comments

agent-x/linkedin-multi-functional-scraper

Scrape & Collect profiles, companies, posts, messages, reactions, and comments efficiently. Save 84% on costs while getting more functionality. Perfect for researchers, recruiters, sales teams, and marketers. Customizable, automated, and easy to integrate.

Agent-X

5.0

Scrape product data from any e-commerce site with a dataLayer

eloquent_mountain/scrape-product-data-from-any-e-commerce-site

Scrapes e-commerce product data from any (e-commerce) website that has a dataLayer object (mostly used in google analytics implementations). It returns all product data in multiple data formats. Also available as an API to integrate with your own or other products. Circumvents the Cookie wall.