Run Scrapy spiders on Apify

Reliable cloud infrastructure for your Scrapy project. Run, monitor, schedule, and scale your spiders in the cloud.

Easy start

From Scrapy spider to Apify Actor

Deploy your Scrapy code in the cloud with just a few commands.

1# Install Apify CLI
2brew install apify-cli
4# Create Apify Actor from your Scrapy spider
5cd your-scrapy-project
6apify init
8# Deploy it to Apify
9apify login
10apify push

Full support for Scrapy

We fully support Scrapy spiders as they are. Take advantage of the Apify platform's features without having to modify your Scrapy spider.

Monetize your spiders

Join hundreds of developers who publish their web scrapers as paid Actors on Apify Store, find users and get paid.


Running Scrapy spider on Apify

Check out the video of running a spider on the Apify platform using our CLI.

Apify video

Frequently asked questions

Yes, to access all the platform features you would need to get an account using your email. You can explore our platform's capabilities for free with our Free plan or choose a more extensive plan for your spiders.

How much money can I make from publishing my spiders on Apify?

Many developers earn passive income by sharing their Actors on the Apify Store, but the exact earnings depend on usage and user subscriptions. You can make anything from a few bucks to a hundreds of dollars per month. The amount of money you can make from hosting spiders on the Apify platform varies based on factors like the complexity of your Actors and the demand for the data they provide.

To give you a more specific answer, last month we paid out more than $100K in total to community Actors' developers. You can read about the journeys from two of our them - Caleb David or Tuğkan Cengiz.

In which format can I export scraped data from the platform?

The datasets in the output are available in multiple formats, including JSON, XML, CSV, HTML, and RSS. You can download your data, export it using an API or plug it into other apps.

Can I integrate my spider with other apps?

Yes. Your Scrapy spider can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. You can integrate with Make, Zapier, Slack, LangChain, Airbyte, GitHub, Google Sheets, Google Drive, and more. Or you can use webhooks to carry out an action whenever an event occurs, e.g. get a notification whenever your new Actor successfully finishes a run.

Can I use API to call my cloud web scraper?

Yes. You can start the scraper, start, create, delete tasks, run them synchronously, start builds, get logs, create webhooks, get datasets, monitor your Scrapy spider using an API. You can also access key-value stores, request queues and user data. API can be accessed with Python, Node.js, and directly with Endpoints.

Can I use Apify cloud to provide web scraping services?

Yes. You can do so by either republishing your Scrapy spider from Zyte to the Apify Store (See monetization process here) or by picking custom web scraping projects from our Discord.

From Discord, you can provide scraping services for requests coming to the specialized channel. You will be the one communicating with the customer, setting deadlines and deliverables for their case. From Store, your published Actor acts as a web scraping tool rather than web scraping service. You will be only responsible for its maintenance and improvements. However, even in this case you can provide web scraping as a service if potential users contact you with requests to customize your existing Actor or to build them a new one.

Got feedback?

Please feel free to contact us at