Run Scrapy spiders on Apify

Reliable cloud infrastructure for your Scrapy project. Run, monitor, schedule, and scale your spiders in the cloud.

Easy start

From Scrapy spider to Apify Actor

Deploy your Scrapy code in the cloud with just a few commands.

1# Install Apify CLI
2brew install apify-cli
3
4# Create Apify Actor from your Scrapy spider
5cd your-scrapy-project
6apify init
7
8# Deploy it to Apify
9apify login
10apify push

Full support for Scrapy

We fully support Scrapy spiders as they are. Take advantage of the Apify platform's features without having to modify your Scrapy spider a bit.

Monetize your spiders

Join hundreds of developers who publish their web scrapers as paid Actors on Apify Store, find users and get paid.

Learn more

Frequently asked questions

Yes, to access all the platform features you would need to get an account using your email. You can explore our platform's capabilities for free with our Free plan or choose a more extensive plan for your spiders.

How much money can I make from publishing my spiders on Apify?

You can make anything from a few bucks to a hundreds of dollars per month. The amount of money you can make from hosting spiders on the Apify platform varies based on factors like the complexity of your Actors and the demand for the data they provide.

Many developers earn passive income by sharing their Actors on the Apify Store, but the exact earnings depend on usage and user subscriptions.

In which format can I export scraped data from the platform?

The datasets in the output are available in multiple formats, including JSON, XML, CSV, HTML, and RSS. You can download your data, export it using an API or plug it into other apps.

Can I integrate my spider with other apps?

Yes. Your Scrapy spider can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. You can integrate with Make, Zapier, Slack, LangChain, Airbyte, GitHub, Google Sheets, Google Drive, and more. Or you can use webhooks to carry out an action whenever an event occurs, e.g. get a notification whenever your new Actor successfully finishes a run.

Demo

Running Scrapy spider on Apify

Check out the video of running a spider on the Apify platform using our CLI.

Apify video

Got feedback?

Please feel free to contact us at python@apify.com