View all ideas

scrapy cloud runner.png

Scrapy Cloud Runner

Claim as developed

Status

Open to develop

Categories

Developer tools

Automation

Integrations

Submitted

October 19, 2025

Run Scrapy spiders in the cloud via Apify.

Host your Scrapy spiders written in Python on the Apify platform. Automate, schedule, and run your web scrapers and crawlers directly in the Console and integrate these APIs with other services and platforms to make your scraping and crawling more efficient.

This is just an idea. You’re free to adapt it, expand on it, or take it in a completely different direction. Treat it as inspiration, not as rules, endorsement, or guidance.

Actors in Store

Website Content Crawler avatar

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

User avatar

Apify

83K

4.6

Web Scraper avatar

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

User avatar

Apify

102K

3.9

Cheerio Scraper avatar

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

User avatar

Apify

11K

4.9

🔥 LinkedIn Jobs Scraper avatar

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

User avatar

Bebity

17K

4.5

Twitter (X.com) Scraper Unlimited: No Limits avatar

Twitter (X.com) Scraper Unlimited: No Limits

apidojo/twitter-scraper-lite

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.

User avatar

API Dojo

12K

2.9

Youtube Video Downloader avatar

Youtube Video Downloader

epctex/youtube-video-downloader

Effortlessly download YouTube videos of your preferred quality with our user-friendly Video Downloader. Try it now!

User avatar

epctex

2K

3.8

Linkedin Profile Posts Scraper [NO COOKIES] avatar

Linkedin Profile Posts Scraper [NO COOKIES]

apimaestro/linkedin-profile-posts

Scrape LinkedIn posts data for a given LinkedIn profile including post content, reactions, comments count, and media attachments

User avatar

API Maestro

9.4K

4.7

Puppeteer Scraper avatar

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

User avatar

Apify

10K

5.0

Google Maps Scraper avatar

Google Maps Scraper

rigelbytes/google-maps-scraper

Scrape UNLIMITED business data from Google Maps for just $45/month! Extract names, addresses, reviews, ratings, and more. Perfect for market research, lead generation, and competitor analysis. Easy to use, proxy-supported, and highly customizable. Start scraping smarter today!

User avatar

Rigel Bytes

300

Instagram Scraper avatar

Instagram Scraper

devil_port369-owner/instagram-scraper

Scrape Instagram user's profile details along with Email/Phone details.

User avatar

DataFusionX

1.8K

5.0