Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

47.4k

4.6

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

90.7k

4.4

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

21.3k

4.5

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

32.3k

4.5

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

7.4k

4.7

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

9.8k

4.4

Instagram Comments Scraper

apify/instagram-comment-scraper

Scrape Instagram comments from posts or reels. Just add one or more Instagram post URLs to get comment text, post IDs, position, timestamp, owner ids, usernames, profile pics, and URLs. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

13.1k

4.1

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

9.7k

4.8

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add one or more Instagram usernames and extract number of followers&follows, URLs, bio, posts, likes, counts, related profiles, captions, highlight reels. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

49.2k

4.5

Instagram Hashtag Scraper

apify/instagram-hashtag-scraper

Scrape Instagram hashtags data. Just add one or more hashtags and extract posts, images, URLs, comments, likes, users, locations, timestamps, and more. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

22.1k

4.5

Web Scraper

apify/web-scraper

Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

81.6k

4.5

Facebook Ads Scraper

apify/facebook-ads-scraper

Extract advertising data from one or multiple Facebook Pages. Get page details, reach estimates, publisher platforms, report count, number of impressions, ad IDs, timestamps, and more. Download Facebook ads data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.3k

4.5

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

57.7k

4.8

Facebook Pages Scraper

apify/facebook-pages-scraper

Extract basic data from multiple Facebook Pages or Profiles. Extract Facebook page details, website, email, address, messenger, likes, followers, rating, ad running status, and other public data. Export scraped data, schedule scraper via API, integrate with other tools or AI workflows.

Apify

22.4k

4.1

Instagram API Scraper

apify/instagram-api-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos without login. Supports search keywords and URL lists. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

Apify

4k

4.6

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

6.5k

5.0

Facebook Reviews Scraper

apify/facebook-reviews-scraper

Extract data from hundreds of Facebook reviews from one or multiple Facebook pages. Get review text, timestamp, review URL, likes and comments count and basic reviewer info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

874

4.5

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape data from Instagram reels. Just add one or more Instagram usernames and get your data in seconds including hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

14.7k

4.6

Facebook Events Scraper

apify/facebook-events-scraper

Facebook Events Scraper extracts data such as event name, location, description or number of users who are interested. You can use URLs of specific events or come up with search queries and explore pretty much unlimited number of events. Search queries can be combined with various search filters.

Apify

1.2k

4.3

Facebook Photos Scraper

apify/facebook-photos-scraper

Extract data from one or multiple Facebook images. Get image ID, Facebook photo URL, image URL, OCR text, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

1.4k

4.8

Instagram Mentions Scraper

apify/instagram-tagged-scraper

Extract data from tagged posts and mentions on Instagram. Just add one or more Instagram usernames and get post text, hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

3.2k

4.4

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

4.2k

4.1

Facebook Reels Video Scraper

apify/facebook-reels-scraper

Extract data from hundreds of Facebook reels from one or multiple Facebook pages and profiles. Get reel URL, text, page or profile URL, timestamp, number of plays and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

423

2.9

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

5.0

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants, RAG pipelines, or AI agents, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages, and returns their content as Markdown for further processing by an LLM. It can also scrape individual URLs. Supports Model Context Protocol (MCP).

Apify

2.1k

4.4

Facebook page contact info Scraper

apify/facebook-page-contact-information

Get Facebook pages addresses, email, likes, website, check-ins, and phone information

Apify

2.9k

4.7

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

1.3k

4.3

Facebook Search Scraper

apify/facebook-search-scraper

Extract Facebook search data from pages that match your search query. Get page URL, address, email, website, check-ins, creation date, ad status, category, follower count, messenger link. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

757

4.5

Website Screenshot Generator

apify/screenshot-url

Create a screenshot of a website based on a specified URL. The screenshot is stored as the output in a key-value store. It can be used to monitor web changes regularly after setting up the scheduler.

Apify

3.4k

4.4

Facebook page posts checker

apify/facebook-page-posts-checker

Facebook page checker extracts posts until several years from past, reviews and page details. Groups added as beta, less posts expected but with better details.

Apify

683

4.3

Monitoring Reporter Dashboard

apify/monitoring-reporter-dashboard

The monitoring reporter dashboard is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

71

4.8

Facebook Hashtag Scraper

apify/facebook-hashtag-scraper

Extract data from hundreds of Facebook posts using one or multiple hashtags. Get post text&URL, time of posting, basic poster info, image&video URLs, OCR text, likes, comments and shares count, and more. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

3.8k

4.8

Facebook URL to ID

apify/facebook-url-to-id

Scraping any Facebook URL as data object with internal Facebook ID and metadata if-when available.

Apify

2.3k

4.5

Instagram Hashtag Stats

apify/instagram-hashtag-stats

Scrape Instagram hashtags statistics the fast and easy way. Just add one or more hashtags and the scraper will extract number of posts for give hashtag, top posts and latest posts.

Apify

1k

4.5

Pinecone Integration

apify/pinecone-integration

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Apify

344

4.6

Facebook Marketplace Scraper

apify/facebook-marketplace-scraper

Extract data from one or multiple Facebook Marketplace listings. Scrape data on apartments, whole categories, items for sale, prices, location and sellers. Export scraped data in JSON, CSV, and Excel, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

809

3.9

🧲 Social Media Leads Analyzer

apify/social-media-leads-analyzer

Add a website and extract emails, phone numbers, and social media details. Use this lead scraper to extract basic social media profile data from 8 platforms. Export results in JSON, CSV, HTML, use APIs, schedule runs, build integrations, and more.

Apify

297

4.3

Facebook Video Search Scraper

apify/facebook-video-search-scraper

Extract Facebook data from videos that match your search query. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

78

4.3

Quick Instagram Posts Checker

apify/quick-instagram-posts-checker

Fast Instagram stats (for profiles and post only) for bulk tracking and analytics

Apify

1.3k

4.8

Example Code Runner (Puppeteer)

apify/example-code-runner-puppeteer

Generic Actor to run code examples from the documentation via "Run on Apify" links.

Apify

517

4.3

Facebook Followers & Following Scraper

apify/facebook-followers-following-scraper

Extract data from Facebook pages and profiles about its followers and profiles it follows. Just enter the URL, and you'll get data such as follow type, profile's URL, image, title, and subtitle. You can integrate your workflow with tools such as Google Drive, Zapier, Make and much more.

Apify

1.2k

4.9

Meta Threads Profile Scraper

apify/threads-profile-api-scraper

Scrape Threads profile info. Add one or more Threads usernames and extract number of followers, bio, profile details, URLs, picture URL, full name, username and more. Download structured data in JSON, CSV, XML, Excel, and HTML to use in applications and reports.

Apify

478

4.6

Monitoring Runner

apify/monitoring-runner

The monitoring runner is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

116

4.5

Example Secret Input

apify/example-secret-input

This Apify actor showcases how to use secret fields in the actor input.

Apify

25

4.7

PGVector Integration

apify/pgvector-integration

This integration transfers data from Apify Actors to a Postgres SQL database (with PGVector extension).

Apify

8

4.6

Weaviate Integration

apify/weaviate-integration

This integration transfers data from Apify Actors to a Weaviate and is a good starting point for a question-answering, search, or RAG use case.

Apify

4

4.7

Instagram Search Scraper

apify/instagram-search-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos without login. Supports search keywords and URL lists. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

Apify

815

4.3

Social Media Hashtag Research

apify/social-media-hashtag-research

Extract information about posts across social media with the same hashtag. Get details from Instagram, YouTube, TikTok, and Facebook about posts’ URLs, captions, timestamps, likes, dislikes, views and comments count, and basic profile info. You can download your data in JSON, CSV, Excel, and more.

Apify

1k

4.1

Example Puppeteer

apify/example-puppeteer

Example showing how to use headless Chromium with Puppeteer to open a web page, determine its dimensions, save a screenshot, and print the page to PDF. This actor must use images with Puppeteer (Node.js 8 + Puppeteer on Debian).

Apify

380

4.6

Chroma Integration

apify/chroma-integration

This integration transfers data from Apify Actors to a Chroma and is a good starting point for a question-answering, search, or RAG use case.

Apify

1

4.5

Monitoring Checker Stats

apify/monitoring-checker-stats

The monitoring checker stats is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

68

4.8

Send Email

apify/send-mail

The actor automatically sends an email to a specific address. This actor is useful for notifications and reporting. With only 3 lines of JavaScript code, you'll be on top of your scraping actors and never miss important results or issues.

Apify

2.8k

4.7

AI Web Agent

apify/ai-web-agent

Use natural language prompts to browse the web, click on elements, fill and submit forms, extract data, and take screenshots using the OpenAI API.

Apify

1.2k

4.2

Actors MCP Server

apify/actors-mcp-server

Connect Apify Actors to AI applications (AI Agents) using Anthropic's Model Context Protocol (MCP). This MCP server provides integration of any Apify Actor through the MCP framework.

Apify

819

4.4

SuperScraper API

apify/super-scraper-api

Generic REST API for scraping websites: send a URL and get back HTML. This Actor is a drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

Apify

639

4.2

Example Process Crawl Results

apify/example-process-crawl-results

Iterates through all results from a crawler run and count them. Needs to be called from the crawler's finish webhook by adding an URL to finish the webhook of your crawler. Use this actor as a starting point to develop custom post-processing of data from the crawler.

Apify

17

4.5

Monitoring Checker Run Status

apify/monitoring-checker-run-status

The monitoring checker run status is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

81

4.8

Facebook Likes Scraper

apify/facebook-likes-scraper

Extract Facebook likes data from one or multiple Facebook posts. Get post URL, reaction type (like, love, care, sad, angry, laugh), and basic liker info such as Facebook name and profile URL. Download the data in JSON, CSV Excel and use it in apps, spreadsheets, and reports.

Apify

1.9k

4.5

Example Call

apify/example-call

A simple example showing how to call another actor from an actor. Note that this actor doesn't accept any input and doesn't generate any output.

Apify

30

4.5

Example Counter

apify/example-counter

This actor simply counts up from one. In each run it prints one number. Its state (counter position) is stored in a named key-value store. The name of the store is example-counter and you can find in Apify app under Storages.

Apify

9

4.7

Example Web Server

apify/example-web-server

This example demonstrates how to use web server in actor as communication channel with outer world. Read more at Apify docs https://docs.apify.com/actors/running#container-web-server

Apify

45

4.0

Hello World Example

apify/hello-world

The simplest Actor you will see today. It takes a greeting message on input, prints it, and stores a new message as the output. That's all.

Apify

2.4k

4.8

Proxy Test

apify/proxy-test

This actor simply tests given array of URLs against selected proxy URLs or Apify proxy groups.

Apify

435

4.7

Example Live View

apify/example-live-view

This example demonstrates how to use web server in actor as communication channel with outer world. Read more at Apify docs https://docs.apify.com/actors/running#container-web-server

Apify

88

5.0

Example Php

apify/example-php

Example act using PHP as the main language.

Apify

72

4.8

Image Difference Generator

apify/image-diff

Returns a difference of two given images as JPEG or PNG image.

Apify

126

4.0

Page Scraping Analyzer

apify/page-analyzer

Performs analysis of a webpage to figure out the best way how to scrape its data. Provide a URL and data points to find and get back a detailed dashboard showing how the data can be scraped. Works with initial and rendered HTML, JavaScript variables and dynamically loaded data.

Apify

1.3k

4.4

Quick Start for Actor Creation

apify/quick-start

Contains a basic boilerplate of an Apify actor with Node.js source code and a custom Dockerfile. The purpose of this actor is to help you get started quickly to create your own actors.

Apify

53

4.0

Example using GitHub Gist

apify/example-github-gist

Example of an Apify actor with source code hosted in a GitHub Gist. For example, this is useful if you want to have public code examples accompanied by a working API that anyone can try straight away.

Apify

3

5.0

Example Selenium

apify/example-selenium

Example of loading a web page in headless Chrome using Selenium Webdriver.

Apify

280

4.7

Monitoring Reporter Mail

apify/monitoring-reporter-mail

The Monitoring reporter mail is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

53

4.3

Monitoring Reporter Slack

apify/monitoring-reporter-slack

The Monitoring reporter slack is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

31

4.3

Monitoring Checker Duplication

apify/monitoring-checker-duplication

The Monitoring checker duplication is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

15

4.8

Apify Email Signature Generator

apify/email-signature-generator

Generates a standardized email signature for Apify team members, using provided details.

Apify

95

4.5

JSDOM Scraper

apify/jsdom-scraper

Parses the HTML using the JSDOM library, providing the same DOM API as browsers do (e.g. `window`). It is able to process client-side JavaScript without using a real browser. Performance-wise, it stands somewhere between the Cheerio Scraper and the browser scrapers.

Apify

91

4.3

Python Example

apify/python-example

Example Actor written in Python, showing how to read the Actor input and push to the Actor's default dataset.

Apify

102

Generates READMEs scrapers using ChatGPT, based on an Apify-approved template.

Apify

18

4.6

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

816

4.4

Example Code Runner (Cheerio)

apify/example-code-runner-cheerio

Generic Actor to run code examples from the documentation via "Run on Apify" links.

Apify

958

4.0

Qdrant Integration

apify/qdrant-integration

Transfer data from Apify Actors to a Qdrant vector database.

Apify

36

4.5

Export Instagram Comments and Posts

apify/export-instagram-comments-posts

This unique tool allows you to scrape Instagram posts and its comments in one run. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

985

4.6

OpenSearch Integration

apify/opensearch-integration

Transfer data from Apify Actors to Amazon OpenSearch Service. This Actor is a good starting point for building question-answering systems, search functionality, or Retrieval-Augmented Generation (RAG) use cases.

Apify

3

4.4

Actor Logo Light Fixture Control

Apify

2

Firestore Import

apify/firestore-import

Seamlessly import data from Apify datasets into Firebase Firestore database. This integration allows full control over document IDs, conflict resolution (overwrite, merge, skip), and data transformation using a custom JavaScript function.

Apify

2

5.0

Example Code Runner (Python)

apify/example-code-runner-python

Python Actor to run code examples from the documentation via "Run on Apify" links.

Apify

120

Algolia Website Indexer

apify/algolia-website-indexer

The Indexer crawls recursively a website using the Puppeteer browser (headless Chrome) and indexes the selected pages to the Algolia index.

Apify

20

4.5

Example Code Runner (Playwright)

apify/example-code-runner-playwright

Generic Actor to run code examples from the documentation via "Run on Apify" links.

Apify

1.1k

4.7

Facebook Games Scraper

apify/facebook-games-scraper

Scrape and download Facebook Games names and live streams; followers count, concurrent viewer count, URL, and more. Get data from Facebook Games simply using one search query. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

23

4.6

Instagram Topic Scraper

apify/instagram-topic-scraper

Scrape and download Instagram posts based on the topic. Just add one or more Instagram topic URLs. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

16

Monitoring

apify/monitoring

This actor monitors your actors' statuses, validates their datasets' data, and displays useful information in an interactive dashboard. And if something happens, you'll get notified via email or Slack.

Apify

159

4.4

Monitoring Teardown

apify/monitoring-teardown

The monitoring teardown is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

75

5.0

Milvus Integration

apify/milvus-integration

This integration transfers data from Apify Actors to a Milvus/Zilliz database and is a good starting point for a question-answering, search, or RAG use case.

Apify

8

4.5

Convert HTML string to A4 PDF.

Apify

52

4.3

Monitoring Checker Schema

apify/monitoring-checker-schema

The monitoring checker schema is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

29

4.8

Camoufox Scraper

apify/camoufox-scraper

Crawls websites with stealthy Camoufox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

3

S3 Uploader

apify/s3-uploader

Upload data from an Apify dataset to an Amazon S3 bucket. Providing various filters and transformation options, this Actor allows precise control over data structure, formatting, and upload settings to ensure seamless integration into your data pipeline.

Apify

1