Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

28.8k

720

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

62.4k

595

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15.8k

198

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.8k

86

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

72.4k

248

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.5k

67

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

7.2k

83

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

21.7k

165

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add one or more Instagram usernames and extract number of followers&follows, URLs, bio, posts, likes, counts, related profiles, captions, highlight reels. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

39.2k

233

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.7k

71

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

51k

256

Instagram Hashtag Scraper

apify/instagram-hashtag-scraper

Scrape Instagram hashtags data. Just add one or more hashtags and extract posts, images, URLs, comments, likes, users, locations, timestamps, and more. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

18.9k

104

Facebook Pages Scraper

apify/facebook-pages-scraper

Facebook scraping tool to crawl and extract basic data from one or multiple Facebook Pages. Extract Facebook page name, page URL address, category, likes, check-ins, and other public data. Download data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

19.5k

74

Instagram API Scraper

apify/instagram-api-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos without login. Supports search keywords and URL lists. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

Apify

3k

39

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape data from Instagram reels. Just add one or more Instagram usernames and get your data in seconds including hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

4.8k

115

Facebook Events Scraper

apify/facebook-events-scraper

Facebook Events Scraper extracts data such as event name, location, description or number of users who are interested. You can use URLs of specific events or come up with search queries and explore pretty much unlimited number of events. Search queries can be combined with various search filters.

Apify

933

29

Facebook Ads Scraper

apify/facebook-ads-scraper

Extract advertising data from one or multiple Facebook Pages. Get page details, reach estimates, publisher platforms, report count, number of impressions, ad IDs, timestamps, and more. Download Facebook ads data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

5.5k

65

Instagram Hashtag Stats

apify/instagram-hashtag-stats

Scrape Instagram hashtags statistics the fast and easy way. Just add one or more hashtags and the scraper will extract number of posts for give hashtag, top posts and latest posts.

Apify

724

12

Facebook Reviews Scraper

apify/facebook-reviews-scraper

Extract data from hundreds of Facebook reviews from one or multiple Facebook pages. Get review text, timestamp, review URL, likes and comments count and basic reviewer info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

698

19

Instagram Comments Scraper

apify/instagram-comment-scraper

Scrape Instagram comments. Just add one or more Instagram post URLs to get comment text, post IDs, position, timestamp, owner ids, usernames, profile pics, and URLs. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

9.9k

67

Facebook Hashtag Scraper

apify/facebook-hashtag-scraper

Extract data from hundreds of Facebook posts using one or multiple hashtags. Get post text&URL, time of posting, basic poster info, image&video URLs, OCR text, likes, comments and shares count, and more. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

3.4k

23

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.2k

27

Facebook Photos Scraper

apify/facebook-photos-scraper

Extract data from one or multiple Facebook images. Get image ID, Facebook photo URL, image URL, OCR text, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

1.1k

9

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

21

Instagram Mentions Scraper

apify/instagram-tagged-scraper

Extract data from tagged posts and mentions on Instagram. Just add one or more Instagram usernames and get post text, hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

2.4k

13

Facebook page posts checker

apify/facebook-page-posts-checker

Facebook page checker extracts posts until several years from past, reviews and page details. Groups added as beta, less posts expected but with better details.

Apify

647

14

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

881

19

Facebook page contact info Scraper

apify/facebook-page-contact-information

Get Facebook pages addresses, email, likes, website, check-ins, and phone information

Apify

2.4k

21

Monitoring Reporter Dashboard

apify/monitoring-reporter-dashboard

The monitoring reporter dashboard is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

69

10

Facebook URL to ID

apify/facebook-url-to-id

Scraping any Facebook URL as data object with internal Facebook ID and metadata if-when available.

Apify

2k

8

Website Screenshot Generator

apify/screenshot-url

Create a screenshot of a website based on a specified URL. The screenshot is stored as the output in a key-value store. It can be used to monitor web changes regularly after setting up the scheduler.

Apify

2.9k

48

RAG Web Browser

apify/rag-web-browser

Web browser for OpenAI Assistants API and RAG pipelines, similar to a web browser in ChatGPT. It queries Google Search, scrapes the top N pages from the results, and returns their cleaned content as Markdown for further processing by an LLM.

Apify

239

38

Meta Threads Profile Scraper

apify/threads-profile-api-scraper

Scrape Threads profile info. Add one or more Threads usernames and extract number of followers, bio, profile details, URLs, picture URL, full name, username and more. Download structured data in JSON, CSV, XML, Excel, and HTML to use in applications and reports.

Apify

318

9

SuperScraper API

apify/super-scraper-api

Generic REST API for scraping websites: send a URL and get back HTML. This Actor is a drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

Apify

499

28

Monitoring Runner

apify/monitoring-runner

The monitoring runner is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

115

14

Quick Instagram Posts Checker

apify/quick-instagram-posts-checker

Fast Instagram stats (for profiles and post only) for bulk tracking and analytics

Apify

1k

11

Pinecone Integration

apify/pinecone-integration

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Apify

116

18

Facebook Marketplace Scraper

apify/facebook-marketplace-scraper

Extract data from one or multiple Facebook Marketplace listings. Scrape data on apartments, whole categories, items for sale, prices, location and sellers. Export scraped data in JSON, CSV, and Excel, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

263

10

Monitoring Checker Run Status

apify/monitoring-checker-run-status

The monitoring checker run status is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

81

10

Social Media Hashtag Research

apify/social-media-hashtag-research

Extract information about posts across social media with the same hashtag. Get details from Instagram, YouTube, TikTok, and Facebook about posts’ URLs, captions, timestamps, likes, dislikes, views and comments count, and basic profile info. You can download your data in JSON, CSV, Excel, and more.

Apify

709

33

Monitoring Checker Stats

apify/monitoring-checker-stats

The monitoring checker stats is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

68

11

Send Email

apify/send-mail

The actor automatically sends an email to a specific address. This actor is useful for notifications and reporting. With only 3 lines of JavaScript code, you'll be on top of your scraping actors and never miss important results or issues.

Apify

2.6k

80

Facebook Reels Video Scraper

apify/facebook-reels-scraper

Extract data from hundreds of Facebook reels from one or multiple Facebook pages and profiles. Get reel URL, text, page or profile URL, timestamp, number of plays and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

97

6

Facebook Video Search Scraper

apify/facebook-video-search-scraper

Extract Facebook data from videos that match your search query. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

20

1

Monitoring Reporter Mail

apify/monitoring-reporter-mail

The Monitoring reporter mail is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

53

6

Monitoring Reporter Slack

apify/monitoring-reporter-slack

The Monitoring reporter slack is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

31

5

AI Web Agent

apify/ai-web-agent

Use natural language prompts to browse the web, click on elements, fill and submit forms, extract data, and take screenshots using the OpenAI API.

Apify

738

28

Facebook Followers & Following Scraper

apify/facebook-followers-following-scraper

Extract data from Facebook pages and profiles about its followers and profiles it follows. Just enter the URL, and you'll get data such as follow type, profile's URL, image, title, and subtitle. You can integrate your workflow with tools such as Google Drive, Zapier, Make and much more.

Apify

195

2

Qdrant Integration

apify/qdrant-integration

Transfer data from Apify Actors to a Qdrant vector database.

Apify

18

3

Instagram Search Scraper

apify/instagram-search-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos without login. Supports search keywords and URL lists. Download your data as HTML table, JSON, CSV, Excel, XML, and RSS feed.

Apify

229

11

Example Call

apify/example-call

A simple example showing how to call another actor from an actor. Note that this actor doesn't accept any input and doesn't generate any output.

Apify

27

3

Example Counter

apify/example-counter

This actor simply counts up from one. In each run it prints one number. Its state (counter position) is stored in a named key-value store. The name of the store is example-counter and you can find in Apify app under Storages.

Apify

12

5

Example Web Server

apify/example-web-server

This example demonstrates how to use web server in actor as communication channel with outer world. Read more at Apify docs https://docs.apify.com/actors/running#container-web-server

Apify

41

4

Hello World Example

apify/hello-world

The simplest Actor you will see today. It takes a greeting message on input, prints it, and stores a new message as the output. That's all.

Apify

2.3k

21

Proxy Test

apify/proxy-test

This actor simply tests given array of URLs against selected proxy URLs or Apify proxy groups.

Apify

396

4

Example Live View

apify/example-live-view

This example demonstrates how to use web server in actor as communication channel with outer world. Read more at Apify docs https://docs.apify.com/actors/running#container-web-server

Apify

75

3

Example Php

apify/example-php

Example act using PHP as the main language.

Apify

69

3

Image Difference Generator

apify/image-diff

Returns a difference of two given images as JPEG or PNG image.

Apify

113

4

Quick Start for Actor Creation

apify/quick-start

Contains a basic boilerplate of an Apify actor with Node.js source code and a custom Dockerfile. The purpose of this actor is to help you get started quickly to create your own actors.

Apify

44

4

Example Puppeteer

apify/example-puppeteer

Example showing how to use headless Chromium with Puppeteer to open a web page, determine its dimensions, save a screenshot, and print the page to PDF. This actor must use images with Puppeteer (Node.js 8 + Puppeteer on Debian).

Apify

354

6

Example using GitHub Gist

apify/example-github-gist

Example of an Apify actor with source code hosted in a GitHub Gist. For example, this is useful if you want to have public code examples accompanied by a working API that anyone can try straight away.

Apify

3

3

Example Selenium

apify/example-selenium

Example of loading a web page in headless Chrome using Selenium Webdriver.

Apify

256

2

Monitoring Checker Duplication

apify/monitoring-checker-duplication

The Monitoring checker duplication is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

15

3

Apify Email Signature Generator

apify/email-signature-generator

Generates a standardized email signature for Apify team members, using provided details.

Apify

86

20

JSDOM Scraper

apify/jsdom-scraper

Parses the HTML using the JSDOM library, providing the same DOM API as browsers do (e.g. `window`). It is able to process client-side JavaScript without using a real browser. Performance-wise, it stands somewhere between the Cheerio Scraper and the browser scrapers.

Apify

80

4

Python Example

apify/python-example

Example Actor written in Python, showing how to read the Actor input and push to the Actor's default dataset.

Apify

83

3

Facebook Likes Scraper

apify/facebook-likes-scraper

Extract Facebook likes data from one or multiple Facebook posts. Get post URL, reaction type (like, love, care, sad, angry, laugh), and basic liker info such as Facebook name and profile URL. Download the data in JSON, CSV Excel and use it in apps, spreadsheets, and reports.

Apify

1.3k

13

Generates READMEs scrapers using ChatGPT, based on an Apify-approved template.

Apify

15

4

Crawls websites using raw HTTP requests. It parses the HTML with the BeautifulSoup library and extracts data from the pages using Python code. Supports both recursive crawling and lists of URLs. This Actor is a Python alternative to Cheerio Scraper.

Apify

736

4

Example Code Runner (Playwright)

apify/example-code-runner-playwright

Generic Actor to run code examples from the documentation via "Run on Apify" links.

Apify

746

10

Example Code Runner (Cheerio)

apify/example-code-runner-cheerio

Generic Actor to run code examples from the documentation via "Run on Apify" links.

Apify

764

4

Example Code Runner (Puppeteer)

apify/example-code-runner-puppeteer

Generic Actor to run code examples from the documentation via "Run on Apify" links.

Apify

399

4

Facebook Games Scraper

apify/facebook-games-scraper

Scrape and download Facebook Games names and live streams; followers count, concurrent viewer count, URL, and more. Get data from Facebook Games simply using one search query. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

21

3

Milvus Integration

apify/milvus-integration

This integration transfers data from Apify Actors to a Milvus/Zilliz database and is a good starting point for a question-answering, search, or RAG use case.

Apify

5

1

Export Instagram Comments and Posts

apify/export-instagram-comments-posts

This unique tool allows you to scrape Instagram posts and its comments in one run. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

148

12

OpenSearch Integration

apify/opensearch-integration

Transfer data from Apify Actors to Amazon OpenSearch Service. This Actor is a good starting point for building question-answering systems, search functionality, or Retrieval-Augmented Generation (RAG) use cases.

Apify

3

1

Page Scraping Analyzer

apify/page-analyzer

Performs analysis of a webpage to figure out the best way how to scrape its data. Provide a URL and data points to find and get back a detailed dashboard showing how the data can be scraped. Works with initial and rendered HTML, JavaScript variables and dynamically loaded data.

Apify

1.2k

10

Algolia Website Indexer

apify/algolia-website-indexer

The Indexer crawls recursively a website using the Puppeteer browser (headless Chrome) and indexes the selected pages to the Algolia index.

Apify

20

2

Chroma Integration

apify/chroma-integration

This integration transfers data from Apify Actors to a Chroma and is a good starting point for a question-answering, search, or RAG use case.

Apify

1

0

Convert HTML string to A4 PDF.

Apify

22

2

🧲 Social Media Leads Analyzer

apify/social-media-leads-analyzer

Add a website and extract emails, phone numbers, and social media details. Use this lead scraper to extract basic social media profile data from 8 platforms. Export results in JSON, CSV, HTML, use APIs, schedule runs, build integrations, and more.

Apify

128

13

Monitoring Checker Schema

apify/monitoring-checker-schema

The monitoring checker schema is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

29

7

Example Process Crawl Results

apify/example-process-crawl-results

Iterates through all results from a crawler run and count them. Needs to be called from the crawler's finish webhook by adding an URL to finish the webhook of your crawler. Use this actor as a starting point to develop custom post-processing of data from the crawler.

Apify

17

5

Monitoring

apify/monitoring

This actor monitors your actors' statuses, validates their datasets' data, and displays useful information in an interactive dashboard. And if something happens, you'll get notified via email or Slack.

Apify

157

13

Monitoring Teardown

apify/monitoring-teardown

The monitoring teardown is a part of the Apify Monitoring Suite (apify/monitoring). See its readme for more information and how to use this.

Apify

74

7

Example Secret Input

apify/example-secret-input

This Apify actor showcases how to use secret fields in the actor input.

Apify

23

0

PGVector Integration

apify/pgvector-integration

This integration transfers data from Apify Actors to a Postgres SQL database (with PGVector extension).

Apify

6

1

Facebook Search Scraper

apify/facebook-search-scraper

Extract Facebook data from pages that match your search query. Get page URL, address, email, website, check-ins, creation date, ad status, category, follower count, messenger link, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

50

2

Weaviate Integration

apify/weaviate-integration

This integration transfers data from Apify Actors to a Weaviate and is a good starting point for a question-answering, search, or RAG use case.

Apify

3

1