# Social Page Scraper (Facebook & Instagram) (`xiphosuran_puzzle/social-page-scraper`) Actor Scrapes public Facebook and Instagram pages: page info, posts, images, captions, engagement metrics (reactions, shares, comments), and datetimes. - **URL**: https://apify.com/xiphosuran\_puzzle/social-page-scraper.md - **Developed by:** [Paul Jonathan Natividad](https://apify.com/xiphosuran_puzzle) (community) - **Categories:** Social media - **Stats:** 1 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README undefined # Actor input Schema ## `pageUrl` (type: `string`): URL of the Facebook or Instagram page to scrape. Examples: https://www.facebook.com/nasa or https://www.instagram.com/nasa ## `maxPosts` (type: `integer`): Maximum number of posts to scrape. Set to 0 for unlimited (not recommended — will scroll until end of feed). ## `postTypes` (type: `array`): Filter which post types to include. Select one or more. Leave empty or select 'all' to scrape everything. ## `scrapeComments` (type: `boolean`): Whether to open each post and scrape its comments. Significantly increases run time. ## `maxComments` (type: `integer`): Maximum number of comments to scrape per post (only used when scrapeComments is enabled). ## `cookies` (type: `array`): Provide your browser session cookies to unlock full feed access. Without cookies, Facebook/Instagram only show ~5-10 public posts. ━━━ HOW TO GET YOUR COOKIES ━━━ 🔹 Step 1: Open Chrome and log into Facebook (or Instagram) 🔹 Step 2: Press F12 to open Developer Tools 🔹 Step 3: Click the 'Application' tab at the top of DevTools (If you don't see it, click the >> arrows to find it) 🔹 Step 4: In the left sidebar, expand 'Cookies' and click on 'https://www.facebook.com' (or instagram.com) 🔹 Step 5: You'll see a table of cookies. Find and copy these: FOR FACEBOOK — you need 2 cookies: • c_user → your Facebook user ID (a number like 100012345678) • xs → your session token (a long string) FOR INSTAGRAM — you need 1 cookie: • sessionid → your session token (a long string) 🔹 Step 6: Paste them below in this format (see placeholder) ━━━ EASY METHOD: Cookie Editor Extension ━━━ 🔹 Install 'Cookie-Editor' browser extension: Chrome: https://chromewebstore.google.com/detail/cookie-editor/hlkenndednhfkekhgcdicdfddnkalmdm Firefox: https://addons.mozilla.org/en-US/firefox/addon/cookie-editor/ 🔹 Log into Facebook/Instagram, click the extension icon, click 'Export' (JSON format), and paste the result here. The actor will automatically pick out the cookies it needs. ━━━ IMPORTANT NOTES ━━━ • Cookies expire after a few days/weeks — you may need to refresh them • Never share your cookies with anyone — they give full access to your account • We recommend using a secondary/dummy account for scraping ## `proxyConfiguration` (type: `object`): Proxy settings. Residential proxies are strongly recommended for Facebook/Instagram — datacenter proxies are usually blocked. ## Actor input object example ```json { "pageUrl": "https://www.facebook.com/nasa", "maxPosts": 20, "postTypes": [ "all" ], "scrapeComments": false, "maxComments": 10, "cookies": [ { "name": "c_user", "value": "PASTE_YOUR_C_USER_VALUE_HERE" }, { "name": "xs", "value": "PASTE_YOUR_XS_VALUE_HERE" } ] } ```` # Actor output Schema ## `datasetOutput` (type: `string`): Single JSON object containing page info, filtered posts, and run metadata. ## `fullOutput` (type: `string`): Complete scrape result stored as OUTPUT in key-value store. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "cookies": [ { "name": "c_user", "value": "PASTE_YOUR_C_USER_VALUE_HERE" }, { "name": "xs", "value": "PASTE_YOUR_XS_VALUE_HERE" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("xiphosuran_puzzle/social-page-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "cookies": [ { "name": "c_user", "value": "PASTE_YOUR_C_USER_VALUE_HERE", }, { "name": "xs", "value": "PASTE_YOUR_XS_VALUE_HERE", }, ] } # Run the Actor and wait for it to finish run = client.actor("xiphosuran_puzzle/social-page-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "cookies": [ { "name": "c_user", "value": "PASTE_YOUR_C_USER_VALUE_HERE" }, { "name": "xs", "value": "PASTE_YOUR_XS_VALUE_HERE" } ] }' | apify call xiphosuran_puzzle/social-page-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=xiphosuran_puzzle/social-page-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Social Page Scraper (Facebook & Instagram)", "description": "Scrapes public Facebook and Instagram pages: page info, posts, images, captions, engagement metrics (reactions, shares, comments), and datetimes.", "version": "0.1", "x-build-id": "JGiQaVxZavaxuCsxb" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/xiphosuran_puzzle~social-page-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-xiphosuran_puzzle-social-page-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/xiphosuran_puzzle~social-page-scraper/runs": { "post": { "operationId": "runs-sync-xiphosuran_puzzle-social-page-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/xiphosuran_puzzle~social-page-scraper/run-sync": { "post": { "operationId": "run-sync-xiphosuran_puzzle-social-page-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "pageUrl" ], "properties": { "pageUrl": { "title": "Page URL", "pattern": "https?://(www\\.)?(facebook\\.com|instagram\\.com)/.+", "type": "string", "description": "URL of the Facebook or Instagram page to scrape. Examples: https://www.facebook.com/nasa or https://www.instagram.com/nasa" }, "maxPosts": { "title": "Max posts", "minimum": 0, "maximum": 500, "type": "integer", "description": "Maximum number of posts to scrape. Set to 0 for unlimited (not recommended — will scroll until end of feed).", "default": 20 }, "postTypes": { "title": "Post types to scrape", "uniqueItems": true, "type": "array", "description": "Filter which post types to include. Select one or more. Leave empty or select 'all' to scrape everything.", "items": { "type": "string", "enum": [ "all", "photo", "video", "reel", "album", "text", "link" ], "enumTitles": [ "All types", "Photos", "Videos", "Reels", "Albums (multiple images)", "Text-only posts", "Link shares" ] }, "default": [ "all" ] }, "scrapeComments": { "title": "Scrape comments", "type": "boolean", "description": "Whether to open each post and scrape its comments. Significantly increases run time.", "default": false }, "maxComments": { "title": "Max comments per post", "minimum": 1, "maximum": 200, "type": "integer", "description": "Maximum number of comments to scrape per post (only used when scrapeComments is enabled).", "default": 10 }, "cookies": { "title": "Session cookies", "type": "array", "description": "Provide your browser session cookies to unlock full feed access. Without cookies, Facebook/Instagram only show ~5-10 public posts.\n\n━━━ HOW TO GET YOUR COOKIES ━━━\n\n🔹 Step 1: Open Chrome and log into Facebook (or Instagram)\n\n🔹 Step 2: Press F12 to open Developer Tools\n\n🔹 Step 3: Click the 'Application' tab at the top of DevTools\n (If you don't see it, click the >> arrows to find it)\n\n🔹 Step 4: In the left sidebar, expand 'Cookies' and click on\n 'https://www.facebook.com' (or instagram.com)\n\n🔹 Step 5: You'll see a table of cookies. Find and copy these:\n\n FOR FACEBOOK — you need 2 cookies:\n • c_user → your Facebook user ID (a number like 100012345678)\n • xs → your session token (a long string)\n\n FOR INSTAGRAM — you need 1 cookie:\n • sessionid → your session token (a long string)\n\n🔹 Step 6: Paste them below in this format (see placeholder)\n\n━━━ EASY METHOD: Cookie Editor Extension ━━━\n\n🔹 Install 'Cookie-Editor' browser extension:\n Chrome: https://chromewebstore.google.com/detail/cookie-editor/hlkenndednhfkekhgcdicdfddnkalmdm\n Firefox: https://addons.mozilla.org/en-US/firefox/addon/cookie-editor/\n\n🔹 Log into Facebook/Instagram, click the extension icon,\n click 'Export' (JSON format), and paste the result here.\n The actor will automatically pick out the cookies it needs.\n\n━━━ IMPORTANT NOTES ━━━\n• Cookies expire after a few days/weeks — you may need to refresh them\n• Never share your cookies with anyone — they give full access to your account\n• We recommend using a secondary/dummy account for scraping" }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Proxy settings. Residential proxies are strongly recommended for Facebook/Instagram — datacenter proxies are usually blocked." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```