root = true

[*]
indent_style = space
indent_size = 4
charset = utf-8
trim_trailing_whitespace = true
insert_final_newline = true
end_of_line = lf


.editorconfig

.eslintrc

# This file tells Git which files shouldn't be added to source control

.idea
node_modules


.gitignore

# First, specify the base Docker image. You can read more about
# the available images at https://sdk.apify.com/docs/guides/docker-images
# You can also use any other image from Docker Hub.
FROM apify/actor-node:16

# Second, copy just package.json and package-lock.json since it should be
# the only file that affects "npm install" in the next step, to speed up the build
COPY package*.json ./

# Install NPM packages, skip optional and development dependencies to
# keep the image small. Avoid logging too much and print the dependency
# tree for debugging
RUN npm --quiet set progress=false \
 &amp;&amp; npm install --only=prod --no-optional \
 &amp;&amp; echo "Installed NPM packages:" \
 &amp;&amp; (npm list --only=prod --no-optional --all || true) \
 &amp;&amp; echo "Node.js version:" \
 &amp;&amp; node --version \
 &amp;&amp; echo "NPM version:" \
 &amp;&amp; npm --version

# Next, copy the remaining files and directories with the source code.
# Since we do this after NPM install, quick build will be really fast
# for most source file changes.
COPY . ./

# Optionally, specify how to launch the source code of your actor.
# By default, Apify's base Docker images define the CMD instruction
# that runs the Node.js source code using the command specified
# in the "scripts.start" section of the package.json file.
# In short, the instruction looks something like this:
#
# CMD npm start

Dockerfile

{
 "title": "Input schema for the apify_project actor.",
 "type": "object",
 "schemaVersion": 1,
 "properties": {
 "startUrls": {
 "title": "Posts URL(s)",
 "type": "array",
 "description": "Insert pages that contains direct posts like https://www.facebook.com/apifytech/posts/303001308495203",
 "editor": "requestListSources",
 "prefill": [ 
 {
 "url": "https://www.facebook.com/apifytech/posts/306435811485086"
 }
 ]
 }
 },
 "required": ["startUrls"]
}

INPUT_SCHEMA.json

## Why scrape Facebook comments? 

Our free Facebook Comments Scraper allows to scrape Facebook posts and their comment section. Scraping Facebook comments can help you track public sentiment towards specific topics, brands, and personas, get immediate insights into the performance of marketing campaigns, identify and react to fake news, abuse, or information of high public value, and more.

If you want to know how your business could use the comment data scraped from Facebook, check out our [industries pages](https://apify.com/industries) for ideas and use cases.

## How to scrape Facebook comments

Facebook Comments Scraper has a user-friendly structure, so there aren't too many scraping parameters to set.

1. [Create](https://console.apify.com/sign-up) a free Apify account.
2. Open [Facebook Latest Comments Scraper](https://apify.com/pocesar/facebook-latest-comments-scraper)
3. Add one or more Facebook post URLs to scrape the comments under them.
4. Click *Run* and wait for the datasets to be extracted.
5. Download your data in JSON, XML, CSV, Excel, or HTML.

## Want to scrape the most recent Facebook posts instead?

If you need to scrape not just a post but a whole Facebook page for recent posts and comments, consider trying this mini-scraper's twin - [Facebook Posts Scraper](https://apify.com/pocesar/facebook-latest-posts-scraper). Our mini-scrapers are created to require just 1 or 2 settings to deliver scraping results quickly and effortlessly. Just enter one or more post URLs and click to start the scraping. 

## Need something more advanced?

Try our more advanced [Facebook Pages Scraper](https://apify.com/pocesar/facebook-pages-scraper) or [Facebook Ads Scraper](https://apify.com/tugkan/facebookads-scraper) if you need a wider array of options and are comfortable with configuring various scraper settings on your own.

Let us know if you need a [custom Facebook scraping solution](https://apify.com/custom-solutions).

## Cost of usage

Based on Apify's pricing at the time of writing, the Personal plan **($49)** would allow you to **scrape comments from about 10-20k posts monthly**. 

To run this actor, you will need to have access to [residential proxies](https://apify.com/proxy). If you don't already have access, contact us at [support@apify.com](mailto:support@apify.com).

For more info on how the price for scraping Facebook is formed, read in [Cost of usage](https://apify.com/pocesar/facebook-pages-scraper#cost-of-usage) of the main Facebook Pages Scraper.



## Input

Here's an example input for scraping comments from a Facebook post with a picture. It needs only one parameter - **startUrls**. You can check the `INPUT_SCHEMA` tab for more details.

```javascript
{ 
	 "startUrls": [
	 { 
		 "url": "https://www.facebook.com/time/photos/a.470156966490/10158856011396491" 
	 } 
	] 
}
```

## Output

This mini-scraper will deliver results in a dataset. You can choose in which format to download it: JSON, CSV, XML, Excel, and HTML. Here's the example of the JSON dataset you'd get if you apply the input parameter above:

```json
[{
 "author": "TIME",
 "fbPage": "https://www.facebook.com/time/",
 "site": "https://www.time.com",
 "profile": "TIME",
 "postText": "Elon Musk is TIME's 2021 Person of the Year. https://ti.me/3IJvO6W",
 "postUrl": "https://www.facebook.com/time/photos/a.470156966490/10158856011396491/",
 "date": "2021-12-13T12:39:18.000Z",
 "modifiedDate": "2021-12-15T16:17:58.000Z",
 "imageCaption": "Elon Musk is TIME's 2021 Person of the Year. https://ti.me/3IJvO6W",
 "imageUrl": "https://scontent.fhel3-1.fna.fbcdn.net/v/t39.30808-6/p960x960/266791421_10158856011391491_2342928019632248499_n.jpg?_nc_cat=1&amp;ccb=1-5&amp;_nc_sid=9267fe&amp;_nc_ohc=DNaExIwztaYAX9op0cE&amp;_nc_ht=scontent.fhel3-1.fna&amp;oh=00_AT-Ii_M_AAN_4M-ZQIFZ71xx7_HyUb-smZgQ6M5buGaZWw&amp;oe=61BFF64C",
 "likesCount": 17903,
 "sharesCount": 4020,
 "commentsCount": 4259,
 "followerCount": 13278612,
 "thumbnailUrl": null,
 "comments": [
 {
 "authorId": "4d9f311f39e08536743b97d4b19fffd81816560266656d9500079cd8e896b8aa3fbc0c95f0fbd39fe4ebaba6aa2904b4d7b3d1fe1f6807d736ea3b7fcddfb1fd",
 "authorProfile": null,
 "author": null,
 "dateCreated": "2021-12-13T21:36:32.000Z",
 "text": "I am disappointed that Dr. Fauci Has not been named person of the year. The way he fights to keep people well, manoeuvres between so many politicians, insurance companies and other special interest groups, shows great leadership. I guess he does not tweet enough? TIME Mag: you disappoint!!!"
 },
 {
 "authorId": "653505145",
 "authorProfile": "https://www.facebook.com/katia.abinader.3",
 "author": "Katia Abinader",
 "dateCreated": "2021-12-13T13:49:46.000Z",
 "text": "Hope he somehow understand that he has to pay his taxes. Hope also that he remembers he was once bailed out by the Government. They gave him some breathing room for his business. He should pay back now to help others. Let’s hope he will give that 6 Billions he promissed the UN to alleviate poverty."
 },
 {
 "authorId": "100050528197919",
 "authorProfile": "https://www.facebook.com/oliviamblack",
 "author": "Olivia Black",
 "dateCreated": "2021-12-13T16:42:06.000Z",
 "text": "This represents everything wrong with the world. He’s done nothing for humanity. Disappointed in Time."
 },
 {
 "authorId": "8c1362aa708da18c3e031887d2fa5df3f7427f9433eecae26323da3cd20c1c034877abf68ed4f3537699d48e9892bfda3ad74e15b9d8ea7200deb2418e726857",
 "authorProfile": null,
 "author": null,
 "dateCreated": "2021-12-13T16:40:01.000Z",
 "text": "He deserves it"
 }
'''
```

## Limitations

- No login support.
- Does not scrape comment replies yet, only comments.
- The "About" page can't be accessed publicly.
- No content, stats, or comments for live stream posts.


## Personal data

We do not consider scraping vast amounts of personal data ethical and discourage anyone from doing so. Facebook Comments Scraper **does not scrape personal data from profiles**, including emails, addresses, phone numbers, etc. 
Personal data is protected by GDPR in the European Union and other laws and regulations around the world. You should not scrape it unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. Please read our blog post about [creating ethical and compliant scrapers](https://blog.apify.com/is-web-scraping-legal/) if you would like to learn more.

README.md

{
 "env": { "npm_config_loglevel": "silent" }
}

apify.json

main.js

{
 "name": "project-empty",
 "version": "0.0.1",
 "description": "This is a boilerplate of an Apify actor.",
 "dependencies": {
 "apify": "^2.1.0"
 },
 "devDependencies": {
 "@apify/eslint-config": "^0.2.2",
 "eslint": "^7.32.0"
 },
 "scripts": {
 "start": "node main.js",
 "lint": "./node_modules/.bin/eslint ./src --ext .js,.jsx",
 "lint:fix": "./node_modules/.bin/eslint ./src --ext .js,.jsx --fix",
 "test": "echo \"Error: oops, the actor has no tests yet, sad!\" &amp;&amp; exit 1"
 },
 "author": "It's not you it's me",
 "license": "ISC"
}

package.json

# First, specify the base Docker image. You can read more about
# the available images at https://sdk.apify.com/docs/guides/docker-images
# You can also use any other image from Docker Hub.
FROM apify/actor-node:16

# Second, copy just package.json and package-lock.json since it should be
# the only file that affects "npm install" in the next step, to speed up the build
COPY package*.json ./

# Install NPM packages, skip optional and development dependencies to
# keep the image small. Avoid logging too much and print the dependency
# tree for debugging
RUN npm --quiet set progress=false \
 && npm install --only=prod --no-optional \
 && echo "Installed NPM packages:" \
 && (npm list --only=prod --no-optional --all || true) \
 && echo "Node.js version:" \
 && node --version \
 && echo "NPM version:" \
 && npm --version

# Next, copy the remaining files and directories with the source code.
# Since we do this after NPM install, quick build will be really fast
# for most source file changes.
COPY . ./

# Optionally, specify how to launch the source code of your actor.
# By default, Apify's base Docker images define the CMD instruction
# that runs the Node.js source code using the command specified
# in the "scripts.start" section of the package.json file.
# In short, the instruction looks something like this:
#
# CMD npm start


Insert pages that contains direct posts like https://www.facebook.com/apifytech/posts/303001308495203

Posts URL(s)

Input schema for the apify_project actor.

## Why scrape Facebook comments? 

Our free Facebook Comments Scraper allows to scrape Facebook posts and their comment section. Scraping Facebook comments can help you track public sentiment towards specific topics, brands, and personas, get immediate insights into the performance of marketing campaigns, identify and react to fake news, abuse, or information of high public value, and more.

If you want to know how your business could use the comment data scraped from Facebook, check out our  [industries pages](https://apify.com/industries)  for ideas and use cases.

## How to scrape Facebook comments

Facebook Comments Scraper has a user-friendly structure, so there aren't too many scraping parameters to set.

1.  [Create](https://console.apify.com/sign-up)  a free Apify account.
2.  Open  [Facebook Latest Comments Scraper](https://apify.com/pocesar/facebook-latest-comments-scraper)
3.  Add one or more Facebook post URLs to scrape the comments under them.
4.  Click *Run* and wait for the datasets to be extracted.
5.  Download your data in JSON, XML, CSV, Excel, or HTML.

## Want to scrape the most recent Facebook posts instead?

If you need to scrape not just a post but a whole Facebook page for recent posts and comments, consider trying this mini-scraper's twin - [Facebook Posts Scraper](https://apify.com/pocesar/facebook-latest-posts-scraper). Our mini-scrapers are created to require just 1 or 2 settings to deliver scraping results quickly and effortlessly. Just enter one or more post URLs and click to start the scraping. 

## Need something more advanced?

Try our more advanced  [Facebook Pages Scraper](https://apify.com/pocesar/facebook-pages-scraper) or [Facebook Ads Scraper](https://apify.com/tugkan/facebookads-scraper) if you need a wider array of options and are comfortable with configuring various scraper settings on your own.

Let us know if you need a  [custom Facebook scraping solution](https://apify.com/custom-solutions).

##   Cost of usage

Based on Apify's pricing at the time of writing, the Personal plan **($49)** would allow you to  **scrape comments from about 10-20k posts monthly**. 

To run this actor, you will need to have access to [residential proxies](https://apify.com/proxy). If you don't already have access, contact us at [support@apify.com](mailto:support@apify.com).

For more info on how the price for scraping Facebook is formed, read in [Cost of usage](https://apify.com/pocesar/facebook-pages-scraper#cost-of-usage) of the main Facebook Pages Scraper.



## Input

Here's an example input for scraping comments from a Facebook post with a picture. It needs only one parameter - **startUrls**. You can check the `INPUT_SCHEMA` tab for more details.

```javascript
{  
	 "startUrls":  [
	   {  
		    "url":  "https://www.facebook.com/time/photos/a.470156966490/10158856011396491"  
	   }  
	]  
}
```

## Output

This mini-scraper will deliver results in a dataset. You can choose in which format to download it: JSON, CSV, XML, Excel, and HTML. Here's the example of the JSON dataset you'd get if you apply the input parameter above:

```json
[{
  "author": "TIME",
  "fbPage": "https://www.facebook.com/time/",
  "site": "https://www.time.com",
  "profile": "TIME",
  "postText": "Elon Musk is TIME's 2021 Person of the Year. https://ti.me/3IJvO6W",
  "postUrl": "https://www.facebook.com/time/photos/a.470156966490/10158856011396491/",
  "date": "2021-12-13T12:39:18.000Z",
  "modifiedDate": "2021-12-15T16:17:58.000Z",
  "imageCaption": "Elon Musk is TIME's 2021 Person of the Year. https://ti.me/3IJvO6W",
  "imageUrl": "https://scontent.fhel3-1.fna.fbcdn.net/v/t39.30808-6/p960x960/266791421_10158856011391491_2342928019632248499_n.jpg?_nc_cat=1&ccb=1-5&_nc_sid=9267fe&_nc_ohc=DNaExIwztaYAX9op0cE&_nc_ht=scontent.fhel3-1.fna&oh=00_AT-Ii_M_AAN_4M-ZQIFZ71xx7_HyUb-smZgQ6M5buGaZWw&oe=61BFF64C",
  "likesCount": 17903,
  "sharesCount": 4020,
  "commentsCount": 4259,
  "followerCount": 13278612,
  "thumbnailUrl": null,
  "comments": [
    {
      "authorId": "4d9f311f39e08536743b97d4b19fffd81816560266656d9500079cd8e896b8aa3fbc0c95f0fbd39fe4ebaba6aa2904b4d7b3d1fe1f6807d736ea3b7fcddfb1fd",
      "authorProfile": null,
      "author": null,
      "dateCreated": "2021-12-13T21:36:32.000Z",
      "text": "I am disappointed that Dr. Fauci Has not been named person of the year. The way he fights to keep people well, manoeuvres between so many politicians, insurance companies and other special interest groups, shows great leadership. I guess he does not tweet enough? TIME Mag: you disappoint!!!"
    },
    {
      "authorId": "653505145",
      "authorProfile": "https://www.facebook.com/katia.abinader.3",
      "author": "Katia Abinader",
      "dateCreated": "2021-12-13T13:49:46.000Z",
      "text": "Hope he somehow understand that he has to pay his taxes.  Hope also that he remembers he was once bailed out by the Government.   They gave him some breathing room for his business.   He should pay back now to help others.  Let’s hope he will give that 6 Billions he promissed the UN to alleviate poverty."
    },
    {
      "authorId": "100050528197919",
      "authorProfile": "https://www.facebook.com/oliviamblack",
      "author": "Olivia Black",
      "dateCreated": "2021-12-13T16:42:06.000Z",
      "text": "This represents everything wrong with the world. He’s done nothing for humanity. Disappointed in Time."
    },
    {
      "authorId": "8c1362aa708da18c3e031887d2fa5df3f7427f9433eecae26323da3cd20c1c034877abf68ed4f3537699d48e9892bfda3ad74e15b9d8ea7200deb2418e726857",
      "authorProfile": null,
      "author": null,
      "dateCreated": "2021-12-13T16:40:01.000Z",
      "text": "He deserves it"
    }
'''
```

## Limitations

-   No login support.
-   Does not scrape comment replies yet, only comments.
-   The "About" page can't be accessed publicly.
-   No content, stats, or comments for live stream posts.


## Personal data

We do not consider scraping vast amounts of personal data ethical and discourage anyone from doing so. Facebook Comments Scraper **does not scrape personal data from profiles**, including emails, addresses, phone numbers, etc. 
Personal data is protected by GDPR in the European Union and other laws and regulations around the world. You should not scrape it unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. Please read our blog post about  [creating ethical and compliant scrapers](https://blog.apify.com/is-web-scraping-legal/)  if you would like to learn more.

{
    "env": { "npm_config_loglevel": "silent" }
}


// This is the main Node.js source code file of your actor.

// Import Apify SDK. For more information, see https://sdk.apify.com/
const Apify = require('apify');

const pageFunction = async (context) => {
    const { $, request, log, body, customData } = context;
    const { includeLastComments = false } = customData;
    const { label } = request.userData;

    const lds = $('script[type*="ld"]')
        .map((_, el) => JSON.parse($(el).html()))
        .get()
        .filter(Boolean);

    if (!lds.length) {
        throw new Error('Page didnt load properly, retrying');
    }

    const interactions = (interactionStatistic, type) => {
        return interactionStatistic
                .find(({ interactionType }) => interactionType.includes(type))
                ?.userInteractionCount ?? null;
    }

    const toISODate = (date) => {
        if (!date) {
            return null;
        }

        try {
            return new Date(date).toISOString();
        } catch (e) {
            return null;
        }
    }

    const addComments = (comments) => {
        if (!includeLastComments || !comments?.length) {
            return [];
        }

        return comments.map((comment) => {
            return {
                authorId: comment.author?.identifier ?? null,
                authorProfile: comment.author?.url ?? null,
                author: comment.author?.name ?? null,
                dateCreated: toISODate(comment.dateCreated),
                text: comment.text,
            };
        })
    }

    const posts = lds
            .filter((ld) => ld['@type'] === 'SocialMediaPosting')
            .map(({ url, comment, articleBody, thumbnailUrl, dateCreated, dateModified, author, interactionStatistic, image }) => ({  
                author: author?.name ?? null,
                fbPage: author?.url ?? null,
                site: author?.sameAs ?? null,
                profile: author?.name ?? null,
                postText: articleBody ?? null,
                postUrl: url, 
                date: toISODate(dateCreated),
                modifiedDate: toISODate(dateModified),
                imageCaption: image?.caption ?? null,
                imageUrl: image?.contentUrl ?? null,
                likesCount: interactions(interactionStatistic, 'LikeAction'), 
                sharesCount: interactions(interactionStatistic, 'ShareAction'),
                commentsCount: interactions(interactionStatistic, 'CommentAction'),
                followerCount: interactions(interactionStatistic, 'FollowAction'),
                thumbnailUrl: thumbnailUrl ?? null,
                comments: addComments(comment),
            }));

    if (!label) {
        const postUrls = body.matchAll(/"wwwURL":"([^"]+)"/g);
        const userData = {
            label: 'POST'
        };

        for (const post of postUrls) {
            if (post[1]) {
                await context.enqueueRequest({
                    url: JSON.parse(`"${post[1]}"`),
                    userData,
                });
            }
        }

        if (posts.length) {
            for (const post of posts) {
                if (post.postUrl) {
                    await context.enqueueRequest({
                        url: post.postUrl,
                        userData
                    });
                }
            }
        }
    }
    
    const out = [];

    for (const post of posts) {
        const { postUrl } = post;

        if (!(await context.globalStore.has(postUrl))) {
            out.push(post);
            await context.globalStore.set(postUrl, 1);
        }
    }

    return out;
};

const filterURL = (urls) => {
    return urls.filter((r) => {
        if (r.url) {
            return /https:\/\/www\.facebook\.com\/[^/]+/.test(r.url);
        }

        return true; // requestsFromUrl
    });
}

Apify.main(async () => {
    const { startUrls } = await Apify.getInput();
    const includeLastComments = true;

    await Apify.metamorph('apify/cheerio-scraper', {
        startUrls: filterURL(startUrls),
        pageFunction: pageFunction.toString(),
        proxyConfiguration: {
            useApifyProxy: true,
            apifyProxyGroups: [
                "RESIDENTIAL"
            ],
        },
        customData: {
            includeLastComments
        },
    });
});


project-empty

Mini-actor to scrape Facebook comments from one or multiple post URLs. Get comment text, timestamps, author id, author name, etc. Download data in structured formats such as JSON, CSV, XML, Excel, and HTML and use it in apps, spreadsheets, and reports.
​

facebook-latest-comments-scraper

Scrape Facebook comments from post URLs. Get comment text, posting time, author id, author name, post text, post URL, number of comments etc.

Facebook Latest Comments Scraper

Mini-actor to scrape Facebook comments from one or multiple post URLs. Get comment text, timestamps, author id, author name, etc. Download data in structured formats such as JSON, CSV, XML, Excel, ...

Posts URL(s)

Where next?