Sephora Advanced Scraper

What does Sephora Reviews & Questions scraper do?

The Sephora Scraper is designed to extract detailed product information, including reviews and questions/answers, from either individual product or category URLs on Sephora's website. Here's a brief overview of its capabilities:

1. Extract detailed product information: The Sephora Scraper can pull various types of data for individual products, such as general product information, reviews, questions and answers.
2. Scrape category pages: Not only can you scrape individual products, but also entire categories. The scraper navigates through the pages of a product category, enqueues each product URL found, and subsequently scrapes all product data, providing you with a broad view of the product landscape for that category.
3. Handle similar product recommendations: The Sephora Scraper offers an optional functionality to scrape similar products. If enabled, the scraper navigates to the similar product recommendations section on a product page, enqueues these product URLs, and fetches their data as well, further extending the scope of data you can acquire.
4. Data stored in a structured format: All the scraped data is structured and stored in a dataset, making it easy to process and analyze.

Why scrape Sephora?

The Sephora Reviews & Questions scraper makes it easy to gather large amounts of product data from Sephora, which can be instrumental for

market research competitor analysis price monitoring creating customer persona and more.

How much will it cost to scrape Sephora?

When it comes to scraping, it can be challenging to estimate the resources needed to extract data as use cases may vary significantly. That's why the best course of action is to run a test scrape with a small sample of input data and limited output. You’ll get your price per scrape, which you’ll then multiply by the number of scrapes you intend to do.

Watch this video for a few helpful tips. And don't forget that choosing a higher plan will save you money in the long run.

Is it legal to scrape Sephora?

Our scrapers are ethical and do not extract any private user data, such as email addresses, gender, or location. They only extract what the user has chosen to share publicly. We therefore believe that our scrapers, when used for ethical purposes by Apify users, are safe. However, you should be aware that your results could contain personal data. Personal data is protected by the GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. You can also read Apify blog post on the legality of web scraping.

Input

Sephora Reviews & Questions scraper has the following input options:

1{
2    "url_list": [
3        "https://www.sephora.com/product/watermelon-glow-ultra-fine-mist-P442744",
4        "https://www.sephora.com/product/mini-ceramidin-tm-skin-barrier-moisturizing-cream-P506727"
5    ],
6    "get_similars": true
7}

You can give any number of product URLs to scrape and decide whether you also want to scrape similar products with "get_similars" field. If you want to scrape products from categories, you can simply write category URLs to "url_list" field and scraper will automatically find all products from each category and scrape them. (Note: "get_similars" is ignored in category scraping). A sample category scraping is the following:

1{
2    "url_list": [
3        "https://www.sephora.com/shop/face-mist-face-spray",
4        "https://www.sephora.com/shop/eyebrow-makeup-pencils"
5    ],
6    "get_similars": true
7}

Output

You can download the dataset extracted by Sephora Reviews & Questions scraper in various formats such as JSON, HTML, CSV, or Excel.

Each product data will be mainly including 5 parts: info (general product info), product_variants (info about all variants of product), statistics (general product statistics), reviews (list of all reviews and their statistics), and questions (list of all questions, their answers and statistics). A sample result for each product URL will be as following:

1{
2    "info": {
3      "id": "P455369",
4      "name": "Peptide Moisturizer",
5      "image": "https://www.sephora.com/productimages/sku/s2335610-main-zoom.jpg",
6      "description": "What it is:  A nourishing-yet-fast-absorbing daily moisturizer with a dual peptide formula aiming to reduce the appearance of fine lines and wrinkles.Skin Type: Normal, Dry, Combination, and Oily Skincare Concerns: Fine Lines and Wrinkles, Loss of Firmness and ElasticityFormulation: Lightweight Cream Highlighted Ingredients:- Royal Epigen P5 2%: Nurtures skin to help decrease the appearance of fine lines and wrinkles.",
7      "is_available": "True",
8      "brand": "The INKEY List",
9      "price": "$15.99",
10      "love_count": "73.4K"
11    },
12    "product_variants": [
13      {
14        "variant_id": "P464820",
15        "variant_description": "What it is:  A nurturing yet fast-absorbing daily moisturizer with a peptide duo that helps support natural collagen and hydrate skin.",
16        "is_variant_available": "True",
17        "variant_name": "Peptide Moisturizer",
18        "variant_image": "https://www.sephora.com/productimages/sku/s2404507-main-zoom.jpg"
19      }
20    ],
21    "statistics": {
22        "average_rating": 3.77,
23        "helpful_vote_count": 4232,
24        "not_helpful_vote_count": 1075,
25        "recommended_review_count": 588,
26        "not_recommended_review_count": 251,
27        "review_count": 835,
28        "variant_count": 1,
29        "rating_distribution": [
30            {
31                "rating": 5,
32                "count": 353,
33                "percentage": 42.28
34            },
35            {
36                "rating": 4,
37                "count": 174,
38                "percentage": 20.84
39            },
40            {
41                "rating": 3,
42                "count": 148,
43                "percentage": 17.72
44            },
45            {
46                "rating": 2,
47                "count": 97,
48                "percentage": 11.62
49            },
50            {
51                "rating": 1,
52                "count": 67,
53                "percentage": 8.02
54            }
55        ],
56        "review_distribution": [
57            {
58                "statistics_type": "Age",
59                "statistics": [
60                    {
61                        "label": "13-17",
62                        "count": 3,
63                        "percentage": 0.36
64                    },
65                    {
66                        "label": "18-24",
67                        "count": 8,
68                        "percentage": 0.96
69                    },
70                    {
71                        "label": "25-34",
72                        "count": 14,
73                        "percentage": 1.68
74                    },
75                    {
76                        "label": "35-44",
77                        "count": 11,
78                        "percentage": 1.32
79                    },
80                    {
81                        "label": "45-54",
82                        "count": 3,
83                        "percentage": 0.36
84                    },
85                    {
86                        "label": "over 54",
87                        "count": 23,
88                        "percentage": 2.75
89                    }
90                ]
91            },
92            {
93                "statistics_type": "Skin Type",
94                "statistics": [
95                    {
96                        "label": "Normal",
97                        "count": 114,
98                        "percentage": 13.65
99                    },
100                    {
101                        "label": "Combination",
102                        "count": 398,
103                        "percentage": 47.66
104                    },
105                    {
106                        "label": "Dry",
107                        "count": 225,
108                        "percentage": 26.95
109                    },
110                    {
111                        "label": "Oily",
112                        "count": 84,
113                        "percentage": 10.06
114                    }
115                ]
116            },
117        ],
118        "question_count": 81,
119        "answer_count": 101
120    },
121    "reviews": [
122        {
123            "rating": 3,
124            "review_text": "I’m being generous with giving this 3 stars as this product is very inexpensive.. but that’s the only positive thing about it sadly. I think everyone is made to believe that a $15 product can be the same as a $75 product but that’s simply not true, at least in this case. If I could get past the off putting smell and texture, then maybe I could like this but I also don’t think it did much for my skin. Disappointed - will not repurchase",
125            "review_title": "A no from me",
126            "product_id": "P455369",
127            "is_recommended": false,
128            "number_of_feedbacks_of_review": 0,
129            "number_of_positive_feedbacks_of_review": 0,
130            "number_of_negative_feedbacks_of_review": 0,
131            "submitted_at": "2023-07-23T22:40:31.000+00:00",
132            "reviewer_info": {
133                "nickname": "afasanella",
134                "skinTone": "Fair",
135                "skinType": "Oily",
136                "eyeColor": "Blue",
137                "hairColor": "blonde"
138            },
139            "is_verified_purchase": true
140        },
141        {
142            "rating": 1,
143            "review_text": "I was so excited for this moisturizer as I’ve seen great reviews on it but I’m starting to notice breakouts. so I will be returning this and switching back to my good la richer posay one 💅 btw I have sensitive + combo dkin!",
144            "review_title": "a no from me",
145            "product_id": "P455369",
146            "is_recommended": false,
147            "number_of_feedbacks_of_review": 3,
148            "number_of_positive_feedbacks_of_review": 2,
149            "number_of_negative_feedbacks_of_review": 1,
150            "submitted_at": "2023-07-18T05:06:55.000+00:00",
151            "reviewer_info": {
152                "nickname": "okaymakeup",
153                "IncentivizedReview": "No",
154                "StaffContext": "No",
155                "skinTone": "Medium",
156                "skinType": "Oily",
157                "eyeColor": "Brown",
158                "hairColor": "black"
159            },
160            "is_verified_purchase": false
161        },
162    ],
163    "questions": [
164        {
165            "product_id": "P455369",
166            "answers_count": 0,
167            "question": "Is the phenoxyethanol in the ingredients list safe ?",
168            "asked_at": "2023-05-28T04:27:51.000+00:00",
169            "answers": []
170        },
171        {
172            "product_id": "P464820",
173            "answers_count": 2,
174            "question": "Can it be used everyday for my PM routine?",
175            "asked_at": "2023-04-19T22:02:57.000+00:00",
176            "answers": [
177                {
178                    "answer": "Yes you can!!. I use it every nite even though you can use it in the day time too.",
179                    "username": "fmtorres",
180                    "answered_at": "2023-05-08T18:35:23.000+00:00",
181                    "positive_feedback_count": 1,
182                    "negative_feedback_count": 0
183                },
184                {
185                    "answer": "Yes, this is the BOMB for 50% skin. They have changed the packaging, so not great, but well worth it. ",
186                    "username": "bucanera",
187                    "answered_at": "2023-04-26T15:08:09.000+00:00",
188                    "positive_feedback_count": 1,
189                    "negative_feedback_count": 1
190                }
191            ]
192        },
193    ]
194}