Incidecoder Scraper

INCIDecoder Scraper extracts detailed skincare product ingredient data from incidecoder.com. Given one or more search URLs, it scrapes every product result and outputs a structured breakdown of each product's full ingredient list, ingredient functions, ratings, and expert explanations — ready to download as JSON, CSV, or Excel.

✨ Features

• Full ingredient data extraction — ingredients list, highlights, key/other ingredient groupings by function, per-ingredient ratings and detailed explanations
• Pagination support — automatically follows "Next page" links until maxItems is reached
• Proxy support — configurable proxy to handle large-scale runs without blocks

🔧 Input Configuration

Field	Type	Required	Default	Description
startUrls	array	✅	—	One or more INCIDecoder search URLs (e.g. https://incidecoder.com/search?query=acid). Only search URLs are supported — ingredient URLs are ignored automatically.
maxItems	integer	—	3	Maximum number of product pages to scrape per start URL.
proxyConfiguration	object	—	Apify Proxy enabled	Proxy settings for the crawler. Recommended for large runs.

Supported URL types:

• Search results page: https://incidecoder.com/search?query=<keyword>

📦 Output

The dataset contains one record per product page scraped.

Sample output:

{
    "url": "https://incidecoder.com/products/bielenda-professional-40-salicylic-acid-mandelic-acid-lactic-acid",
    "ingredients": [
        "Aqua (Water)",
        "Lactic Acid",
        "Mandelic Acid",
        "Propylene Glycol",
        "Betaine",
        "Glycerin",
        "Azelaic Acid",
        "Salicylic Acid",
        "Xanthan Gum"
    ],
    "highlights": ["#alcohol-free", "#fragrance & essentialoil-free"],
    "keyIngredients": {
        "Anti-acne": ["Azelaic Acid", "Salicylic Acid"],
        "Exfoliant": ["Lactic Acid", "Mandelic Acid", "Salicylic Acid"],
        "Skin-identical ingredient": ["Glycerin"],
        "Soothing": ["Azelaic Acid", "Salicylic Acid"]
    },
    "otherIngredients": {
        "Antimicrobial/antibacterial": ["Mandelic Acid"],
        "Buffering": ["Lactic Acid", "Azelaic Acid"],
        "Moisturizer/humectant": ["Lactic Acid", "Propylene Glycol", "Betaine", "Glycerin"],
        "Preservative": ["Salicylic Acid"],
        "Solvent": ["Aqua (Water)", "Propylene Glycol"],
        "Viscosity controlling": ["Xanthan Gum"]
    },
    "skimThrough": [
        { "ingredientName": "Aqua (Water)", "function": ["solvent"], "idRating": null },
        {
            "ingredientName": "Lactic Acid",
            "function": ["exfoliant", "moisturizer/humectant", "buffering"],
            "idRating": "superstar"
        },
        {
            "ingredientName": "Salicylic Acid",
            "function": ["exfoliant", "anti-acne", "soothing", "preservative"],
            "idRating": "superstar"
        }
    ],
    "ingredientsExplained": [
        {
            "ingredientName": "Lactic Acid",
            "idRating": "superstar",
            "function": ["exfoliant", "moisturizer/humectant", "buffering"],
            "additionalInfo": [
                "It's the second most researched AHA after glycolic acid",
                "It gently lifts off dead skin cells to reveal newer, fresher, smoother skin",
                "It also has amazing skin hydrating properties"
            ]
        }
    ]
}

📊 Data Table

Field	Format	Description
url	string	Product page URL
ingredients	array of strings	Full ordered ingredient list
highlights	array of strings	Product tags (e.g. #alcohol-free)
keyIngredients	object	Notable ingredients grouped by their primary function
otherIngredients	object	Remaining ingredients grouped by secondary functions
skimThrough	array of objects	Per-ingredient quick view: name, functions, and ID rating
ingredientsExplained	array of objects	Detailed cards: name, ID rating, functions, and bullet-point explanations

💡 Uses of This Data

• Product formulation research — compare ingredient lists and functional categories across competing products
• Skincare ingredient monitoring — track which products contain specific active ingredients (e.g. Azelaic Acid, Niacinamide)
• Building ingredient databases — aggregate ID ratings and expert explanations for ingredients at scale
• Clean beauty filtering — programmatically filter products by highlights like #alcohol-free or #fragrance & essentialoil-free
• Content and review generation — use structured ingredient explanations to power product-specific content

🚀 How to Use

1. Sign up for a free Apify account — includes $5 monthly credit.
2. Open the actor page and click Try for free.
3. Paste one or more INCIDecoder search URLs into the Start URLs field.
4. Set Max Items to control how many products to scrape per search.
5. Click Start and wait for the run to complete.
6. Download results from the Output tab in JSON, CSV, or Excel format.

You can also run this actor via the Apify API or integrate it into your workflows using Zapier, Make, or n8n.

⚠️ Limitations & Known Issues

• Rate limiting — for large-scale runs, enable proxy to avoid being rate-limited by the site.

📝 Notes

• Proxy recommended for large-scale scraping — for high-volume runs, enable Apify Residential or Datacenter proxy to avoid blocks.
• API integration — this actor can be called as an API from any automation platform (Zapier, Make, n8n, custom scripts).

🔗 Other Actors

Rightmove Listing Availability Checker

WHOIS Domain Lookup Scraper