Slug: fatihtahta/shopee-scraper

Shopee Scraper | All-In-One is a comprehensive and resilient tool for extracting detailed product and search data from all 11 Shopee country sites. Scrape by keyword or by providing a list of direct search/category URLs to get deep insights into product listings, pricing, sales performance, and seller information.

This unofficial Shopee API is your ultimate solution for market research, competitor monitoring, price tracking, and e-commerce analytics across Southeast Asia and Latin America.

---

Features 🚀

With this all-in-one tool, you can:

• Scrape by Keyword or URL: Easily extract product data for any search term or provide your own pre-filtered search/category URLs for highly specific datasets.
• Dual Scraping Modes: Choose the best mode for your needs:
  • ⚡ Fast Scrape: Quickly extracts essential data directly from search result pages, saving time and compute units.
  • 🔬 Deep Scrape: First discovers all product links, then visits each page to extract a rich, comprehensive dataset with all available details.
• Full Multi-Country Support: Target all 11 Shopee regions, including Indonesia, Malaysia, Singapore, Thailand, Taiwan, Vietnam, Philippines, Brazil, Mexico, Colombia, and Chile.
• Robust and Resilient:
  • Built with advanced browser fingerprinting (Camoufox) to avoid blocks.
  • Includes an integrated, third-party Captcha Solver to handle Shopee's anti-bot measures automatically.
  • Uses a persistent browser session in Deep Scrape mode to mimic human behavior and ensure high success rates.
• Comprehensive Data Extraction: Get a rich dataset for every product, including variants, full image sets, seller statistics, and product specifications.
• Flexible Export Options: Download your data as JSON, CSV, Excel, or HTML.

---

What Product Data Can I Extract?

With this Shopee Scraper, you will be able to extract the following data for each product:

• 📝 Product Name & URL
• 🆔 Item ID & Shop ID
• 💰 Price, Price Range, & Original Price
• 💸 Discount Percentage & Currency
• 📈 Sales Count
• ⭐ Average Rating & Total Rating Count (Deep Scrape)
• 📍 Location
• 🖼️ Image URLs: Main image (Fast Scrape) or all images (Deep Scrape).
• 🚚 Shipping Info (Deep Scrape)
• 🎨 Product Variants (e.g., Color, Size) (Deep Scrape)
• 📦 Product Specifications (Deep Scrape)
• 🧑‍💼 Seller Information (Name, logo, ratings, etc.) (Deep Scrape)
• 📄 Full Product Description (Deep Scrape)

---

Why Scrape Shopee? 🛍️

Shopee is a dominant e-commerce platform in several of the world's fastest-growing markets. Scraping its data provides invaluable insights for your business.

• Competitor Analysis: Monitor your competitors' pricing, promotions, sales performance, and product catalogs in real-time across different countries.
• Market Research: Identify best-selling products, emerging trends, and gaps in the market by analyzing sales data and user ratings.
• Price Monitoring: Track dynamic pricing to ensure your own products are competitively priced.
• Brand Monitoring: Understand how your products and brand are represented and performing on one of the largest online marketplaces.
• Lead Generation: Find successful third-party sellers and popular brands for potential partnerships.

---

How to Use Shopee Scraper

Shopee Scraper was designed to be easy to start with. Here's a quick guide:

1. Create a free Apify account.
2. Open the Shopee Scraper in the Apify Store and click "Try actor".
3. Configure Your Scrape:
   • Choose your scraping target: either provide Search Keywords (and a Country) or a list of full Search URLs.
   • Provide your Shopee Cookie Header. This is mandatory for reliable scraping. See the detailed guide below.
   • Select a Scrape Mode (Fast or Deep).
   • Set the Max Products per Search.
4. Click "Start" and wait for the data to be extracted.
5. Download your data in JSON, CSV, Excel, or HTML format.

---

🔑 How to Get Your Shopee Cookie (Mandatory)

This scraper requires you to be logged in to reliably access Shopee's data. The most effective way to do this is by providing your session cookie. Follow these steps carefully:

1. Log In to Shopee

• Open your web browser (like Chrome, Firefox, or Brave).
• Navigate to the Shopee site for the country you want to scrape (e.g., shopee.sg, shopee.com.br).
• Log into your account.
• Pro Tip: It's recommended to use a secondary Shopee account for scraping. While unlikely, this prevents any risk to your main account.

2. Open Developer Tools

![Step 2: Open Developer Tools https://i.imgur.com/7J88ZtB.png

• Once logged in, right-click anywhere on the page and select Inspect to open the Developer Tools.
• You can also use the keyboard shortcut F12 or Ctrl+Shift+I (on Windows/Linux) or Cmd+Opt+I (on Mac).

3. Find the Network Request

![Step 3: Filter Network Requests https://i.imgur.com/fnkPnvm.png

• In the Developer Tools panel, click on the Network tab.
• In the filter box at the top, type get_account_info.
• Note: If you don't see this request immediately, refresh the page or browse the site for a few seconds. The request will appear as the page loads your account data.

4. Copy the Cookie Value

![Step 4: Copy the Cookie Header https://i.imgur.com/Xnwzr6E.png

• Click on the get_account_info request in the list.
• A new panel will appear. Select the Headers tab.
• Scroll down to the Request Headers section until you find the cookie header.
• Carefully select and copy the entire lengthy string of text for that cookie value. It will look something like _QPWSDCXHZQA=a4easdjj324-234.......

5. Paste and Scrape

• Paste the copied value into the cookieHeader input field in the Apify Console.
• You're now ready to run the scraper!

⚠️ Important Note on Cookie Expiration

Shopee cookies typically expire after about 24 hours. If your scrape fails after working previously, the most likely cause is an expired cookie. Simply follow these steps again to get a fresh one before starting your next run.

---

Input

The scraper accepts either a list of keywords or a list of full Shopee search URLs.

Input example using keywords

{
  "searchKeywords": [
    "hawaii shirt men",
    "gaming mouse"
  ],
  "country": "TH",
  "scrapeMode": "deep",
  "maxProductsPerSearch": 200,
  "cookieHeader": "SPC_F=...; SPC_T_ID=...; ..."
}

Output Data Structure

The results are stored in a dataset. Each item is a product with a comprehensive set of data fields.

Here is an example of a single product record from a Deep Scrape:

{
  "keyword": "hawaii shirt men",
  "url": "[https://shopee.co.th/product/123456/789012](https://shopee.co.th/product/123456/789012)",
  "name": "Premium Hawaiian Palm Tree Shirt for Men",
  "itemId": 789012,
  "shopId": 123456,
  "price": 199,
  "currentPriceRange": [
    199,
    250
  ],
  "originalPriceRange": [
    398,
    500
  ],
  "currency": "฿",
  "discountPercentage": 50,
  "salesCount": 1250,
  "rating": 4.9,
  "ratingCount": 450,
  "imageUrls": [
    "[https://down-th.img.susercontent.com/file/image1.webp](https://down-th.img.susercontent.com/file/image1.webp)",
    "[https://down-th.img.susercontent.com/file/image2.webp](https://down-th.img.susercontent.com/file/image2.webp)"
  ],
  "location": "จังหวัดกรุงเทพมหานคร",
  "shippingInfo": "Free Shipping",
  "variants": {
    "Color": [
      "Blue",
      "Red",
      "Green"
    ],
    "Size": [
      "M",
      "L",
      "XL"
    ]
  },
  "sellerInfo": {
    "name": "Official Seller Store",
    "logoUrl": "[https://seller.logo/image.png](https://seller.logo/image.png)",
    "Ratings": "15.2k",
    "Response Rate": "98%"
  },
  "specifications": {
    "Brand": "No Brand",
    "Material": "Cotton",
    "Ships From": "จังหวัดกรุงเทพมหานคร"
  },
  "description": "A high-quality shirt made from premium cotton..."
}

Is It Legal to Scrape Shopee?

This scraper is designed to be ethical and only extracts publicly available data from the website. It does not access any private user information. However, you should be aware that your results could contain personal data in some cases (e.g., seller names). Personal data is protected by regulations like GDPR, and you should not scrape it unless you have a legitimate reason. If you are unsure, it's best to consult with a legal professional.

Your Feedback

If you have any technical feedback for Shopee Scraper or find a bug, please create an issue on the Actor’s Issues tab in the Apify Console and it will be resolved around the clock.

Happy Scrapings!

Fatih