TikTok Shop Scraper V4

Scrape product data from TikTok Shop — prices, ratings, reviews, seller info, sales counts, and more.

What It Does

Searches TikTok Shop for products by keyword and extracts structured data for each result:

• Product info: title, description, price, original price, discount %, images
• Metrics: rating, review count, sold count, in-stock status
• Seller info: name, URL, rating
• Category & tags
• Multi-region support: US, UK, DE, FR, ES, IT, ID, MY, PH, SG, TH, VN

How It Works

The scraper uses a multi-strategy approach:

1. Camoufox stealth browser (primary) — anti-detection fingerprinting that makes the browser look like a real user
2. Standard Playwright Firefox (fallback) — when Camoufox isn't available
3. Firecrawl API (optional fallback) — when browser methods can't get through

For each page, it tries three extraction methods in order:

1. __NEXT_DATA__ JSON — TikTok Shop embeds product data in the page HTML as JSON. This is the most reliable method.
2. API response interception — captures the API calls the browser makes and extracts product data from the responses.
3. DOM extraction — reads product info directly from the rendered page elements.

Quick Start

1. Demo Mode (Free, No Setup)

Just run with demo mode enabled to see sample output:

{
  "searchQueries": ["wireless earbuds"],
  "demoMode": true
}

2. Basic Scraping

{
  "searchQueries": ["wireless earbuds", "phone cases"],
  "maxProducts": 50,
  "region": "US",
  "demoMode": false,
  "useCamoufox": true,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

3. Full Setup (Best Results)

{
  "searchQueries": ["wireless earbuds"],
  "maxProducts": 100,
  "region": "US",
  "demoMode": false,
  "sessionCookies": "[paste Cookie-Editor JSON here]",
  "sadCaptchaApiKey": "your-sadcaptcha-api-key",
  "useCamoufox": true,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  },
  "useFirecrawl": true,
  "firecrawlApiKey": "your-firecrawl-key"
}

Input Parameters

Parameter	Type	Default	Description
searchQueries	string[]	["wireless earbuds"]	Keywords to search
productUrls	string[]	[]	Direct product URLs to scrape
maxProducts	integer	50	Max products per query (1-500)
region	string	"US"	TikTok Shop region
demoMode	boolean	false	Generate sample data (no scraping)
sessionCookies	string	—	Cookie-Editor JSON export
sadCaptchaApiKey	string	—	SadCaptcha API key for CAPTCHA solving
useCamoufox	boolean	true	Use stealth browser
proxyConfiguration	object	—	Apify proxy settings
useFirecrawl	boolean	false	Enable Firecrawl fallback
firecrawlApiKey	string	—	Firecrawl API key

How to Get Session Cookies

TikTok Shop works best with an authenticated session. Here's how:

1. Install the Cookie-Editor browser extension
2. Go to shop.tiktok.com and log in
3. Search for any product to make sure the session is active
4. Click the Cookie-Editor icon → Export → JSON
5. Paste the JSON into the sessionCookies input field

Cookie Manager Integration

Instead of manually exporting and pasting cookies, you can use the Cookie Manager actor to capture and store TikTok session cookies in a Named Key-Value Store, then reference them by key.

Setup

1. Run the Cookie Manager actor with:
   • mode: capture
   • platform: tiktok
   • storageKey: tiktok-shop (or any key you choose)
2. Log into TikTok / TikTok Shop via the Live View when prompted
3. Cookie Manager stores your session cookies automatically

Usage

{
  "searchQueries": ["wireless earbuds"],
  "cookieStorageKey": "tiktok-shop",
  "demoMode": false
}

The actor loads cookies from the KV store at runtime — no need to paste or update cookie JSON manually. If cookieStorageKey is set and no manual sessionCookies are provided, the actor reads from the store automatically.

Parameter	Type	Default	Description
cookieStorageKey	string	—	Key used in Cookie Manager's storageKey field
cookieKvStoreName	string	cookie-sessions	Named KV Store name (only change if you used a custom name in Cookie Manager)

How to Get a SadCaptcha API Key

If TikTok shows CAPTCHAs (common with heavy scraping), SadCaptcha solves them automatically:

1. Go to sadcaptcha.com
2. Sign up and get an API key
3. Add it to the sadCaptchaApiKey input field

Output Format

Each product is returned as a JSON object:

{
  "productId": "1234567890",
  "title": "Wireless Bluetooth Earbuds TWS",
  "url": "https://shop.tiktok.com/view/product/1234567890",
  "price": "USD 12.99",
  "priceNumeric": 12.99,
  "originalPrice": "USD 24.99",
  "discountPercent": 48,
  "currency": "USD",
  "rating": 4.7,
  "reviewCount": 2341,
  "soldCount": 45000,
  "inStock": true,
  "category": "Electronics",
  "description": "High quality wireless earbuds with noise cancellation...",
  "images": [
    "https://p16-oec-ttp.tiktokcdn-us.com/image.jpg"
  ],
  "seller": {
    "name": "TechDirect Official",
    "url": "https://shop.tiktok.com/@techdirect",
    "rating": 4.8
  },
  "region": "US",
  "scrapedAt": "2026-03-18T12:00:00.000Z"
}

Pricing

Pay-per-event pricing:

• $0.05 per product scraped
• Demo mode: free (no charges)

Troubleshooting

"No products found"

1. Add session cookies — TikTok Shop often requires authentication
2. Use residential proxies — set proxyConfiguration with RESIDENTIAL group
3. Enable Camoufox — set useCamoufox: true
4. Add SadCaptcha — if you see CAPTCHA errors in logs
5. Enable Firecrawl — as a last resort fallback

"CAPTCHA detected"

Add your SadCaptcha API key:

{
  "sadCaptchaApiKey": "your-key-here"
}

"Rate limited / blocked"

• Use residential proxies (not datacenter)
• Reduce maxProducts to 20-30
• Add session cookies from a real browser session
• Enable Camoufox stealth browser

Versions

• V4 (current) — Multi-strategy scraper with Camoufox + SadCaptcha + Firecrawl
• V1-V3 — Deprecated. Do not use.

Support

Report issues at github.com/johnrippy1980/local-seo