TikTok User Profile Scraper

Scrapes public TikTok user profiles and outputs structured JSON (same shape as parsing webapp.user-detail from __UNIVERSAL_DATA_FOR_REHYDRATION__).

Input

The Console form is grouped into sections (usernames → user IDs → URLs → proxy & performance). JSON keys:

Key	Description
usernames	Handles (@name or name), bulk list.
userIds	Numeric TikTok IDs as strings, bulk list.
urls	Full profile URLs.
proxyConfiguration	Apify Proxy; set useApifyProxy to false for direct-only (no fallback).
requestGapMs	Delay between jobs (default 750).
maxRetries	Per-fetch retries on network errors (default 3).

Provide at least one entry across usernames, userIds, or urls.

Local runs

Input is not stored in the repo. On Apify, use the task/input UI. Locally, set APIFY_LOCAL_STORAGE_DIR to a folder whose default key-value store contains INPUT.json (for example storage/key_value_stores/default/INPUT.json after apify run or your own copy). Running python -m src without that file yields empty input.

Behaviour

1. Direct HTTPS to TikTok (no proxy) first.
2. If blocked or incomplete HTML, datacenter Apify proxy (if enabled).
3. Then residential proxy, up to 3 attempts per URL.
4. After the first successful fetch via residential, all following jobs use residential only.
5. Results are deduplicated by unique_id (first occurrence wins), then pushed to the dataset.

Optional src/require.json / src/profile_overlay.json in the image can fill sparse fields (same as the standalone extractor).

Output

One dataset item per unique profile — fields include uid, unique_id, nickname, stats, avatars, share_info, biz_account_info, etc.

Legal

Data is taken from publicly visible pages only. You are responsible for compliance with TikTok’s terms and applicable law.