Tiktok Discover Scraper

Tiktok Discover Scraper

Tiktok Discover Scraper is a purpose-built Apify actor that collects public TikTok videos and trend data from the Discover and Tag pages for your keywords and hashtags. It solves the manual effort of researching the Discover tab by automatically extracting structured video, author, music, and engagement metrics — ideal for marketers, developers, data analysts, and researchers. This tiktok discover scraper lets you scrape TikTok Discover page results at scale, monitor hashtag trends, and power dashboards, reports, or automations with clean JSON — enabling trend analysis and content planning at scale.

What data / output can you get?

Below are real fields the actor pushes to the Apify dataset. You can export results to JSON, CSV, or Excel.

Data type	Description	Example value
id	Unique TikTok video ID	"7251234567890123456"
text	Video caption text	"Unbelievable goal! #football"
createTime	Unix timestamp (seconds)	1743664875
createTimeISO	ISO-8601 UTC timestamp	"2026-04-03T07:21:15Z"
webVideoUrl	Public video URL on TikTok	"https://www.tiktok.com/@user123/video/7251234567890123456"
authorMeta.name	Author’s unique handle	"user123"
authorMeta.nickName	Author’s display name	"User 123"
authorMeta.fans	Follower count	154200
musicMeta.musicName	Sound title	"original sound"
videoMeta.duration	Video duration in seconds	15
playCount	Views	238410
diggCount	Likes	18342
commentCount	Comments	421
shareCount	Shares	97
hashtags[].name	Hashtag/title from challenges	"football"
mediaUrls[]	Direct media URL(s) if available	["https://.../video.mp4"]
discoveryInfo.url	Source Discover URL	"https://www.tiktok.com/discover/football"
hashtag	The input keyword/hashtag for this record	"football"
count	Incremental counter per input (live)	12

Bonus metadata includes:

• authorMeta (id, verified, signature, avatar, privateAccount, following, fans, heart, video, digg)
• musicMeta (musicAuthor, playUrl, coverMediumUrl, musicId, musicOriginal, musicAlbum)
• videoMeta (height, width, coverUrl, originalCoverUrl, definition, format, originalDownloadAddr, downloadAddr, subtitleUrls[], slideshowImages[])
• flags like isAd, isMuted, isSlideshow, isPinned
• input echo and discoveryInfo (breadcrumbs, relatedTags, tag, type)

Key features

• ⚡ Bold Discover + Tag coverage
  Starts at https://www.tiktok.com/discover/{keyword} and automatically falls back to https://www.tiktok.com/tag/{keyword} to maximize yield for your tiktok discover data extractor and tiktok discover crawler workflows.

• 🔁 Real-time dataset streaming
  Each item is pushed as soon as it’s found, enabling live updates in the Apify dataset — perfect for monitoring tiktok trending topics scraper jobs as they run.

• 🧭 Smart pagination & response interception
  Intercepts TikTok web APIs, handles hasMore/cursor, and augments scrolling with direct API requests for deeper coverage — a reliable tiktok discover web scraper approach that taps into the “tiktok discover api” responses exposed in the browser.

• 🛡️ Automatic proxy fallback logic
  Starts with no proxy by default. On rejections, it falls back to datacenter, then residential proxies, retrying up to 3 times on residential and sticking with it for remaining requests. Fully configurable via proxyConfiguration.

• 🧱 Clean, structured output
  Rich JSON with authorMeta, musicMeta, videoMeta, mediaUrls, engagement counts, and discoveryInfo fields — ready for analytics or a tiktok discover page scraper pipeline.

• 🧰 Developer-friendly
  Built with Playwright and Apify SDK. Access results via the Apify API and integrate into automation workflows in your preferred stack (great for tiktok discover scraper Python projects).

• 🔐 Public data only
  Scrapes publicly available Discover and Tag endpoints — no login required.

How to use Tiktok Discover Scraper - step by step

1. Sign in to Apify
   Create a free Apify account or log in.

2. Open the actor
   Find “Tiktok Discover Scraper” in the Apify Store.

3. Add input keywords/URLs
   In startUrls, enter one or more items such as:

   • Plain keyword: football
   • Hashtag (with or without #): #fashion or fashion
   • TikTok search URL: https://www.tiktok.com/search?q=football

4. Set result limits
   Configure maxItems to cap how many videos to collect per hashtag/keyword. Set to 0 for unlimited.

5. Configure proxy (optional)
   If you encounter blocks, set proxyConfiguration.useApifyProxy to true. The actor automatically falls back from direct → datacenter → residential as needed.

6. Start the run
   Click Start. The actor will navigate Discover first, then Tag if needed, and push items as they’re found.

7. Monitor progress live
   Watch the dataset update in real time (fields include hashtag and count for easy per-keyword tracking).

8. Export results
   Download your dataset in JSON/CSV/Excel or access it via the Apify API for downstream pipelines.

Pro tip: Schedule this tiktok discover trends scraper to run daily and feed your dashboards or data warehouse with fresh Discover insights.

Use cases

Use case name	Description
Marketing + trend monitoring	Track emerging topics and collect engagement metrics to inform campaigns and editorial calendars.
Social listening for hashtags	Monitor hashtag performance over time and export structured metrics for reporting with a tiktok trending hashtag scraper workflow.
Creator and content analysis	Analyze authorMeta and engagement to spot rising creators within a niche.
Data analytics pipeline	Use the Apify API to pull JSON into BI tools for ongoing TikTok trends scraping.
Academic & market research	Collect structured, reproducible datasets from public TikTok Discover/Tag endpoints.
Automation & enrichment	Orchestrate this tiktok discover page scraper with Make/Zapier/n8n via the Apify API for end-to-end workflows.

Why choose Tiktok Discover Scraper?

Built for precision and reliability, this tiktok discover web scraper focuses on clean output, resilient collection, and developer-grade control.

• 🎯 Accurate, structured fields
  Consistent JSON with authorMeta, musicMeta, videoMeta, engagement counts, and discoveryInfo — ready for analytics.

• 🔄 Discover + Tag fallback
  Starts with Discover and seamlessly pivots to Tag to maximize recall across your keywords/hashtags.

• 🛡️ Robust proxy strategy
  Automatic fallback from direct to datacenter to residential with controlled retries to minimize blocks.

• ⚙️ Automation-ready
  Run manually or schedule jobs, then export to JSON/CSV/Excel or consume via Apify’s API.

• 🧪 Production-grade Playwright runner
  Headless Chromium + response interception ensures a stable tiktok discover crawler for recurring workloads.

• 🔒 Public endpoints only
  No login or cookies required; focuses on publicly accessible discover search data.

In short, it’s a production-ready tiktok discover scraper that outperforms fragile browser extensions and ad‑hoc scripts.

Is it legal / ethical to use Tiktok Discover Scraper?

Yes — when done responsibly. This actor collects publicly available data from TikTok’s Discover and Tag pages and does not access private or authenticated content.

Guidelines for compliant use:

• Scrape only public pages and data
• Review and respect TikTok’s Terms of Service
• Follow relevant privacy regulations (e.g., GDPR, CCPA)
• Use data ethically and consult your legal team for edge cases

Input parameters & output format

JSON input example

{
  "startUrls": [
    "football",
    "https://www.tiktok.com/search?q=street%20style",
    "#travel"
  ],
  "maxItems": 25,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

Field reference:

• startUrls (array) — List one or more TikTok URLs (e.g., https://www.tiktok.com/search?q=hashtag), usernames (e.g., username), or keywords/hashtags (e.g., #hashtag or hashtag). Supports bulk input. Required: yes. Default: none.
• maxItems (integer) — Maximum number of videos to collect per hashtag/keyword. Leave empty or set to 0 for unlimited. Required: no. Default: 10. Min: 0. Max: 500.
• proxyConfiguration (object) — By default no proxy is used. If TikTok rejects or blocks requests, the actor fallbacks to datacenter proxy, then to residential proxy (and sticks with residential for remaining requests). Residential is retried 3 times before giving up. Required: no. Default: {"useApifyProxy": false}.

JSON output example

Each dataset item contains the input hashtag/keyword context, counters, and the full transformed TikTok video object.

{
  "hashtag": "football",
  "count": 12,
  "id": "7251234567890123456",
  "text": "Unbelievable goal! #football",
  "createTime": 1743664875,
  "createTimeISO": "2026-04-03T07:21:15Z",
  "isAd": false,
  "isMuted": false,
  "authorMeta": {
    "id": "7031122334455667788",
    "name": "user123",
    "nickName": "User 123",
    "verified": false,
    "signature": "Sports highlights",
    "bioLink": null,
    "avatar": "https://.../avatar.jpg",
    "privateAccount": false,
    "following": 321,
    "fans": 154200,
    "heart": 2031540,
    "video": 482,
    "digg": 9231
  },
  "musicMeta": {
    "musicName": "original sound",
    "musicAuthor": "user123",
    "musicOriginal": true,
    "musicAlbum": "",
    "playUrl": "https://.../music.mp3",
    "coverMediumUrl": "https://.../cover.jpg",
    "musicId": "7230099887766554433"
  },
  "webVideoUrl": "https://www.tiktok.com/@user123/video/7251234567890123456",
  "mediaUrls": [
    "https://.../video.mp4"
  ],
  "videoMeta": {
    "height": 1024,
    "width": 576,
    "duration": 15,
    "coverUrl": "https://.../cover.webp",
    "originalCoverUrl": "https://.../origin-cover.webp",
    "definition": "540p",
    "format": "mp4",
    "originalDownloadAddr": "https://.../download.mp4",
    "downloadAddr": "https://.../download.mp4",
    "subtitleUrls": [],
    "slideshowImages": []
  },
  "diggCount": 18342,
  "shareCount": 97,
  "playCount": 238410,
  "collectCount": 512,
  "commentCount": 421,
  "mentions": [],
  "hashtags": [
    {
      "id": "1653275727519749",
      "name": "football",
      "title": "",
      "cover": ""
    }
  ],
  "effectStickers": [],
  "isSlideshow": false,
  "isPinned": false,
  "input": "football",
  "discoveryInfo": {
    "breadcrumbs": [],
    "relatedTags": [],
    "url": "https://www.tiktok.com/discover/football",
    "tag": "football",
    "type": "discover"
  }
}

Note: Some nested fields (e.g., subtitleUrls, slideshowImages) may be empty if not present in the source data.

FAQ

Is there a free TikTok discover scraper option?

Yes. You can start on Apify with trial resources and run the actor to evaluate results before upgrading. Exports are available from the dataset in standard formats.

Do I need to log in to scrape TikTok Discover?

No. The actor targets publicly available Discover and Tag pages and does not require login or cookies.

Can I use it to scrape TikTok discover search results and hashtags?

Yes. Provide keywords/hashtags in startUrls (e.g., “fashion”, “#travel”, or a search URL), and the actor will collect public videos related to those terms from Discover and Tag endpoints.

What fields does the TikTok discover data extractor return?

The output includes video identifiers and metadata (id, text, createTime, createTimeISO), authorMeta, musicMeta, videoMeta, engagement metrics (playCount, diggCount, shareCount, commentCount, collectCount), mediaUrls, hashtags, and discoveryInfo, plus context fields hashtag and count.

How many results can I collect per keyword?

Use maxItems to control volume per keyword/hashtag. Set it to 0 for unlimited. The actor handles scrolling, response interception, and cursor pagination to maximize coverage.

Does it support API or Python integration?

Yes. Runs on Apify and stores results in a dataset you can access via the Apify API. This makes it easy to plug into Python scripts or automation tools for a tiktok discover automation pipeline.

How does the scraper handle blocking?

By default, it runs without a proxy. If TikTok rejects requests, it automatically falls back to datacenter, then residential proxies, retrying residential up to 3 times and sticking with it for subsequent requests.

Is using this TikTok discover crawler legal?

Yes — when you collect only public data and follow platform terms and applicable regulations. Always ensure your use complies with TikTok’s Terms of Service and relevant privacy laws.

Closing CTA / Final thoughts

Tiktok Discover Scraper is built to extract clean, structured TikTok Discover and Tag data at scale. With smart endpoint fallback, resilient proxy handling, and rich JSON output, it empowers marketers, analysts, and developers to track trends and measure engagement without manual effort. Access results via the Apify UI or API, schedule recurring jobs, and wire this tiktok discover page scraper into your automation stack. Start extracting smarter TikTok insights today.