Tiktok Discover Scraper

Tiktok Discover Scraper

Tiktok Discover Scraper is an Apify actor that collects TikTok Discover and hashtag/tag page results for your keywords, extracting videos with engagement metrics, author profiles, and music metadata — fast. This TikTok Discover scraper tool solves the manual effort of tracking trends by letting you scrape TikTok Discover page results programmatically. It’s built for marketers, developers, data analysts, and researchers who need a TikTok trends scraper for content strategy, social listening, and reporting at scale. With automation-ready workflows, this TikTok Discover API scraper enables repeatable, high-volume extraction for hashtags, search topics, and popular videos.

What data / output can you get?

Below are real fields the actor outputs to the Apify dataset for each discovered video. You can export results to JSON, CSV, or Excel from the dataset.

Data type	Description	Example value
id	Unique TikTok video ID	"7574074787564178709"
text	Video caption/description	"Video caption text..."
createTime	Unix timestamp (seconds)	1710000000
createTimeISO	ISO-8601 UTC timestamp	"2024-03-09T12:00:00Z"
webVideoUrl	Public web URL to the video	"https://www.tiktok.com/@its_nirob.11/video/7574074787564178709"
mediaUrls	Direct media/playback URLs (if available)	["https://v16-webapp-prime.tiktok.com/video/..."]
authorMeta.name	Author’s unique handle	"its_nirob.11"
authorMeta.fans	Author follower count	54700
musicMeta.musicName	Music/sound title	"original sound"
videoMeta.duration	Video duration (seconds)	19
diggCount	Like count	39900
playCount	View count	471300
shareCount	Share count	2031
commentCount	Comment count	595
hashtags[].name	Hashtags detected from challenges	"hamzachoudhury"
isAd	Whether the item is an ad	false
isSlideshow	Whether the item is an image slideshow	false
input	The input keyword/hashtag you searched for	"football"
discoveryInfo.url	Source Discover URL	"https://www.tiktok.com/discover/football"

Bonus metadata includes complete authorMeta (avatar, verification, follower metrics), musicMeta (author, original flag, cover art), and videoMeta (height, width, covers, definition, subtitle URLs, slideshow images). This TikTok Discover data extractor is ideal for dashboards, analytics, and pipelines that need structured fields.

Key features

• ⚡ Bold trend capture from Discover & Tags – Scrapes both /discover/{keyword} and /tag/{hashtag} endpoints to maximize coverage of TikTok Discover feed scraper results for each search term.
• 🔄 Real-time dataset streaming – Each new item is pushed to the dataset immediately, enabling live table updates and faster iteration for your TikTok Discover crawler workflows.
• 🧠 Smart deduplication – Prevents duplicate videos using an in-memory ID set, keeping your TikTok popular videos scraper output clean and analytics-ready.
• 🧭 Cursor-based pagination – Leverages captured API responses (including /api/recommend/item_list/) to continue fetching when hasMore is true, improving depth for your TikTok trending topics scraper runs.
• 🧱 Proxy fallback resilience – Starts with no proxy, auto-falls back to datacenter, then residential proxies (with retries) if TikTok blocks requests — and sticks with residential once used for reliability.
• 🧪 Headless Chromium + Playwright – Production-grade browser automation ensures robust extraction for your TikTok Discover automation tool without manual intervention.
• 📦 Flexible exports & API access – Download results as JSON/CSV/Excel from the Apify dataset or access them programmatically via the Apify API for downstream integrations.
• 🐍 Developer-friendly foundation – Built in Python with Playwright and the Apify SDK, making it a practical TikTok Discover scraper Python option for data engineers and ML teams.

How to use Tiktok Discover Scraper - step by step

1. Create or log in to your Apify account.
2. Open the “Tiktok Discover Scraper” actor in the Apify Console.
3. Add input data in startUrls:
   • Enter TikTok URLs like https://www.tiktok.com/search?q=football
   • Or enter plain keywords/usernames/hashtags like Cristiano Ronaldo, football, or #hashtag (the # is optional)
4. Set maxItems:
   • Choose how many videos to collect per hashtag/keyword (0 for unlimited; up to 500).
5. Configure proxyConfiguration (optional):
   • By default no proxy is used. If TikTok blocks requests, the actor will automatically fall back to datacenter, then residential proxies with retries.
6. Start the run:
   • Click “Start”. The actor navigates Discover first, then tries the tag endpoint as needed, pushing items in real time.
7. Monitor progress:
   • Watch the run logs and the Dataset tab as records stream in live with fields like id, text, playCount, authorMeta, and musicMeta.
8. Export results:
   • Go to the Dataset and export to JSON, CSV, or Excel, or fetch via the Apify API for automation.

Pro tip: Schedule this TikTok search trends scraper daily to track shifts in hashtags, sounds, and engagement automatically. Connect the dataset to your BI tool or a Python pipeline for ongoing analysis.

Use cases

Use case	Description
Marketing trend tracking	Monitor emerging hashtags and topics to inform campaigns and media planning with a reliable TikTok trending hashtags scraper.
Content planning	Build content calendars around high-engagement results gathered by your TikTok Discover feed scraper.
Social listening & reporting	Analyze playCount, diggCount, and shareCount to understand audience behavior around search topics.
Influencer scouting	Identify creators behind top-performing videos using authorMeta (followers, nickname, verification).
Hashtag performance analysis	Compare engagement across keywords to prioritize content themes and track trend lifecycles.
Music/sound research	Use musicMeta to spot trending sounds and audio patterns for creative optimization with a TikTok trending sounds scraper workflow.
Data engineering pipelines	Integrate this TikTok Discover API scraper into ETL jobs, export to CSV/JSON, and feed dashboards or ML models.
Academic & market research	Collect structured, public Discover/tag data to study diffusion of topics and media dynamics.

Why choose Tiktok Discover Scraper?

This actor delivers precision, automation, and reliability for Discover-based trend intelligence — without fragile browser extensions.

• ✅ Accurate, structured fields: Video, author, and music metadata are normalized for analytics-ready output.
• 🌱 Scales with your needs: Collect up to 500 videos per keyword per run (or 0 for unlimited) with pagination and deduplication.
• 🐍 Developer access: Built with Python and Apify SDK; export via API for integration into your data stack.
• 🛡️ Safe-by-design: Targets public Discover and tag pages — no login or cookies required.
• 🔀 Robust proxy handling: Automatic fallback from direct → datacenter → residential with retries if TikTok rejects requests.
• 💾 Flexible exports: Pull results from the dataset as JSON, CSV, or Excel for downstream tools.
• 🧩 Better than extensions: Headless Playwright + proxy control outperforms unstable, manual browser add-ons.

Bottom line: a production-ready TikTok Discover crawler that turns public Discover/tag pages into clean, analyzable data.

Is it legal / ethical to use Tiktok Discover Scraper?

Yes — when done responsibly. This actor is designed to collect publicly available information from TikTok Discover and tag pages.

Guidelines for compliant use:

• Scrape only public data and avoid private or authenticated content.
• Review and respect TikTok’s Terms of Service.
• Ensure your usage complies with applicable regulations (e.g., GDPR, CCPA).
• Use the data ethically and verify edge cases with your legal team.

Input parameters & output format

JSON input example

{
  "startUrls": [
    "Cristiano Ronaldo",
    "football",
    "https://www.tiktok.com/search?q=football"
  ],
  "maxItems": 10,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Parameters

• startUrls (array, required): List one or more TikTok URLs (e.g., https://www.tiktok.com/search?q=hashtag), usernames (e.g., username), or keywords/hashtags (e.g., #hashtag or hashtag). Supports bulk input. Default: none.
• maxItems (integer, optional): Maximum number of videos to collect per hashtag/keyword. Leave empty or set to 0 for unlimited. Range: 0–500. Default: 10.
• proxyConfiguration (object, optional): By default no proxy is used. If TikTok rejects or blocks requests, the actor fallbacks to datacenter proxy, then to residential proxy (and sticks with residential for remaining requests). Residential is retried 3 times before giving up. Default behavior: no proxy.

JSON output example

Each dataset item represents one video discovered for a given input keyword/hashtag. Records are pushed in real time during the run.

{
  "hashtag": "football",
  "count": 1,
  "id": "7574074787564178709",
  "text": "Video caption text...",
  "createTime": 1710000000,
  "createTimeISO": "2024-03-09T12:00:00Z",
  "isAd": false,
  "isMuted": false,
  "authorMeta": {
    "id": "7475549234427888641",
    "name": "its_nirob.11",
    "nickName": "nirob",
    "verified": false,
    "signature": "Account signature...",
    "bioLink": null,
    "avatar": "https://...",
    "privateAccount": false,
    "following": 162,
    "fans": 54700,
    "heart": 4700000,
    "video": 994,
    "digg": 6037
  },
  "musicMeta": {
    "musicName": "original sound",
    "musicAuthor": "creator",
    "musicOriginal": true,
    "musicAlbum": "",
    "playUrl": "https://...",
    "coverMediumUrl": "https://...",
    "musicId": "7502745955301821185"
  },
  "webVideoUrl": "https://www.tiktok.com/@its_nirob.11/video/7574074787564178709",
  "mediaUrls": [
    "https://v16-webapp-prime.tiktok.com/video/..."
  ],
  "videoMeta": {
    "height": 576,
    "width": 768,
    "duration": 19,
    "coverUrl": "https://...",
    "originalCoverUrl": "https://...",
    "definition": "540p",
    "format": "mp4",
    "originalDownloadAddr": "https://...",
    "downloadAddr": "https://...",
    "subtitleUrls": [],
    "slideshowImages": []
  },
  "diggCount": 39900,
  "shareCount": 2031,
  "playCount": 471300,
  "collectCount": 1776,
  "commentCount": 595,
  "mentions": [],
  "hashtags": [
    {
      "id": "1653275727519749",
      "name": "hamzachoudhury",
      "title": "",
      "cover": ""
    }
  ],
  "effectStickers": [],
  "isSlideshow": false,
  "isPinned": false,
  "input": "football",
  "discoveryInfo": {
    "breadcrumbs": [],
    "relatedTags": [],
    "url": "https://www.tiktok.com/discover/football",
    "tag": "football",
    "type": "discover"
  }
}

Notes

• Some fields may be empty or null depending on availability (e.g., bioLink, subtitleUrls, slideshowImages).
• The count field increments per input keyword/hashtag to reflect streaming order.
• Use the Apify dataset to export to JSON, CSV, or Excel, or access records via the Apify API.

FAQ

Is there a free trial?

Yes. You can try the actor on Apify with trial minutes (the listing currently includes 120 trial minutes), which is great for testing small jobs before scaling.

Do I need to log in to TikTok or provide cookies?

No. The actor targets public TikTok Discover and tag pages and runs headless without login. It does not access private or authenticated content.

How many results can I scrape per keyword?

You control this with maxItems. Set a value from 1 to 500, or set 0 for unlimited. The actor also uses pagination when available to retrieve more items.

What inputs are accepted?

Provide a list of TikTok URLs, usernames, or keywords/hashtags in startUrls. Examples include plain text like "football" or a full search URL like "https://www.tiktok.com/search?q=football".

Does it support Python or API integration?

Yes. This is a TikTok Discover scraper Python actor built on the Apify SDK. You can fetch results via the Apify API and integrate with your pipelines or notebooks.

How does proxy management work?

By default no proxy is used. If TikTok blocks requests, the actor automatically falls back to a datacenter proxy; if needed, it then switches to a residential proxy and retries (up to 3 times), sticking with residential for remaining requests.

What data fields are included in the output?

Each record includes video identifiers and links (id, webVideoUrl), engagement metrics (playCount, diggCount, shareCount, commentCount, collectCount), authorMeta, musicMeta, videoMeta, hashtags, and source context (input, discoveryInfo).

Can this scrape trending sounds or hashtags?

It extracts musicMeta for each video (e.g., musicName, musicAuthor, musicOriginal) and includes hashtags from challenges, making it effective as a TikTok trending sounds scraper and hashtag trends extractor within the context of Discover/tag results.

Final thoughts

Tiktok Discover Scraper is built to turn TikTok Discover and tag pages into structured, analytics-ready data. With real-time streaming, proxy fallback, and clean JSON output, it empowers marketers, developers, analysts, and researchers to track trends, evaluate engagement, and power dashboards or ML models. Start a run in the Apify Console, export to CSV/JSON, or connect via the Apify API to automate your TikTok Discover automation tool pipeline and start extracting smarter insights today.