Universal Social Media & Video Insights Harvester 🚀

All-in-one harvester for Instagram, TikTok, YouTube, Reddit, and Twitter/X posts. Extracts views, likes, comments, captions, creator handles, and direct media URLs without needing 5 separate scrapers.

⚡ Try it in 1-Click: Click the Run or Try for Free button on the right to test this Actor immediately with pre-configured parameters. No technical setup, passwords, or API keys required! 🎁 Free Starter Allowance: Test runs cost less than a fraction of a cent ($0.0001 container fee) so you can run test queries risk-free with your monthly Apify starter credits.

---

⚡ 1-Click API Quick-Start (cURL / Python / Dify / FastGPT / Coze)

Run directly via HTTP API without opening the browser form (支持直接通过 API 调用，无缝接入 Dify、Coze、FastGPT 与自动化脚本):

# 1-Click cURL Instant Run (Replace YOUR_APIFY_TOKEN)
curl -X POST "https://api.apify.com/v2/acts/trusted_tech_spot~universal-social-media-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{}'

---

🌟 Why Choose This Actor?

📊 No-Code Instant Export: Download your clean extracted data directly into Excel (.xlsx), CSV, JSON, or sync directly to Google Sheets with 1 click right from the Apify Console dataset tab. No coding required!

• ⚡ High-Speed & Resilient Extraction: Engineered with intelligent rate adaptation and defensive fallbacks to eliminate downtime or captchas.
• 💰 Predictable Pay-Per-Result Pricing: Only pay for the actual records extracted. Never pay for actor startup overhead, cold starts, or container idle seconds.
• 🧠 AI & RAG Ready: Seamlessly feeds vector databases (Pinecone, Qdrant, ChromaDB, Weaviate) and LLM agents with pre-calculated OpenAI token counts and semantic chunking.
• 🎯 Native Keyword Filtering: Target exact records automatically with includeKeywords and excludeKeywords without client-side post-processing.
• 📊 Instant Multi-Format Export: One-click download into JSON, CSV, Excel, XML, or HTML Table directly from Apify Console or API.

---

💡 国内/跨境电商用户快速上手 (Quick Guide for China & Cross-Border Teams):

1. 本工具已内置自动抗封锁与动态解析，无需配置任何国外代理 (No Proxy Needed)，亦无需提供个人手机号或 Cookie 凭据。
2. 点击右侧或上方 "Run" 或 "Try for free"，使用系统自带的预设参数即可在 2 秒内完成首批数据提取测试。
3. 支持在控制台直接导出 Excel、CSV、JSON 等全格式数据，或无缝对接 Python / Node.js API。

---

🚀 How to Run in 3 Easy Steps

1. Open the Actor: Click the Run button on the top right of this page.
2. Review or Adjust Inputs: The form is organized into clean visual sections (Primary Settings, Filtering, and AI Vector Options). Run it with default values or customize to your target.
3. Download Results: View your extracted dataset in real time and export it to Excel, CSV, or JSON.

---

📥 Input Parameters

All parameters come pre-filled with sensible defaults so you can run the Actor right away:

Parameter	Type	Required	Default / Prefill	Description
Target URL (url)	string	No	"https://www.youtube.com/watch?v=dQw4w9WgXcQ"	The public URL from Instagram, TikTok, YouTube, Reddit, or Twitter/X
Include Keywords (Filter) (includeKeywords)	string	No	""	Filter results to only include items containing these comma-separated keywords
Exclude Keywords (Filter) (excludeKeywords)	string	No	""	Filter out results containing these comma-separated keywords
Enable AI / RAG Token Chunking (enableRagEnrichment)	boolean	No	true	Automatically compute OpenAI token counts and generate semantic vector chunks for RAG pipelines
Preferred Output Format (outputFormat)	string	No	"JSON"	Format results for preferred downstream consumer (e.g. JSON, Markdown, Flat)

---

📤 Sample Output Data

Data is saved directly to the default dataset. Below is a realistic example of the structured fields returned:

{
  "url": "Sample url",
  "platform": "Sample platform",
  "title": "Sample title",
  "author": "Sample author",
  "authorUrl": "Sample authorUrl",
  "viewsCount": 42,
  "likesCount": 42,
  "commentsCount": 42,
  "mediaType": "Sample mediaType",
  "mediaUrls": [
    "Sample Record 1",
    "Sample Record 2"
  ],
  "publishedTime": "Sample publishedTime",
  "_sentimentScore": 0.25,
  "_rag": {
    "estimatedTokens": 380,
    "chunksCount": 1,
    "ingestionReady": true
  }
}

---

💻 Developer API & AI Framework Integration

Node.js (apify-client)

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({
    token: 'YOUR_APIFY_TOKEN',
});

// Run actor with pre-configured parameters
const run = await client.actor('trusted_tech_spot/universal-social-media-scraper').call();

// Fetch structured items from the dataset
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(`Extracted ${items.length} records:`, items);

Python (apify-client)

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")

# Run actor with default parameters
run = client.actor("trusted_tech_spot/universal-social-media-scraper").call()

# Fetch dataset items
items = client.dataset(run["defaultDatasetId"]).list_items().items
print(f"Extracted {len(items)} records:", items)

LangChain Vector Ingestion (AI & RAG)

from apify_client import ApifyClient
from langchain_community.vectorstores import Chroma
from langchain_openai import OpenAIEmbeddings
from langchain_core.documents import Document

# 1. Fetch pre-chunked dataset from Apify
client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("trusted_tech_spot/universal-social-media-scraper").call()
items = client.dataset(run["defaultDatasetId"]).list_items().items

# 2. Extract semantic chunks directly into LangChain documents
docs = []
for item in items:
    chunks = item.get("_rag", {}).get("chunks", [str(item)])
    for chunk in chunks:
        docs.append(Document(page_content=chunk, metadata={"source": "universal-social-media-scraper"}))

# 3. Ingest into ChromaDB / Pinecone vector store
vector_store = Chroma.from_documents(docs, OpenAIEmbeddings())
print(f"Successfully indexed {len(docs)} chunks into Vector DB!")

LlamaIndex Knowledge Ingestion

from apify_client import ApifyClient
from llama_index.core import VectorStoreIndex, Document

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("trusted_tech_spot/universal-social-media-scraper").call()
items = client.dataset(run["defaultDatasetId"]).list_items().items

# Wrap clean extracted text into LlamaIndex documents
documents = [Document(text=str(item)) for item in items]
index = VectorStoreIndex.from_documents(documents)
query_engine = index.as_query_engine()
response = query_engine.query("Summarize key findings from this extracted data")
print(response)

---

🔗 Related Automations (Social Media Trends, Creator Analytics & Global Jobs Fleet)

Explore our specialized high-speed micro-scrapers and cross-border intelligence tools from the trusted_tech_spot fleet:

• Xiaohongshu (REDnote) Posts Scraper 小红书笔记与爆款采集 (xiaohongshu-rednote-posts-trends-scraper) — Extract Xiaohongshu (REDnote) viral notes, KOL engagement metrics, and trending lifestyle tags.
• TikTok Trending Hashtags & Viral Sounds Scraper (tiktok-trending-hashtags-sounds-scraper) — Scrape viral TikTok hashtags, trending sounds, creator growth metrics, and video views.
• Remote Tech Jobs & Compensation Salary Scraper (remote-tech-jobs-salary-scraper) — Extract high-paying remote developer, AI engineer, and DevOps jobs with verified salary bands.
• TikTok Video, Audio & Profile Scraper (fast-tiktok-video-audio-scraper) — High-speed TikTok video, audio stream, author stats, and engagement extractor.
• Indeed Jobs & Salary Scraper (Remote & Contacts) (fast-indeed-jobs-scraper) — Scrape Indeed job postings, company salaries, remote roles, and hiring manager contacts.

---

💬 Technical Support & Custom Demands

Need custom extraction fields, high-volume dedicated scraping, enterprise data feeds, or encountered an edge-case?

• 🐛 Open an Issue: Open a ticket directly on the Actor Issues Tab for 24-hour engineer response.
• ✉️ Direct Email Support: Reach out directly to contact@trustedtechspot.com for custom scraping jobs, private proxy setups, or SLA contracts.
• 💡 Feature Requests: Request new export columns, filtering rules, or platform endpoints anytime.

---

🔒 Privacy & Enterprise Compliance

• No Passwords or Cookies Required: Safely executes without requesting your credentials, private tokens, or session cookies.
• Enterprise Grade Sanitization: Automatically scrubs sensitive headers and tracking parameters before saving data.