Lemon8 Media Scraper

Lightweight scraper that extracts image and video URLs from Lemon8 posts. Focused on media extraction only - no comments, no post details, just clean media URLs.

Features

• Image Extraction - Get all image URLs from posts
• Video Extraction - Extract video URLs from video posts
• Search Discovery - Find posts by keyword search
• Direct URLs - Scrape specific post URLs
• High Quality - Auto-convert thumbnails to high-quality URLs
• Media Download - Optional download to Apify key-value store
• Two Input Modes - Specific post URLs or a keyword search
• Multiple Regions - Support for 10+ countries
• Reliable Access - Smart proxy rotation with automatic fallback

Send results into your apps (MCP connectors)

Optionally pipe the scraped results into the apps you already use, via Model Context Protocol (MCP) connectors. This is an extra delivery step after the scrape — the Apify dataset is never changed.

What gets written to the connector: a condensed, human-readable summary of each record — not the full JSON. Each item becomes one entry with a title and its key fields flattened to plain text. The complete record always stays in the Apify dataset.

1. Authorize a connector once under Apify → Settings → Integrations (Notion, Linear, Airtable, or Apify).
2. Select it in the "Pipe results into your apps" input field. (If the picker is empty, you haven't authorized a connector yet.)
3. For Notion, also set notionParentPageUrl to the page where items should be created.

The connection is mediated by Apify's MCP proxy, so this actor never sees your third-party credentials. Leave the field empty to skip.

Output Data

Each post is saved as a separate item in the dataset:

{
  "postId": "7543408422994264589",
  "postUrl": "https://www.lemon8-app.com/@username/7543408422994264589?region=us",
  "images": [
    {
      "url": "https://p16-lemon8-sign-va.tiktokcdn.com/tos-maliva-v-ac5634-us/...",
      "alt": "Post image description",
      "type": "image"
    }
  ],
  "videos": [],
  "imageCount": 5,
  "videoCount": 0
}

With Media Download Enabled

When downloadMedia: true, each media item includes a keystoreKey:

{
  "postId": "7543408422994264589",
  "images": [
    {
      "url": "https://p16-lemon8-sign-va.tiktokcdn.com/...",
      "alt": "Post image",
      "type": "image",
      "keystoreKey": "7543408422994264589_img_0.webp"
    }
  ],
  "videos": [
    {
      "url": "https://v16-lemon8.tiktokcdn.com/...",
      "poster": "https://p16-lemon8-sign-va.tiktokcdn.com/...",
      "type": "video",
      "keystoreKey": "7543408422994264589_vid_0.mp4"
    }
  ],
  "imageCount": 1,
  "videoCount": 1
}

Input Options

Option	Type	Default	Description
postUrls	Array	[]	Direct post URLs to scrape (overrides searchTerm)
searchTerm	String	"fashion"	Search keyword for discovery page
region	String	"us"	Region code
limit	Number	2	Maximum posts to process (1-100)
saveImages	Boolean	true	Extract image URLs
saveVideos	Boolean	true	Extract video URLs
downloadMedia	Boolean	false	Download files to key-value store
highQuality	Boolean	true	Convert to high-quality URLs
maxScrolls	Number	2	Max scrolls on discovery (1-30)
scrollDelay	Number	1000	Delay between scrolls in ms
clearStorage	Boolean	false	Clear request queue and start fresh
proxy	Object	null	Apify proxy configuration

Example: Search Discovery

{
  "searchTerm": "fashion",
  "region": "us",
  "limit": 20,
  "saveImages": true,
  "saveVideos": true,
  "downloadMedia": false
}

Example: Direct Post URLs

{
  "postUrls": [
    "https://www.lemon8-app.com/@username/7543408422994264589",
    "https://www.lemon8-app.com/@another/7550145067198005791"
  ],
  "downloadMedia": true
}

Available Regions

Code	Region
us	United States
au	Australia
nz	New Zealand
jp	Japan
th	Thailand
id	Indonesia
vn	Vietnam
my	Malaysia
sg	Singapore
ca	Canada

Crash Recovery & Rerun

This actor uses Apify's Request Queue for state persistence:

• Resume after crash: Simply Resurrect the failed run - it will continue from unprocessed posts
• Start fresh: Set clearStorage: true in input, or start a new run (not resurrect)

How it works:

1. All post URLs are added to a persistent Request Queue before processing
2. Each post is marked as "handled" only after successful extraction
3. Each post is saved to the dataset immediately (incremental saves)
4. On restart, only unhandled requests are processed

Storage

Key-Value Store

• INPUT - Run configuration
• OUTPUT - Complete results with all media
• METADATA - Run statistics (totalPosts, totalImages, totalVideos, downloadedFiles)
• {postId}_img_{index}.webp - Downloaded images (if enabled)
• {postId}_vid_{index}.mp4 - Downloaded videos (if enabled)

Dataset

Each post saved as a separate item for easy export and processing.

Accessing Downloaded Files

https://api.apify.com/v2/key-value-stores/{storeId}/records/{keystoreKey}

Use Cases

• Content Archiving - Save media from posts before they disappear
• Dataset Building - Collect images for ML training data
• Visual Analysis - Analyze trending visual styles and formats
• Competitor Research - Monitor competitor visual content
• Content Inspiration - Discover popular image styles