Lemon8 Media Scraper

Lightweight scraper that extracts image and video URLs from Lemon8 posts. Focused on media extraction only - no comments, no post details, just clean media URLs.

Features

• Image Extraction - Get all image URLs from posts
• Video Extraction - Extract video URLs from video posts
• Search Discovery - Find posts by keyword search
• Direct URLs - Scrape specific post URLs
• High Quality - Auto-convert thumbnails to high-quality URLs
• Media Download - Optional download to Apify key-value store
• Crash Recovery - Resume from where you left off if interrupted
• Multiple Regions - Support for 10+ countries
• Stealth Browser - Uses Camoufox to avoid detection

Output Data

Each post is saved as a separate item in the dataset:

{
  "postId": "7543408422994264589",
  "postUrl": "https://www.lemon8-app.com/@username/7543408422994264589?region=us",
  "images": [
    {
      "url": "https://p16-lemon8-sign-va.tiktokcdn.com/tos-maliva-v-ac5634-us/...",
      "alt": "Post image description",
      "type": "image"
    }
  ],
  "videos": [],
  "imageCount": 5,
  "videoCount": 0
}

With Media Download Enabled

When downloadMedia: true, each media item includes a keystoreKey:

{
  "postId": "7543408422994264589",
  "images": [
    {
      "url": "https://p16-lemon8-sign-va.tiktokcdn.com/...",
      "alt": "Post image",
      "type": "image",
      "keystoreKey": "7543408422994264589_img_0.webp"
    }
  ],
  "videos": [
    {
      "url": "https://v16-lemon8.tiktokcdn.com/...",
      "poster": "https://p16-lemon8-sign-va.tiktokcdn.com/...",
      "type": "video",
      "keystoreKey": "7543408422994264589_vid_0.mp4"
    }
  ],
  "imageCount": 1,
  "videoCount": 1
}

Input Options

Option	Type	Default	Description
postUrls	Array	[]	Direct post URLs to scrape (overrides searchTerm)
searchTerm	String	"fashion"	Search keyword for discovery page
region	String	"us"	Region code
limit	Number	2	Maximum posts to process (1-100)
saveImages	Boolean	true	Extract image URLs
saveVideos	Boolean	true	Extract video URLs
downloadMedia	Boolean	false	Download files to key-value store
highQuality	Boolean	true	Convert to high-quality URLs
maxScrolls	Number	2	Max scrolls on discovery (1-30)
scrollDelay	Number	1000	Delay between scrolls in ms
clearStorage	Boolean	false	Clear request queue and start fresh
proxy	Object	null	Apify proxy configuration

Example: Search Discovery

{
  "searchTerm": "fashion",
  "region": "us",
  "limit": 20,
  "saveImages": true,
  "saveVideos": true,
  "downloadMedia": false
}

Example: Direct Post URLs

{
  "postUrls": [
    "https://www.lemon8-app.com/@username/7543408422994264589",
    "https://www.lemon8-app.com/@another/7550145067198005791"
  ],
  "downloadMedia": true
}

Available Regions

Code	Region
us	United States
au	Australia
nz	New Zealand
jp	Japan
th	Thailand
id	Indonesia
vn	Vietnam
my	Malaysia
sg	Singapore
ca	Canada

Crash Recovery & Rerun

This actor uses Apify's Request Queue for state persistence:

• Resume after crash: Simply Resurrect the failed run - it will continue from unprocessed posts
• Start fresh: Set clearStorage: true in input, or start a new run (not resurrect)

How it works:

1. All post URLs are added to a persistent Request Queue before processing
2. Each post is marked as "handled" only after successful extraction
3. Each post is saved to the dataset immediately (incremental saves)
4. On restart, only unhandled requests are processed

Storage

Key-Value Store

• INPUT - Run configuration
• OUTPUT - Complete results with all media
• METADATA - Run statistics (totalPosts, totalImages, totalVideos, downloadedFiles)
• {postId}_img_{index}.webp - Downloaded images (if enabled)
• {postId}_vid_{index}.mp4 - Downloaded videos (if enabled)

Dataset

Each post saved as a separate item for easy export and processing.

Accessing Downloaded Files

https://api.apify.com/v2/key-value-stores/{storeId}/records/{keystoreKey}

Use Cases

• Content Archiving - Save media from posts before they disappear
• Dataset Building - Collect images for ML training data
• Visual Analysis - Analyze trending visual styles and formats
• Competitor Research - Monitor competitor visual content
• Content Inspiration - Discover popular image styles