Toynk Product Scraper

Extract normalized products from Toynk's public Shopify catalogue into the Apify default dataset. The Actor uses direct HTTP requests by default and does not require login or browser automation.

Run locally with Python 3.11+:

$PYTHONPATH=src python3 -m toynk_scraper.cli --input input.json --output dataset.jsonl

In Apify, provide the same JSON object as Actor input. Each dataset item has id, name, brand, price, currency, category, available, image, and url.

Example input:

{
  "collections": ["all"],
  "queries": [],
  "available": true,
  "maxItems": 100,
  "proxyConfiguration": {"proxyUrls": []}
}

collections contains Shopify collection handles. queries contains case-insensitive terms matched against product title, vendor, type, tags, and description while paging the public catalogue. Sources can be combined; products are deduplicated by Shopify product ID. available can be true, false, or null (no filter). Direct access is the default; when supplied, the first HTTP(S) proxyUrls entry is honored.

Each output line is a JSON object with id, name, brand, price, currency, category, available, image, and url. A successfully flushed line is the platform-neutral persistence signal that Deploy maps to one apify-default-dataset-item charge. Actor-start charging and default-dataset integration are Apify-owned deployment concerns.

The Actor scans public Shopify JSON feeds, paginates in batches, filters availability, and deduplicates products across collections and queries. Query matching is literal case-insensitive substring matching across product title, brand, type, tags, and description. Only the first configured proxy URL is used when proxyConfiguration.proxyUrls is supplied.