Abt Electronics Scraper

Platform-neutral asynchronous scraper for public Abt.com category, search, SKU-search and product pages. It validates input, follows pagination, optionally fetches full product details with bounded concurrency/retries/rate limiting, filters and sorts results, deduplicates by SKU or canonical URL, and emits explicit billable-event signals.

Run

Install the project in an environment that already provides Python 3.11+ dependencies, then create INPUT.json and run:

$python -m abt_scraper.main --input INPUT.json --output OUTPUT.jsonl --events EVENTS.jsonl

Example input:

{
  "query": "dishwasher",
  "categoryUrl": "https://www.abt.com/Top-Rated-Products/c/1182.html",
  "productUrls": ["https://www.abt.com/Frigidaire-Professional-Built-In-Microwave-2.2-Cu.-Ft.-in-Stainless-Steel-PMBS3080BF/p/210960.html"],
  "skus": ["PMBS3080BF"],
  "maxItems": 100,
  "brand": "Frigidaire",
  "minPrice": 100,
  "maxPrice": 2000,
  "inStock": true,
  "sortBy": "price-asc",
  "fullDetails": true,
  "concurrency": 5,
  "requestDelaySecs": 0.25,
  "memoryGb": 0.25
}

At least one of query, categoryUrl, productUrls, or skus is required. sortBy accepts relevance, price-asc, price-desc, brand-asc, or brand-desc.

Each line of OUTPUT.jsonl contains title, brand, price, currency, sku, model, mpn, availability, in_stock, images, description, dimensions, source_url, and retrieved_at. Availability is a point-in-time observation tied to the source URL and retrieval timestamp, not durable inventory truth.

EVENTS.jsonl records one apify-actor-start event (quantity is one per GB of allocated memory, minimum one) before network work and one apify-default-dataset-item event for each returned item. A Deploy adapter can map these platform-neutral signals to Apify charging and dataset operations.