Initial release. Pay-per-event Walmart search results scraper:
- Input:
searchQueries, maxProductsPerSearch, maxSearchPages, sort, maxRequestRetries, proxyConfiguration.
- Output:
usItemId, name, price, priceString, wasPrice, wasPriceValue, savings, onSale, discountPercent, rating, reviewCount, seller, fulfillmentType, flag, thumbnail, url, isSponsored, brand, currency, pageNumber, searchQuery, scrapedAt.
- Run-scoped deduplication by
usItemId so duplicate items across overlapping keyword searches and sponsored-then-organic placements are billed at most once.
- Charges
product_scraped ($0.0046 list, $2.40/1k on Business Gold's 48% subscription-tier discount) only after pushData succeeds.
- Residential proxy default; HttpCrawler with low concurrency (5) and session pool to ride Walmart's bot detection.
Actor.on('aborting') flushes state and exits within 1s so user cost ceilings are honored.