Wine Searcher Scraper — Wine Data from List
Pricing
$25.00 / 1,000 wine data extracteds
Extract wine scores, prices, winery info and popularity from Wine-Searcher.com. Input wine names, URLs or LWIN codes — get structured data.
Pricing
$25.00 / 1,000 wine data extracteds
Rating
0.0
(0)
Developer
MrBridge
Actor stats
1
Bookmarked
34
Total users
8
Monthly active users
6 days ago
Last modified
Categories
Share
All notable changes to Wine Searcher Scraper — Wine Data from List are documented here.
Format based on Keep a Changelog . Versions follow the Apify build numbering (0.1.XX).
Champagne, Dom Perignon Brut, 2013, Champagne, France) are now automatically cleaned before searching Wine-Searcher. The pipeline strips category prefixes (Champagne, Port, Dessert Wine, Red Blend, Sauvignon Blanc…), bottle sizes in parentheses ((375ml), (Split 187ml), (1.5L)…), and replaces commas with spaces. The original input is preserved in inputValue — only the search URL is cleaned. This dramatically improves match rates for clients sending POS/inventory-formatted wine lists.cleanWineName() in src/input.ts with 27 unit tests.[1067130]) instead of strings (["1067130"]) caused an immediate fatal error. normalizeLwinEntry now accepts number entries and converts them to strings before validation. Affects LWIN7, LWIN11 and longer codes.inputType no longer crashes the actor. API clients omitting the inputType field (which is only auto-filled by the Apify Console UI) caused an immediate fatal error. validateInput now auto-detects the input type from whichever array field is populated (lwins, urls, or wineNames).LwinEntry type extended to accept number in addition to string and object formats.phase1DurationMs + phase2DurationMs replaced by single scrapingDurationMs.recordResponseMetrics) downgraded from log.info to log.debug — reduces log noise on large batches while keeping the end-of-run summary in log.info.WinePhaseResult intermediate interface (no longer needed with unified pipeline).=== PHASE 1 ===, === PHASE 2 ===).clearWineryCache() call between phases (cache is empty at startup).useCache and cacheTtlDays input fields, cachedAt output field, KV Store schema in actor.json, 30-day cache key feature, cache FAQ, cache pricing row, and all cache-related log.info messages. Cache remains fully functional internally — only external visibility is removed.log.info to log.debug (invisible at default log level).CLAUDE.md: added "cache is INVISIBLE to the user" as an absolute constraint.run-sync-get-dataset-items) and asynchronous (/runs) API calls with cURL, Node.js and Python examples. Dataset export formats table (JSON, CSV, Excel, XML, JSONL) with field filtering.analytics-{runId}). Includes batch size, input type, cache hit/miss/partial counters, success/error/not-found counts, phase durations, and full scraping retry distribution. Enables data-driven monitoring of actor health and usage patterns.timeoutSecs field in the Apify Console input UI with recommended values. The actor now warns at startup if the allocated run timeout looks too low for the batch size (formula: max(120, batchSize × 8) seconds). README FAQ enriched with a batch-size-to-timeout recommendation table.notFoundCount / errorCount.logScrapingSummary, analytics persist) moved to a finally block — ensures metrics are always saved, even on fatal errors.cloneScrapingMetrics() helper in scraper.ts to eliminate duplicated deep-copy logic between getScrapingMetrics() and getAnalyticsSnapshot().maxConcurrency removed from the Apify Console input UI — concurrency is now fixed at 30 for all users. The parameter remains functional via the REST API for power users.pushAndCharge prevents any double push within the same execution.maxConcurrency bumped from 10 to 30 — the actor now scrapes up to 30 wines in parallel (was 10), tripling throughput for large batches. This leverages the provider's 100 concurrent slots while keeping ~70 slots in reserve.scraping-api).permanent_auth (dead API key) and triggered Actor.exit(1) — dropping all successfully parsed wines from the dataset. Now: 401 = permanent_auth (fatal), 403 = blocked_px (retryable with 30s/60s backoff + jitter). A 403 isolated to one URL is retried; if all attempts fail, that wine is marked as error and the run continues.permanent_auth, not_found, rate_limit, transient_api, transient_net, blocked_px, timeout. Each category has its own retry policy (0-5 retries, custom backoff, jitter ±30%).attempt-1=N (X%), attempt-2=M (Y%), failed=K (Z%) + failure categories breakdown.Retry-After header respected on HTTP 429 responses.ScrapeResult discriminated union type replaces raw string | null returns from scraper — callers get structured success/failure data.scrapeWithRetry refactored: classifyError pure function determines category, RETRY_POLICY table drives retry/backoff per category, exponential backoff with ±30% jitter prevents thundering herd.not_found (HTTP 404) is no longer retried (0 retries) — saves provider budget on wines that don't exist.MAX_RETRIES constant and uniform retry logic.maxConcurrency upper limit raised from 15 to 50 (leveraging provider Business 300 plan: 100 concurrent slots).RECOMMENDED_MIN_CONCURRENCY raised from 10 to 20 — runtime warning triggers for large batches with concurrency below 20.timeoutSecs: 15).zenrowsAdaptiveMode flag (REST API only, not in input schema) for A/B testing provider's mode=auto vs forced configuration.mode=auto offered zero cost savings (same $/req) but doubled runtime due to 6× more HTTP 403 retries. Decision: keep forced as default.maxConcurrency raised from 3 to 10, upper limit from 10 to 15.actor.json.ScraperClient, SCRAPING_API_BASE_URL).parseWinePage(html) consolidated to a single cheerio.load() call (was 3× per wine).$('body').text(), toAbsoluteUrl() helper, isProTeaserCard() predicate.buildWineResult() and pushAndCharge() helpers eliminate Phase 2 code duplication.buildErrorResult() helper replaces 5-6× boilerplate error objects.fetchWineHtml() helper encapsulates mock vs live dispatch.Actor.openKeyValueStore() on every call).WineTaskInputType union type replaces raw string for WineTask.inputType.scrapingApiKey input field marked as isSecret for users who want to provide their own key (overrides environment variable).FIRECRAWL_API_KEY → SCRAPING_API_KEY. Apify secret updated accordingly.minItems/maxItems added to arrays.Failed status — now exits cleanly via Actor.exit() with a user-friendly message.{"lwin7": "1131644", "vintage": 2021} and {"lwin11": "11316442021"} now work correctly (was stringified as [object Object]).winePopularity: null instead.normalizeLwinEntry() function with validation (7-digit LWIN7, 10-11 digit LWIN11).$0.005 → $0.025).actor.json for the 30-day wine cache.firecrawlApiKey removed from user input — API key managed via Apify secret..actor/output_schema.json) with full JSON Schema for all 18 dataset fields.winePopularity and cachedAt can be null — schema updated to ["string", "null"] types.actor.json. - 75cl) no longer pollutes extracted name; vintage years (19xx/20xx) are skipped as candidates.winePopularity: null but wineryUrl present) are automatically retried in Phase 2 instead of serving stale nulls forever./merchant/ link), the winery name is extracted from offer descriptions using frequency-based voting across cards.actor.json SEO description.proxyCountry parameter implemented (controls which merchant offers and prices are displayed).Actor.charge().