Walmart Product Detail Scraper

What does Walmart Product Detail Scraper do?

Walmart Product Detail Scraper extracts rich product records from public Walmart Canada and Walmart US product, search, and category pages. It reads public JSON-LD, embedded page state, and product cards, then normalizes product identity, offers, images, ratings, catalog identifiers, seller, shipping, return policy, category, features, specifications, fulfillment, badges, and optional variants.

The Actor requires a complete detail record before emitting a product row: price, availability, at least one image, seller, fulfillment, and specifications must be publicly available. Incomplete candidates are counted in the summary; they are not presented as rich products. The Actor does not log in, use credentials, solve CAPTCHAs, bypass access controls, or fabricate values.

Why use Walmart Product Detail Scraper?

Use it for catalog enrichment, price monitoring, product-page audits, seller comparison, and variant discovery. Each row preserves the requested URL, final URL, source market, rank, transport, extraction method, and timestamp. Apify provides dataset exports, API access, scheduling, run history, and optional ordinary proxy configuration.

What data can Walmart Product Detail Scraper extract?

Group	Fields
Identity	productId, name, url, brand, manufacturer, sku, upc
Commerce	price, originalPrice, unitPrice, currency, availability, sellerName
Detail	description, images, shipping, returnPolicy, category, breadcrumbs, features, specifications, fulfillment, badges
Variants	variantId, variantName, variantOptions when enabled
Provenance	source, sourceUrl, finalUrl, market, rank, sourceTransport, extractionMethod, scrapedAt
Record state	recordType, status, dataAvailable, sourceBlocked, httpStatus

How to scrape Walmart product details

1. Open the Input tab and add one or more public Walmart HTTPS URLs.
2. Set maxProductsPerStartUrl for the per-page output limit.
3. Enable enqueueProductVariants only when variant rows are needed.
4. Start the run and inspect the dataset and the OUTPUT_SUMMARY key-value record.

Direct requests are used by default. Ordinary Apify Proxy can be enabled for public-source collection, but it is not an access-control bypass. Challenges, unavailable pages, and incomplete candidates are reported in logs and OUTPUT_SUMMARY.diagnostics; only source-backed product records are written to the dataset. Each page uses at most six attempts, with bounded delays for transient HTTP or network failures. Detected access challenges stop further attempts; retries retain the selected proxy URL.

How much will it cost to scrape Walmart product details?

Apify bills the run according to the account and pricing configuration shown in the Console. Cost depends on the number of start URLs, response sizes, proxy/container resources, and stored detail or variant rows. Begin with one product URL and a low per-URL limit; variants increase output and storage.

Input

Supported settings:

• startUrls: one to 20 objects (or compatible URL strings) containing public HTTPS Walmart.com or Walmart.ca product, search, or category URLs.
• maxProductsPerStartUrl: 1–100 product rows per start URL; defaults to 10.
• enqueueProductVariants: boolean, default false; emits publicly exposed variants as separate rows.
• timeoutMs: per-request timeout from 5,000 to 120,000 milliseconds; defaults to 30,000.
• proxyConfiguration: optional standard Apify Proxy settings; direct access is the default.

One public product URL

{
  "startUrls": [
    {
      "url": "https://www.walmart.ca/en/ip/example-wireless-keyboard/EXAMPLE123"
    }
  ],
  "maxProductsPerStartUrl": 1,
  "timeoutMs": 30000
}

Multiple pages with variants and proxy

{
  "startUrls": [
    { "url": "https://www.walmart.ca/en/search?q=wireless+keyboard" },
    { "url": "https://www.walmart.com/search?q=wireless+keyboard" }
  ],
  "maxProductsPerStartUrl": 5,
  "enqueueProductVariants": true,
  "timeoutMs": 45000,
  "proxyConfiguration": { "useApifyProxy": true }
}

Output

You can download the dataset in various formats such as JSON, HTML, CSV, or Excel.

Complete product row

{
  "recordType": "product",
  "status": "success",
  "dataAvailable": true,
  "source": "walmart_public_product_detail",
  "provenance": {
    "requestedUrl": "https://www.walmart.ca/en/ip/example-wireless-keyboard/EXAMPLE123",
    "responseUrl": "https://www.walmart.ca/en/ip/example-wireless-keyboard/EXAMPLE123",
    "market": "CA",
    "rank": 1,
    "productId": "EXAMPLE123",
    "extractionMethod": "embedded_product_payload_with_idml"
  },
  "sourceTransport": "got_scraping_direct",
  "extractionMethod": "embedded_product_payload_with_idml",
  "market": "CA",
  "sourceBlocked": false,
  "sourceUrl": "https://www.walmart.ca/en/ip/example-wireless-keyboard/EXAMPLE123",
  "finalUrl": "https://www.walmart.ca/en/ip/example-wireless-keyboard/EXAMPLE123",
  "rank": 1,
  "productId": "EXAMPLE123",
  "name": "Example wireless keyboard",
  "url": "https://www.walmart.ca/en/ip/example-wireless-keyboard/EXAMPLE123",
  "brand": "Example Brand",
  "description": "Example product description.",
  "images": ["https://www.walmart.ca/example-image.jpg"],
  "price": 29.99,
  "originalPrice": 39.99,
  "currency": "CAD",
  "availability": "In stock",
  "sellerName": "Example Seller",
  "fulfillment": [{ "delivery": "Example delivery" }],
  "specifications": { "Color": "Black" },
  "scrapedAt": "2026-09-08T12:00:00.000Z"
}

OUTPUT_SUMMARY contains status, dataStatus, source/market, pagesRequested, pagesSucceeded, pagesNotFound, pagesFailed, stored products, datasetWriteFailedCount, blocked count, skipped incomplete count, field coverage, and completion time. The three page outcome counts sum to pagesRequested; dataset write failures are counted separately. pagesSucceeded counts pages yielding complete product candidates before storage, while productCount and itemsStored count only saved products.

diagnostics preserves structured entries with a diagnostic code, status (error, warning, or not_found), failure stage, requested/final URLs, HTTP status when available, content type, response size, and attempt count. Incomplete-detail entries include candidate counts and missingFields; parser exceptions include parserErrorName, and network failures include a transport error code when available. Response bodies and raw exception messages are excluded; diagnostic URLs omit credentials and fragments and redact sensitive query parameters. diagnosticCounts groups entries by code, and diagnosticCount includes informational not-found entries.

An allowed Walmart source response with HTTP 404 or 410 and no detected challenge is NOT_FOUND. If every page has that outcome, the run is SUCCEEDED with dataStatus: "NO_RESULTS". A reachable page with no parseable product identity or only incomplete candidates is a source/parser failure. If no products were saved, a failure produces FAILED with dataStatus: "FAILED"; saved products with errors or incomplete candidates produce SUCCEEDED with dataStatus: "PARTIAL". Informational NOT_FOUND entries alone do not make saved products partial. HTTP 200 empty-state pages are not assumed to prove an empty catalog.

Tips and advanced options

Use a product URL when you need the richest fields. Search/category pages can expose candidates but often omit fulfillment or specifications, so those candidates may be counted as incomplete. Keep the per-URL limit low when variants are enabled. If a run returns no product rows, inspect run logs and OUTPUT_SUMMARY source-issue and blocked counts before retrying.

FAQ, support, and responsible use

INCOMPLETE_PRODUCT_DETAIL means a public page was reachable but did not expose all required rich fields. NO_PUBLIC_PRODUCT means the response supplied no parseable product identity, and PARSER_FAILED means extraction or normalization threw an exception. ACCESS_BOUNDARY means a challenge or protected response was detected. NOT_FOUND records a verified HTTP 404/410 outcome. These codes appear in run logs, OUTPUT_SUMMARY.diagnostics, and diagnosticCounts. For support, use the Actor Issues tab or API tab and include the run ID, sanitized input shape, and summary counts. Do not submit cookies, credentials, private headers, or personal data.

This Actor is not affiliated with Walmart. It extracts only public page data and does not access private user information, authenticate, solve CAPTCHAs, or bypass access controls. Follow Walmart's terms, robots guidance, rate limits, applicable law, and privacy obligations.

Local verification

Run npm test, npm run check, npm run schema, apify run --purge --input-file qa-input-281.json, and npm run validate.