# Ultimate Walmart Scraper (`w3crawler/ultimate-walmart-scraper`) Actor This is the ultimate web scraping tool for extracting the most relevant data points from products on Walmart.com! Developed by an expert software developer, this powerful scraper is a fast and reliable tool for all your web scraping needs. - **URL**: https://apify.com/w3crawler/ultimate-walmart-scraper.md - **Developed by:** [w3crawler](https://apify.com/w3crawler) (community) - **Stats:** 2 total users, 1 monthly users, 0.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.99 / 1,000 products This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md. ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run. For examples already wired to this Actor's own input schema, see the [API](#api) section below. Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`). # README ### What does Ultimate Walmart Scraper do? Ultimate Walmart Scraper extracts **public Walmart product records** from Walmart Canada and Walmart US search, browse, category, listing, and product pages. It reads the structured page payloads that Walmart publishes for the page, normalizes product identity, price, currency, availability, seller, ratings, media, category, and specifications, and can enrich a bounded number of product pages. It does not log in, solve CAPTCHAs, bypass access controls, or invent values. See [Walmart](https://www.walmart.ca/) for the public source. ### Why use Ultimate Walmart Scraper? Use it for product research, catalog monitoring, price checks, availability snapshots, and marketplace comparison. A search URL can return multiple distinct products, while a product URL can produce a complete detail record. Results preserve the producing search URL, page number, source hostname, position, extraction method, and timestamp so records remain auditable. Apify provides API access, dataset exports, run history, scheduling, and monitoring around the Actor. Generated searches use Walmart Canada by default because its public pages currently expose structured product data. Set `market` to `us` to generate a Walmart US search URL. Explicit `startUrls` always control the source and can contain either Walmart.ca or Walmart.com URLs; a challenged URL produces an explicit diagnostic instead of a false empty result. Ordinary Apify Proxy is active when enabled in `proxyConfiguration`, but it is not an access-control bypass. ### What data can Ultimate Walmart Scraper extract? | Group | Fields | | --------------------- | --------------------------------------------------------------------------------------------------------------------------- | | Identity | `productId`, `name`, canonical `url`, `sku`, `gtin`, `model` | | Commerce | `price`, `priceFormatted`, `wasPrice`, `unitPrice`, `currency`, `availability`, `seller` | | Content | `description`, `brand`, `category`, `breadcrumbs`, `features`, `specifications` | | Media and delivery | `imageUrl`, bounded `imageUrls`, `media`, `fulfillment`, `badges`, `sponsored` | | Detail and provenance | `detailStatus`, bounded `reviews`, `reviewSummary`, `source`, `searchUrl`, `pageNum`, `position`, `provenance`, `scrapedAt` | ### How to scrape Walmart products 1. Open the Input tab and enter a search term or one or more public Walmart URLs. 2. Choose `ca` or `us` for generated searches, then set `maxItems` and `maxPages`. 3. Enable detail enrichment for a bounded number of product pages; enable public reviews only when needed. 4. Start the Actor and inspect the dataset and `OUTPUT_SUMMARY` key-value record. A `walmart-diagnostic` record is an access, empty-page, or request diagnostic and is not a product. ### How much will it cost to scrape Walmart products? Apify bills the Actor according to the account and pricing configuration shown for the run. More source pages, product-detail requests, retries, browser/container resources, and large media or review arrays require more compute and storage. This Actor uses sequential HTTP requests, bounded response sizes, configurable pacing, and bounded retries. Keep `maxItems`, `maxPages`, `maxDetailItems`, and `maxReviews` close to the business need for predictable runs. ### Input See the input tab for the complete configuration. The important rules are: - `query`, `searchTerms`, `search_terms`, and `queries` generate one search URL per unique non-empty term. `market` defaults to `ca` and accepts only `ca` or `us`. - `startUrls` is an array of `{ "url": "..." }` objects. `urls`, `productUrls`, `product_urls`, and `url` are compatibility aliases. Explicit URLs take precedence over generated terms. - `maxItems` is global across all URLs and pages (1–500). `maxPages` is per search/browse URL (1–10); product URLs are fetched once. The observed Walmart `page` query parameter is advanced between pages, with repeated/no-new pages stopping the crawl. - `deduplicate` uses the stable Walmart item ID, then canonical URL or name. `includeDetails` is bounded by `maxDetailItems` (0–50). `includeReviews` is bounded by `maxReviews` (0–20) and only applies to successful detail pages. - `requestDelayMs` (0–10,000), `maxRequestRetries` (0–3), and `timeoutMs` (5,000–120,000) are bounded developer controls. `userAgent` is optional and transparent. Requests are sequential. #### Smoke-test input ```json { "query": "wireless keyboard", "market": "ca", "maxItems": 3, "maxPages": 1, "includeDetails": true, "maxDetailItems": 1, "requestDelayMs": 0, "maxRequestRetries": 0, "timeoutMs": 30000 } ``` #### Multiple URLs and detail opt-out ```json { "startUrls": [ { "url": "https://www.walmart.ca/en/search?q=wireless+keyboard" }, { "url": "https://www.walmart.ca/en/search?q=usb+mouse" } ], "maxItems": 10, "maxPages": 2, "deduplicate": true, "includeDetails": false, "includeReviews": false } ``` #### Product detail with public reviews ```json { "startUrls": [ { "url": "https://www.walmart.ca/en/ip/example-wireless-keyboard/EXAMPLE123" } ], "maxItems": 1, "includeDetails": true, "maxDetailItems": 1, "includeReviews": true, "maxReviews": 3 } ``` ### Output You can download the dataset in various formats such as JSON, HTML, CSV, or Excel. #### Rich product record ```json { "recordType": "walmart-product", "status": "success", "dataAvailable": true, "source": "walmart.ca", "productId": "EXAMPLE123", "name": "Example wireless keyboard", "url": "https://www.walmart.ca/en/ip/example-wireless-keyboard/EXAMPLE123", "price": 29.99, "currency": "CAD", "availability": "In stock", "seller": "Walmart", "detailEnriched": true, "detailStatus": "success", "searchUrl": "https://www.walmart.ca/en/search?q=wireless+keyboard", "pageNum": 1, "extractionMethod": "embedded_json", "scrapedAt": "2026-09-08T12:00:00.000Z" } ``` #### Run summary ```json { "status": "SUCCEEDED", "recordCount": 3, "itemCount": 3, "productCount": 3, "diagnosticCount": 0, "blockedCount": 0, "detailRequestedCount": 1, "detailSuccessCount": 1, "completedAt": "2026-09-08T12:00:00.000Z" } ``` #### Diagnostic record ```json { "recordType": "walmart-diagnostic", "status": "error", "dataAvailable": false, "accessStatus": "blocked", "source": "walmart.com", "errorCode": "ACCESS_BOUNDARY", "error": "Walmart returned an access challenge instead of public product data.", "url": "https://www.walmart.com/search?q=wireless+keyboard", "scrapedAt": "2026-09-08T12:00:00.000Z" } ``` ### Tips and advanced options Start with one search URL, one page, and a small `maxItems`. Use multiple pages only when the first page cannot satisfy the requested limit; the global item limit is applied across all sources. Detail enrichment costs an additional public request per selected item, and review/media arrays are bounded. A detail timeout or access challenge retains the usable base search record with `detailStatus: "failed"` and a stable error code. Set a respectful delay for larger runs. ### FAQ, support, and responsible use If the dataset contains only diagnostics, inspect `accessStatus`, `errorCode`, the final URL, and `OUTPUT_SUMMARY`; an access boundary is not the same as zero matches. Do not submit credentials, cookies, or private URLs. For support, use the Actor Issues tab or API tab and include the run ID, sanitized input shape, and summary counts. This Actor is not affiliated with Walmart. It extracts only public page data and does not access private user information, authenticate, solve CAPTCHAs, or bypass access controls. Users must follow Walmart’s terms, robots guidance, rate limits, applicable law, and privacy obligations. Public reviews may contain personal data; use them only with a legitimate purpose and seek qualified legal advice when unsure. # Actor input Schema ## `market` (type: `string`): Market used only when a search term generates a URL. Canada is the default because its public pages currently expose structured product data; US URLs remain supported and report an access diagnostic when challenged. ## `startUrls` (type: `array`): Absolute public Walmart.com or Walmart.ca product, search, category, or browse URLs. Explicit URLs take precedence over generated search terms. ## `urls` (type: `array`): Compatibility alias for startUrls. ## `searchTerms` (type: `array`): Non-empty terms converted to public Walmart search URLs when no explicit URL is supplied. Maximum 25 terms, 200 characters each. ## `search_terms` (type: `array`): Compatibility alias for searchTerms. ## `queries` (type: `array`): Compatibility alias for searchTerms. ## `query` (type: `string`): One search term alias. It is ignored when a valid explicit URL is supplied. ## `url` (type: `string`): One URL alias for startUrls. ## `maxItems` (type: `integer`): Global maximum of unique product records across all start URLs and pages. ## `maxPages` (type: `integer`): Maximum number of observed search/browse pages to request for each start URL. Product URLs are fetched once. ## `deduplicate` (type: `boolean`): Use the stable Walmart item ID, then canonical URL, to deduplicate across pages and URLs. ## `includeDetails` (type: `boolean`): Fetch up to maxDetailItems public product pages and merge descriptions, specifications, media, and optional reviews. ## `maxDetailItems` (type: `integer`): Maximum product records eligible for detail enrichment. Use 0 to disable detail requests even when includeDetails is true. ## `includeReviews` (type: `boolean`): Include up to maxReviews public reviews from successfully enriched product pages. ## `maxReviews` (type: `integer`): Bound for public review objects included in each detail-enriched record. ## `requestDelayMs` (type: `integer`): Minimum pacing delay between public requests. The Actor processes requests sequentially for predictable limits. ## `maxRequestRetries` (type: `integer`): Bounded retries for transient HTTP statuses; access challenges are never bypassed. ## `timeoutMs` (type: `integer`): Maximum time for each public HTTP request. ## `userAgent` (type: `string`): Optional transparent client user-agent, limited to 300 characters. ## `proxyConfiguration` (type: `object`): Optional ordinary Apify Proxy settings. When enabled, each request obtains a proxy URL and the summary reports proxy use; this does not bypass challenges. ## Actor input object example ```json { "market": "ca", "startUrls": [], "urls": [], "searchTerms": [], "search_terms": [], "queries": [], "maxItems": 50, "maxPages": 1, "deduplicate": true, "includeDetails": true, "maxDetailItems": 5, "includeReviews": false, "maxReviews": 5, "requestDelayMs": 700, "maxRequestRetries": 1, "timeoutMs": 30000, "proxyConfiguration": { "useApifyProxy": false } } ``` # Actor output Schema ## `dataset` (type: `string`): No description ## `runSummary` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("w3crawler/ultimate-walmart-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("w3crawler/ultimate-walmart-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call w3crawler/ultimate-walmart-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,w3crawler/ultimate-walmart-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/uHqKPG4eBWZz9EewB/builds/Ix2r44K74Bxhzbs5I/openapi.json