Costco Product Scraper

Costco Product Scraper

Costco Product Scraper extracts structured product data from Costco search URLs, category URLs, product URLs, and keywords. It is built for Apify and uses Costco's own search API path instead of a browser-rendered crawl, which keeps runs fast, stable, and inexpensive. The actor is useful for price monitoring, catalog research, product availability checks, ecommerce analytics, and building clean Costco data feeds for downstream tools.

The scraper accepts the same practical inputs buyers expect from a Costco scraping actor: a Costco search URL such as https://www.costco.com/s?keyword=tshirt, a legacy CatalogSearch URL, a category URL such as https://www.costco.com/mens-clothing.html, a direct product URL, or a list of keywords. Each result is written as one dataset item.

What Data You Get

Costco Product Scraper returns product data with fields that match or exceed the main Costco actor benchmark used during development. Dataset items include product URL, product ID, item number, title, item name, description, image URLs, list price, sale price, min and max price, currency, rating, review count, availability, stock status, membership flags, quantity restrictions, marketing features, marketing keywords, category paths, and timestamps.

The output is normalized with camelCase keys so it works well in JavaScript, Python, spreadsheets, databases, and BI tools. The API data can be exported from Apify as JSON, CSV, Excel, XML, or RSS.

Input

Use startUrls for Costco URLs, searchUrls for a simple list of search or category URLs, or keywords for plain search terms. Use maxItems to cap the total dataset size and maxItemsPerStartUrl to cap each input URL. Use maxSearchPagesPerStartUrl to control pagination depth.

The default input is intentionally small and valid for Apify's automatic actor tests:

{
  "startUrls": [{ "url": "https://www.costco.com/CatalogSearch?dept=All&keyword=tshirt" }],
  "maxItems": 10,
  "maxItemsPerStartUrl": 10,
  "maxSearchPagesPerStartUrl": 1
}

Output Example

{
  "productUrl": "https://www.costco.com/kirkland-signature-mens-pima-tee.product.4000385619.html",
  "name": "Kirkland Signature Men's Pima Tee",
  "itemNumber": "1966168",
  "groupId": "4000385619",
  "listPrice": 13.99,
  "currencyCode": "USD",
  "rating": 4.396900177001953,
  "reviewsCount": 194,
  "isInStock": true,
  "image": "https://bfasset.costco-static.com/..."
}

How It Works

Costco Product Scraper resolves every input into one of three API request types:

1. Keyword or Costco search URL: calls the Costco search API with the search query.
2. Category URL: calls the Costco navigation API route with the category path.
3. Product URL: searches the Costco API by product group or item number and emits the matching product.

The actor uses Apify Proxy by default, with the Residential group and US country routing. That keeps local and cloud behavior aligned with real Costco availability and avoids many direct data center blocks.

Usage Tips

Use direct product URLs when you need one exact product. Use category URLs when you want products from a specific Costco section. Use keywords or search URLs for broader catalog discovery, and set maxItems to control the maximum number of charged results.

For best product relevance, use concrete search terms such as kirkland coffee, mens pima tee, vitamins, or laptop instead of very broad terms.

Notes

Costco Product Scraper is designed for public Costco catalog pages and does not log in, bypass paywalls, or collect personal account data. It is a scraping API tool for public ecommerce product data. For best results, keep the proxy configuration enabled and use concrete search terms such as tshirt, coffee, vitamins, laptop, or kirkland.