Costco Product Scraper

Scrape Costco.com for product data including prices, ratings, reviews, brand, member-only status, availability, images, specifications, and more. Search by keyword, direct product URL, or browse by category.

Features

• Multi-keyword search — scrape multiple search terms in a single run
• Direct URL scraping — provide specific Costco product URLs for targeted extraction
• Category browsing — browse entire Costco departments (electronics, grocery, appliances, etc.)
• Price filtering — only include products at or below a maximum price
• Member-only detection — identifies warehouse-only and member-exclusive items
• Rich product data — title, price, savings, rating, reviews, brand, specs, images, availability
• Pagination — automatically follows search result pages up to your max results limit
• Anti-bot handling — User-Agent rotation, request delays, and Akamai detection
• Pay-per-event pricing — only pay for products actually scraped ($0.005 per product)

Output Fields

Field	Type	Description
title	string	Product name
price	number	Current price in USD
originalPrice	number	Original/was price (if on sale)
savings	number	Dollar amount saved
savingsPercent	string	Percentage saved (e.g., "25%")
rating	number	Average rating (0-5 scale)
reviews	number	Number of customer reviews
brand	string	Brand or manufacturer name
memberOnly	boolean	Whether the item is warehouse/member-only
availability	string	Stock status (In Stock, Out of Stock, etc.)
images	array	List of product image URLs
specs	object	Product specifications (key-value pairs)
url	string	Direct link to Costco product page
itemNumber	string	Costco item number
searchTerm	string	The search term that found this product
scrapedAt	string	ISO 8601 timestamp of when the product was scraped

Input Examples

Search by keyword

{
  "searchTerms": ["kirkland olive oil", "samsung tv"],
  "maxResults": 100
}

Scrape specific products

{
  "productUrls": [
    "https://www.costco.com/kirkland-signature-extra-virgin-olive-oil.product.100334937.html"
  ]
}

Filter by category and price

{
  "searchTerms": ["monitor"],
  "category": "electronics",
  "maxPrice": 500,
  "maxResults": 50
}

Full configuration

{
  "searchTerms": ["vitamix", "kitchenaid mixer"],
  "productUrls": [],
  "category": "appliances",
  "maxPrice": 1000,
  "maxResults": 500,
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Proxy Configuration

Costco uses Akamai Bot Manager for anti-bot protection. Residential proxies are strongly recommended for reliable scraping. Datacenter IPs are frequently blocked.

{
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Categories

Supported category filters: electronics, grocery, appliances, furniture, health, beauty, clothing, office, toys, jewelry, sports, automotive, baby, patio, home-improvement, home, pet, floral, wine, pharmacy, optical, travel, business, organic, kirkland.

How It Works

1. Search pages — Sends search queries to Costco.com and parses the product grid. Tries embedded JSON data first, then falls back to HTML parsing with Cheerio.
2. Product detail pages — For each product found, optionally visits the detail page for richer data (specifications, full image gallery, detailed availability).
3. Warehouse/category pages — Browses department pages and follows subcategory links to discover products.
4. Deduplication — Products are deduplicated by item number or title to avoid duplicates across pages.
5. Price filtering — Products above the max price threshold are excluded before saving.

Use Cases

• Price monitoring — Track Costco prices over time for specific products
• Market research — Analyze Costco's product catalog by category
• Competitor analysis — Compare Costco pricing with other retailers
• Deal finding — Search for products with the biggest discounts
• Inventory tracking — Monitor stock availability for popular items
• Brand analysis — Study which brands Costco carries in each department

Limitations

• Costco requires membership for some product details and pricing. Some member-only items may show limited data.
• Akamai Bot Manager may block requests without residential proxies.
• Costco limits search results to approximately 1,000 products per query.
• Product specifications vary by category; not all products have detailed specs.

Cost

This actor uses pay-per-event pricing at $0.005 per product scraped. You only pay for products that are successfully extracted and saved to the dataset.

Integration — Python

from apify_client import ApifyClient

client = ApifyClient("YOUR_API_TOKEN")
run = client.actor("sovereigntaylor/costco-scraper").call(run_input={
    "searchTerm": "costco",
    "maxResults": 50
})

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(f"{item.get('title', item.get('name', 'N/A'))}")

Integration — JavaScript

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });

const run = await client.actor('sovereigntaylor/costco-scraper').call({
    searchTerm: 'costco',
    maxResults: 50
});

const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach(item => console.log(item.title || item.name || 'N/A'));