Price Scraper for Bot-Protected Stores

Extract live product prices from bot-protected retailers — including sites where other scrapers hit a Cloudflare wall, a "Just a moment…" challenge, or an empty price field and give up.

Just type a product name (e.g. RTX 5070 Ti) and get a price comparison across every supported store — no store selection needed. Or paste exact URLs in Advanced mode.

Works out of the box on Amazon.ca, Best Buy Canada, Walmart.ca, Newegg.ca, Vuugo and Canada Computers — plus Memory Express and any product page URL you provide.

Two ways to use it

1. Search by product name (easiest)

Enter a product name and the Actor searches every supported store automatically — no store selection needed. It then scrapes each match for its live price. Results come back sorted cheapest-first — a ready-made price comparison.

Product name:  RTX 5070 Ti

That's the whole input. Stores, URLs and selectors are all optional and live under Advanced — leave them untouched for the default behaviour.

2. Direct URLs (Advanced)

Paste product URLs (or a whole category/search page) for exact control. You can also limit the search to specific stores from the Advanced section.

What you get

Field	Example
retailer	newegg
name	ASUS PRIME GeForce RTX 5070 Ti 16GB
price	1559.99
currency	CAD
inStock	true
url	https://www.newegg.ca/...
scrapedAt	2026-09-09T12:00:00Z

Why it works where others don't

• Bypasses TLS fingerprinting walls that block plain HTTP clients and most scrapers
• Renders JavaScript pages automatically — sites that load prices dynamically work too
• Reads prices from embedded page data when they're not in the visible HTML
• Ignores subscription decoys — a "$19.99/month membership" banner can't masquerade as a product price
• Full category crawling — point it at a category/search page and it finds and scrapes every product across result pages

Input

Field	Type	Description
searchQuery	string	Product name to search for — all supported stores are searched automatically
maxResultsPerStore	int	Matches per store to scrape (default 3)
retailers	array	Advanced: limit to specific stores. Empty/omitted = every supported store
productUrls	array	Advanced: exact product/category URLs (takes priority over search)
maxPagesPerUrl	int	For category URLs: pages to crawl (default 1)
proxy	proxy	Optional. Try without first — enable if a store blocks your IP
nameSelector/priceSelector/stockSelector	string	Advanced: CSS overrides for unusual layouts
useJavascript, debug	bool	Advanced: force browser rendering / verbose logs

Example output

{
  "retailer": "newegg",
  "url": "https://www.newegg.ca/p/N82E16814932771",
  "name": "GIGABYTE WindForce GeForce RTX 5070 Ti 16GB",
  "price": "1669.00",
  "currency": "CAD",
  "inStock": true,
  "engine": "standard",
  "scrapedAt": "2026-09-10T12:00:00Z"
}

If a URL fails entirely, you get a row with an error field — one bad URL never kills a batch run.

Validated on (real runs)

Amazon.ca · Best Buy Canada · Walmart.ca · Newegg.ca · Vuugo · Canada Computers · Memory Express — tested on GPUs, phones, headphones and game consoles. Batch runs are safe: automatic politeness delays, per-URL time budgets, and retry on transient errors.

Use cases

• Price comparison — type a product name, get every store's price side by side, cheapest first.
• Competitor monitoring — schedule a daily run and track how rival listings move.
• Price-drop alerts — feed the dataset into your own alerting to catch discounts.
• Market research — pull category pages to survey a whole product segment at once.
• Procurement — find the cheapest source for a spec before you buy.

Troubleshooting

Symptom	Fix
A store returned nothing	That store may not stock the item (e.g. phones are only sold by phone retailers). Check the run log — it reports per-store results.
Empty price on a row	Some marketplace listings hide the price until you pick a variant. The row returns price: null rather than guessing.
A store is rate-limiting you	Enable the proxy in Advanced, or reduce Max results per store.
Wrong or odd price	Send the URL and the expected price — price extraction is actively improved.
Searching an unusual site	Use a direct URL in Advanced; add a price CSS selector if the page uses non-standard markup.
"Always render JavaScript" gave worse results	Leave that option off. It's a troubleshooting fallback only — automatic detection already renders when a page needs it, and some stores react badly to browser sessions.

Sample output

[
  {
    "retailer": "vuugo",
    "url": "https://www.vuugo.com/product/msi-geforce-rtx-g507t-16vgs/",
    "name": "MSI GeForce RTX 5070 Ti 16G VANGUARD SOC Graphics Card",
    "price": "1386.00",
    "currency": "CAD",
    "inStock": true,
    "engine": "standard",
    "searchQuery": "RTX 5070 Ti",
    "scrapedAt": "2026-09-10T15:34:51.209Z"
  },
  {
    "retailer": "bestbuy",
    "url": "https://www.bestbuy.ca/en-ca/product/...",
    "name": "MSI GeForce RTX 5070 Ti Gaming Trio OC 16GB GDDR7",
    "price": "1799.99",
    "currency": "CAD",
    "inStock": true,
    "engine": "standard",
    "searchQuery": "RTX 5070 Ti",
    "scrapedAt": "2026-09-10T15:34:58.881Z"
  }
]

Limitations (honest)

• Not every store carries every product. For new phones (e.g. iPhone 17 Pro Max), Best Buy and Walmart stock them while component-focused stores (Newegg, Canada Computers) list only accessories — those accessory matches are filtered out automatically, so fewer stores may return results for such items.
• Interactive image CAPTCHAs (select-the-traffic-lights) cannot be automated — may need Apify proxy
• Some stores rate-limit datacenter IPs — if a store returns nothing repeatedly, enable the Apify proxy
• Memory Express search is heavily protected; use a direct product/category URL for it instead
• Some marketplace listings show no price until options are chosen — those return price: null rather than a guessed number
• Respect each site's Terms of Service and robots.txt — this actor is for accessing public data you're entitled to see