Pricing
Pay per usage
An intelligent, universal e-commerce scraper for Apify that automatically detects 6+ store systems, finds product data via sitemaps or deep crawling, and normalizes it into a clean, structured format.
0.0 (0)
Pricing
Pay per usage
1
2
2
Last modified
2 days ago
maxCrawlDepthintegerOptional
Maximum depth for crawling from the start URLs (0 = only start URLs, 1 = start URLs + 1 level, etc.).
Default value of this property is 3
maxCrawlPagesintegerOptional
Maximum number of pages to crawl.
Default value of this property is 100
maxProductsintegerOptional
Maximum number of products to extract (leave empty for unlimited).
detectShopPlatformbooleanOptional
Automatically detect platforms like Magento, Shopify, WooCommerce, etc.
Default value of this property is true
respectRobotsTxtbooleanOptional
Ethical Crawling: Obeys robots.txt disallow rules and crawl delays. Recommended for legal/ethical operation.
Default value of this property is false
identifyAsBotbooleanOptional
Uses an identifiable User-Agent (ApifyPriceScraperBot). If false, uses a standard browser User-Agent.
Default value of this property is false
rotateUserAgentsbooleanOptional
Uses random browser User-Agents for each request (anti-bot evasion). Overrides 'Identify as a Bot'.
Default value of this property is false
crawlDelaynumberOptional
Minimum time between requests to the same domain. 0 = no delay.
Default value of this property is 0
enableDeepCrawlerbooleanOptional
⚠️ WARNING: Crawls ALL links on the site (Screaming Frog-style). Can lead to high costs! Only enable if sitemap is missing.
Default value of this property is false
includeUrlPatternsarrayOptional
Only crawl URLs that match these regex patterns (empty = all URLs).
Default value of this property is []
excludeUrlPatternsarrayOptional
Skip URLs that match these regex patterns.
Default value of this property is ["\\.(pdf|jpg|jpeg|png|gif|css|js|svg|ico|woff|woff2|ttf)$"]
onlyInStockbooleanOptional
Only extract products that are currently in stock.
Default value of this property is false
sortByEnumOptional
Sort extracted products by this field.
"none": string"name": string"price_asc": string"price_desc": string"sku": stringDefault value of this property is "none"
productTypeEnumOptional
Filter by WooCommerce product type (only effective for WooCommerce stores).
"any": string"simple": string"grouped": string"external": string"variable": stringDefault value of this property is "any"
proxyConfigurationobjectOptional
Proxy settings for the crawler (recommended for larger stores).
Default value of this property is {"useApifyProxy":true}
maxConcurrencyintegerOptional
Number of simultaneous HTTP requests (higher = faster, but higher risk of blocking).
Default value of this property is 1
pageLoadTimeoutintegerOptional
Maximum time to wait for a page to load (in seconds).
Default value of this property is 60
customUserAgentstringOptional
Custom User-Agent string (overrides default and rotation).
cookiesarrayOptional
Custom cookies for authentication or personalization.
Default value of this property is []
outputFormatEnumOptional
Format of the extracted data in the dataset.
"json": string"csv": string"xlsx": stringDefault value of this property is "json"
includeImagesbooleanOptional
Include product images in the output.
Default value of this property is true
includeDescriptionbooleanOptional
Include product descriptions in the output.
Default value of this property is true
includeSKUbooleanOptional
Include product SKUs in the output.
Default value of this property is true
includeAvailabilitybooleanOptional
Include stock status in the output.
Default value of this property is true
debugModebooleanOptional
Enables verbose logging for debugging (shows extraction details).
Default value of this property is false