# Etsy Scraper - Listings, Shops & Search Results (`cirkit/etsy-shop-product-scraper`) Actor Scrape Etsy product listings, shop profiles, and search results. Get price, sales, reviews, photos, variants, shop info. 3 input modes. - **URL**: https://apify.com/cirkit/etsy-shop-product-scraper.md - **Developed by:** [Crikit](https://apify.com/cirkit) (community) - **Categories:** E-commerce, SEO tools - **Stats:** 3 total users, 2 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $3.50 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Etsy Scraper – Listings, Shops & Search Results Etsy Scraper extracts product listings, shop profiles, and search results from etsy.com without a login. Three input modes ship together so you can mix bulk listing scrapes, shop deep-dives, and keyword discovery in a single actor run. ### What this Etsy Scraper returns | Record type | What you get | |------------|--------------| | `listing` | title, full description, price low/high, currency, availability, variant count, rating, review count, ordered image URLs, category, breadcrumbs, shop name, shop ID, source URL | | `shop` | shop title, description, owner, location, slogan, logo, aggregate rating, total review count, total listings on the shop page, source URL | | `searchSummary` | search query, page number, total result count Etsy reports for the query, source URL | Every record is flat. No nested wrappers. Pipe directly into a spreadsheet or database. Warnings (404 listings, removed shops, anti-bot blocks) are written to the run's key-value store at `WARNINGS` so you can audit run health, **without** triggering a result charge. Open the run's key-value store tab to download. ### Input modes Mix any combination in a single run. 1. **Search queries** – give a list of free-text searches and the actor walks `page=1..N` per query, summarizing total hits and feeding the listings it sees into the listing detail phase when `includeListingDetails` is enabled. 2. **Shop URLs or names** – full Etsy shop URLs (`https://www.etsy.com/shop/HunchbackLeather`) or bare names. Returns the shop record plus, by default, every listing visible on the shop's front page. 3. **Listing URLs or IDs** – full Etsy listing URLs or bare numeric IDs (e.g. `1529402955`). Returns the full product record. Use `maxResults` as a hard cap across all three modes. Use `maxPagesPerQuery` to control search depth. ### Pricing Pay only for what you get back: **$0.0035 per successful record** ($3.50 per 1,000). No actor-start fee. You are charged ONLY for `listing`, `shop`, and `searchSummary` records that land in the default dataset. 404s, anti-bot warnings, and unfetchable shops are routed to the run's key-value store as a `WARNINGS` blob — never billed. Etsy returns roughly six listing cards per mobile search page, so a single search query at `maxPagesPerQuery=10` produces around 60 listing records plus 10 search-summary rows. ### Why this Etsy Scraper * **3 input modes in one actor.** Most Etsy actors handle search OR shops OR listings. This one does all three so you do not bounce between multiple actors and datasets. * **Real product data.** Pulls from Etsy's JSON-LD Product / Organization / ItemList / BreadcrumbList / FAQPage blocks, the same structured data Google indexes, so the field shape is stable across page redesigns. * **No login required.** Bryan's actor portfolio policy: zero cookie-required scrapers. This Etsy Scraper never asks for your Etsy account, sessionid, or any credential. * **Anti-bot ready.** Etsy fronts everything behind DataDome. This scraper ships with the iOS Safari + curl_cffi `safari17_0` impersonation profile and an Apify RESIDENTIAL US proxy that is the only proxy class DataDome lets through on product, shop, and search pages. A built-in circuit breaker pauses the run instead of burning proxy bandwidth when DataDome enters a sustained block state. * **Cheaper.** $3.50 per 1,000 records flat. The dominant competitor charges roughly $5–$7 per 1,000 plus a $0.05 actor-start fee on every run. ### Output examples #### Listing record ```json { "recordType": "listing", "listingId": "1529402955", "title": "Handmade Full Grain Leather Wallet - Personalizable Men's Bifold Wallet", "priceLow": 154.0, "priceHigh": 194.0, "priceCurrency": "USD", "availability": "https://schema.org/InStock", "variantCount": 25, "ratingValue": 5.0, "reviewCount": 467, "images": ["https://i.etsystatic.com/.../il_fullxfull.jpg", "…"], "category": "Wallets & Money Clips", "breadcrumbs": ["Clothing & Accessories", "Wallets & Money Clips", "Bifold Wallets"], "shopId": "34829689", "shopName": "HunchbackLeather", "shopUrl": "https://www.etsy.com/shop/HunchbackLeather", "sourceUrl": "https://www.etsy.com/listing/1529402955", "scrapedAt": "2026-05-19T18:42:11Z" } ```` #### Shop record ```json { "recordType": "shop", "shopId": "34829689", "shopName": "HunchbackLeather", "title": "HunchbackLeather", "description": "Handcrafted leather goods, made by a single artisan in California.", "shopOwner": "Eric", "shopLocation": "San Francisco, United States", "shopRating": 4.93, "shopReviewCount": 2178, "shopLogo": "https://i.etsystatic.com/iusa/…/iusa_400x400.jpg", "totalShopListings": 84, "sourceUrl": "https://www.etsy.com/shop/HunchbackLeather", "scrapedAt": "2026-05-19T18:42:11Z" } ``` #### Search summary record ```json { "recordType": "searchSummary", "searchQuery": "handmade leather wallet", "searchPage": 1, "searchTotalResults": 80032, "sourceUrl": "https://www.etsy.com/search?q=handmade+leather+wallet&page=1", "scrapedAt": "2026-05-19T18:42:11Z" } ``` ### Common Etsy use cases this actor covers - **Etsy market research** – pull every Etsy listing for a niche query, with price ranges and ratings, into a single Etsy dataset. - **Etsy competitor monitoring** – run a daily Etsy shop scrape across a list of competitor shops, track their listings, prices, and review counts over time. - **Etsy product Python pipelines** – feed the Etsy listing JSON straight into Python with the Apify SDK. The actor's output schema makes the Etsy data CSV-clean. - **Etsy SEO tools** – walk Etsy search results to map title patterns and tag usage across top-ranking listings. - **Etsy review analysis** – combine the shop record's `shopReviewCount` with the listing record's `reviewCount` for a quick reputation snapshot. ### Tips - For deep searches, raise `maxPagesPerQuery` to 30+ and rely on `maxResults` as your wallet cap. - `includeListingDetails: false` is roughly 6× cheaper if you only need shop or search-summary rows. - Etsy shop names are case-sensitive in the URL path; the actor preserves whatever capitalization you pass. - **Concurrency tuning.** `detailConcurrency` defaults to 5 — the sweet spot in our benchmarks. 8–10 will *not* be meaningfully faster (Etsy's mobile search page returns only ~6 listings per page, so the search-page walk becomes the bottleneck) and may increase anti-bot signals. Lower it to 1–2 if you ever see warnings spike. - **Runtime budget.** Set `maxRuntimeSeconds` if you want the actor to stop cleanly at a deadline regardless of how many results have been collected. Useful for daily cron-style jobs. ### Performance In our v0.2.2 benchmark: - **~2.4 results per second** in steady state on residential US proxy (vs ~0.4/sec on v0.1.x). - **8-item prefill run completes in ~12 s** — well inside Apify's 5-minute daily-auto-test envelope. - **100% required-field coverage** on 175 listings across the QA matrix. - **Per-run warnings** ride in the run's key-value store with no per-warning charge. The full v0.2.2 launch QA report is at [`qa/v02/QA_REPORT.md`](qa/v02/QA_REPORT.md). ### Limitations - The mobile layout that DataDome allows through paginates roughly six listings per search page. Plan `maxPagesPerQuery` accordingly. - Etsy hides exact subscriber counts on the public web. The actor returns whatever Etsy renders. - Sold listings still return data but with `availability: OutOfStock`. ### Bug reports & feature requests Open an issue on the Apify Console actor page or DM the maintainer. The actor ships with documented ground-truth listings so reproducing a problem is straightforward. # Actor input Schema ## `searchQueries` (type: `array`): Free-text searches to walk. Each entry produces one result page sequence. Example: \["handmade leather wallet", "silver hoop earrings"]. ## `shopUrls` (type: `array`): Full Etsy shop URLs (https://www.etsy.com/shop/) or bare shop names (case-sensitive, e.g. HunchbackLeather). ## `listingUrls` (type: `array`): Full Etsy listing URLs or bare numeric listing IDs (e.g. 1529402955). ## `maxResults` (type: `integer`): Hard cap on billable records (listings, shops, search summaries) pushed to the default dataset. Warning rows go to a separate 'warnings' dataset and do not count against this cap. Default 100. ## `maxPagesPerQuery` (type: `integer`): How many pages to walk per search query (Etsy mobile layout returns ~6 results per page). Default 5. ## `includeListingDetails` (type: `boolean`): If true, every listing seen in search/shop results gets a full detail fetch (price range, all photos, description, ratings). Slower but richer. If false, only the search/shop summary fields are captured. Default true. ## `detailConcurrency` (type: `integer`): Parallel workers that pull listing IDs from the queue and fetch detail pages. Higher = faster but more aggressive on Etsy/DataDome. Range 1-10, default 5. ## `maxRuntimeSeconds` (type: `integer`): Optional hard wall-clock cap on the actor run. The actor stops cleanly when the deadline is reached even if maxResults has not been hit. Leave blank for no internal limit. ## `sortOrder` (type: `string`): Order applied to search queries only. most\_relevant (default), most\_recent, price\_asc, price\_desc. ## `minPrice` (type: `integer`): Search-only price floor. ## `maxPrice` (type: `integer`): Search-only price ceiling. ## `proxyConfiguration` (type: `object`): Apify residential US proxy is required to bypass DataDome. Leave default unless you know what you're doing. ## Actor input object example ```json { "searchQueries": [ "handmade leather wallet" ], "maxResults": 8, "maxPagesPerQuery": 1, "includeListingDetails": true, "detailConcurrency": 4, "sortOrder": "most_relevant", "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } } ``` # Actor output Schema ## `datasetOverview` (type: `string`): Listings, shops, and search-result records combined into one dataset, viewable as a table. ## `datasetJson` (type: `string`): Same records as raw JSON. ## `datasetCsv` (type: `string`): Same records flattened to CSV. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchQueries": [ "handmade leather wallet" ], "maxResults": 8, "maxPagesPerQuery": 1, "includeListingDetails": true, "detailConcurrency": 4, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }; // Run the Actor and wait for it to finish const run = await client.actor("cirkit/etsy-shop-product-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchQueries": ["handmade leather wallet"], "maxResults": 8, "maxPagesPerQuery": 1, "includeListingDetails": True, "detailConcurrency": 4, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "US", }, } # Run the Actor and wait for it to finish run = client.actor("cirkit/etsy-shop-product-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchQueries": [ "handmade leather wallet" ], "maxResults": 8, "maxPagesPerQuery": 1, "includeListingDetails": true, "detailConcurrency": 4, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }' | apify call cirkit/etsy-shop-product-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=cirkit/etsy-shop-product-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Etsy Scraper - Listings, Shops & Search Results", "description": "Scrape Etsy product listings, shop profiles, and search results. Get price, sales, reviews, photos, variants, shop info. 3 input modes.", "version": "0.2", "x-build-id": "gKPFUHcC5CTdoAfpb" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/cirkit~etsy-shop-product-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-cirkit-etsy-shop-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/cirkit~etsy-shop-product-scraper/runs": { "post": { "operationId": "runs-sync-cirkit-etsy-shop-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/cirkit~etsy-shop-product-scraper/run-sync": { "post": { "operationId": "run-sync-cirkit-etsy-shop-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "searchQueries": { "title": "Search queries", "type": "array", "description": "Free-text searches to walk. Each entry produces one result page sequence. Example: [\"handmade leather wallet\", \"silver hoop earrings\"].", "items": { "type": "string" } }, "shopUrls": { "title": "Shop URLs or names", "type": "array", "description": "Full Etsy shop URLs (https://www.etsy.com/shop/) or bare shop names (case-sensitive, e.g. HunchbackLeather).", "items": { "type": "string" } }, "listingUrls": { "title": "Listing URLs or IDs", "type": "array", "description": "Full Etsy listing URLs or bare numeric listing IDs (e.g. 1529402955).", "items": { "type": "string" } }, "maxResults": { "title": "Maximum results", "minimum": 1, "maximum": 50000, "type": "integer", "description": "Hard cap on billable records (listings, shops, search summaries) pushed to the default dataset. Warning rows go to a separate 'warnings' dataset and do not count against this cap. Default 100.", "default": 100 }, "maxPagesPerQuery": { "title": "Max search pages per query", "minimum": 1, "maximum": 250, "type": "integer", "description": "How many pages to walk per search query (Etsy mobile layout returns ~6 results per page). Default 5.", "default": 5 }, "includeListingDetails": { "title": "Fetch full listing details", "type": "boolean", "description": "If true, every listing seen in search/shop results gets a full detail fetch (price range, all photos, description, ratings). Slower but richer. If false, only the search/shop summary fields are captured. Default true.", "default": true }, "detailConcurrency": { "title": "Detail-fetch concurrency", "minimum": 1, "maximum": 10, "type": "integer", "description": "Parallel workers that pull listing IDs from the queue and fetch detail pages. Higher = faster but more aggressive on Etsy/DataDome. Range 1-10, default 5.", "default": 5 }, "maxRuntimeSeconds": { "title": "Max runtime (seconds)", "minimum": 30, "maximum": 86400, "type": "integer", "description": "Optional hard wall-clock cap on the actor run. The actor stops cleanly when the deadline is reached even if maxResults has not been hit. Leave blank for no internal limit." }, "sortOrder": { "title": "Search sort order", "enum": [ "most_relevant", "most_recent", "price_asc", "price_desc" ], "type": "string", "description": "Order applied to search queries only. most_relevant (default), most_recent, price_asc, price_desc.", "default": "most_relevant" }, "minPrice": { "title": "Min price (USD)", "minimum": 0, "type": "integer", "description": "Search-only price floor." }, "maxPrice": { "title": "Max price (USD)", "minimum": 0, "type": "integer", "description": "Search-only price ceiling." }, "proxyConfiguration": { "title": "Proxy", "type": "object", "description": "Apify residential US proxy is required to bypass DataDome. Leave default unless you know what you're doing.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```