Etsy Scraper Actor

What is Etsy Scraper actor?

The Etsy Scraper actor is an advanced data extraction tool tailored for the bustling marketplace of Etsy. With no official API available, this actor serves as a crucial bridge to access a wealth of information from Etsy's database. It's designed to help you effortlessly retrieve detailed data from product listings, search results, and various categories within Etsy, offering invaluable insights for market analysis, competitive research, and strategic planning.

Key features

• 📋 Product Details Scraping: Access an extensive range of product attributes including images, seller information, and listing times.
• 🔍 Search Result Scraping: Extract data for any specific search result by keyword, giving you the flexibility to target niche markets.
• 🗂️ Category Scraping and Filtering: Navigate and scrape through any category with custom filters to refine your search.
• 🎛️ Controlled Scraping: Specify the number of pages you wish to scrape, from a single page to the entire category listing - If you only want to scrape the first 3 pages, there is an option for that.

Use Cases | Who Can Use Etsy Scraper

• SMBs & Entrepreneurs to conduct comprehensive market research and analysis.
• Marketers & Strategists to gain insights into customer preferences and trends.
• Shoppers & Collectors to find unique items and compare prices across the platform.

Need to find product pairs between Etsy and another online shop?

Use the AI Product Matcher🔗. This AI model allows you to compare items from different web stores, identifying exact matches and comparing real-time data obtained via web scraping.

With the AI Product Matcher, you can use scraped product data to monitor product matches across the industry, implement dynamic pricing for your website, replace or complement manual mapping, and obtain realistic estimates against your competition for upcoming promo campaigns. Most importantly, it is relatively easy to get started with (just follow this guide) and can match thousands of product pairs.

Input

Either start with a keyword or specific URL to your research. You can use any product, category, keyword research, or Etsy store URL.

💡When you want to have filtering over a category URL; go to Etsy, create filters over the category, and copy and paste the link as one of the startUrl.

💡If you would like to scrape only the first page of a search list or category list, then put the link for the page and have the endPage as 1.

With the last approach that is explained above you can also fetch any interval of pages. If you provide the 5th page of a category and define the endPage parameter as 6 then you'll have the 5th and 6th pages only.

It is recommended to keep the other options as default.

Input Parameters Explained

The input of this scraper should be JSON containing the list of pages on Etsy that should be visited. Possible fields are:

• search: (Optional) (String)

  Keywords that can be searched in the Etsy search engine.

• startUrls: (Optional) (Array)

  List of Etsy URLs. You should only provide category details, product details, seller items, or search URLs.

• includeDescription: (Optional) (Boolean)

  If you want to fetch description HTML (or text) you can enable this option. The default value is false.

• endPage: (Optional) (Number)

  Final number of pages that you want to scrape. The default is Infinite. This applies to all search requests and startUrls individually.

• maxItems: (Optional) (Number)

  You can limit scraped items. This should be useful when you search through the big lists or search results.

• proxy: (Required) (Proxy Object)

  Proxy configuration.

• extendOutputFunction: (Optional) (String)

  A function that takes a JQuery handle ($) as an argument and returns an object with data.

• customMapFunction: (Optional) (String)

  A function that takes each object's handle as an argument and returns the object with executing the function.

This solution requires the use of Proxy servers, either your own proxy servers or you can use Apify Proxy.

Etsy Scraper Input Example

1{
2    "startUrls": [
3        "https://www.etsy.com/c/clothing-and-shoes?ref=pagination&page=4"
4    ],
5    "search": "apple watch",
6    "endPage": 6,
7    "includeDescription": true,
8    "maxItems": 100
9}

Compute Unit Consumption

The actor is optimized to run blazing fast and scrape as many products as possible. Therefore, it forefronts all product detail requests. If the actor doesn't block very often it'll scrape 50 products in 1 minute with ~0.04-0.05 compute units.

Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests you can create an issue from here.

During the Run

During the run, the actor will output messages letting you know what is going on. Each message always contains a short label specifying which page from the provided list is currently specified. When items are loaded from the page, you should see a message about this event with a loaded item count and total item count for each page.

If you provide incorrect input to the actor, it will immediately stop with a failure state and output an explanation of what is wrong.

Etsy Export

During the run, the actor stores results into a dataset. Each item is a separate item in the dataset.

You can manage the results in any language (Python, PHP, Node JS/NPM). See the FAQ or our API reference to learn more about getting results from this Amazon actor.

Output

The structure of each item in Etsy products looks like this:

1{
2    "url": "https://www.etsy.com/listing/498417899/edc-slim-valet-personalized-pocket?ga_order=most_relevant&ga_search_type=all&ga_view_type=gallery&ga_search_query=&ref=sr_gallery-4-29&frs=1&cns=1&col=1",
3    "name": "EDC Slim Valet - Personalized Pocket Organizer, Handmade in the USA\nRegions Etsy does business in:",
4    "images": [
5        "https://i.etsystatic.com/13963159/r/il/3d1876/3180744258/il_794xN.3180744258_olzc.jpg",
6        "https://i.etsystatic.com/13963159/r/il/a3c7cf/1617748881/il_794xN.1617748881_1o26.jpg",
7        "https://i.etsystatic.com/13963159/r/il/9eb645/1570294448/il_794xN.1570294448_oe8w.jpg",
8        "https://i.etsystatic.com/13963159/r/il/6b2a6a/1570293332/il_794xN.1570293332_8z6i.jpg",
9        "https://i.etsystatic.com/13963159/r/il/39f7ad/3180744724/il_794xN.3180744724_2baa.jpg",
10        "https://i.etsystatic.com/13963159/r/il/08b20b/3180745230/il_794xN.3180745230_95a2.jpg",
11        "https://i.etsystatic.com/13963159/r/il/31e60f/3494515703/il_794xN.3494515703_54ci.jpg",
12        "https://i.etsystatic.com/13963159/r/il/352b64/3458390857/il_794xN.3458390857_4ity.jpg"
13    ],
14    "seller": {
15		"name": "OnMyWristCo",
16		"url": "https://www.etsy.com/uk/shop/OnMyWristCo?ref=shop-header-name&listing_id=1515784194&from_page=listing",
17		"numberOfReviews": 12000,
18		"rating": 3.9179
19	},
20    "numberOfReviews": 78,
21    "Price": "$49.00+",
22    "variations": [
23        {
24            "label": "Color",
25            "values": [
26                "Dark Chocolate",
27                "Mahogany",
28                "Cordovan"
29            ]
30        },
31        {
32            "label": "Personalize / Monogram",
33            "values": [
34                "None ($49.00)",
35                "Monogram ($59.00)"
36            ]
37        }
38    ],
39    "highlights": [
40        "Handmade",
41        "Materials: leather, metal rivets"
42    ],
43    "listedOn": "Dec 26, 2022",
44    "favorites": 806,
45    "relatedSearches": [
46        {
47            "name": "EDC Pocket Organizer",
48            "link": "https://www.etsy.com/market/edc_pocket_organizer?ref=seller_tag_bottom_image-0"
49        },
50        {
51            "name": "EDC Wallet",
52            "link": "https://www.etsy.com/market/edc_wallet?ref=seller_tag_bottom_image-1"
53        },
54        {
55            "name": "EDC Organizer",
56            "link": "https://www.etsy.com/market/edc_organizer?ref=seller_tag_bottom_image-2"
57        },
58        {
59            "name": "EDC Pocket",
60            "link": "https://www.etsy.com/market/edc_pocket?ref=seller_tag_bottom_image-3"
61        },
62        {
63            "name": "Everyday Carry Gear",
64            "link": "https://www.etsy.com/market/everyday_carry_gear?ref=seller_tag_bottom_image-4"
65        },
66        {
67            "name": "Pocket Organizer",
68            "link": "https://www.etsy.com/market/pocket_organizer?ref=seller_tag_bottom_image-5"
69        },
70        {
71            "name": "Leather Organizer",
72            "link": "https://www.etsy.com/market/leather_organizer?ref=seller_tag_bottom_image-6"
73        },
74        {
75            "name": "EDC",
76            "link": "https://www.etsy.com/market/edc?ref=seller_tag_bottom_image-7"
77        },
78        {
79            "name": "EDC Gear",
80            "link": "https://www.etsy.com/market/edc_gear?ref=seller_tag_bottom_image-8"
81        },
82        {
83            "name": "Minimalist EDC",
84            "link": "https://www.etsy.com/market/minimalist_edc?ref=seller_tag_bottom_image-9"
85        },
86        {
87            "name": "Gift for Men",
88            "link": "https://www.etsy.com/market/gift_for_men?ref=seller_tag_bottom_image-10"
89        },
90        {
91            "name": "Holiday Gift",
92            "link": "https://www.etsy.com/market/holiday_gift?ref=seller_tag_bottom_image-11"
93        },
94        {
95            "name": "Rutsu Designs",
96            "link": "https://www.etsy.com/market/rutsu_designs?ref=seller_tag_bottom_text-0"
97        }
98    ]
99}

Important Note for Etsy

Don't worry when you get a little bit different products than you saw on the browser page. Etsy is ordering products differently for each user.

How to use Etsy Scraper

FAQ

How do I begin scraping Etsy listings?
Simply input your targeted URLs or search terms into the actor, and it will navigate the Etsy marketplace to gather the data you need. 💻

Is real-time data scraping possible with Etsy Scraper?
Yes, Etsy Scraper can fetch real-time data, ensuring you're always informed with the most current insights. ⏱️

Is it legal to scrape data from Etsy?
While scraping public data is generally permissible, it's crucial to adhere to Etsy's terms of service and conduct your data scraping responsibly. Avoid excessive server requests and ensure you're not infringing on any personal data privacy regulations. ⚖️

Contact

Please visit us through epctex.com to see all the products that are available for you. If you are looking for any custom integration or so, please reach out to us through the chat box in epctex.com. In need of support? devops@epctex.com is at your service.