Farfetch Scraper
3 days trial then $30.00/month - No credit card required now
Farfetch Scraper
3 days trial then $30.00/month - No credit card required now
Farfetch web scraper to crawl product information including price and sale price, color, and images.
Some data is missing, the actor is slow, and it often encounters numerous failures
Closed
The Farfetch product details should include the following information:
- Highlights
- Composition
- Washing Instructions
- Product IDs
However, I am not receiving this data during scraping. Could I be missing a configuration in the scraper setup?
Last time I requested to scrape data, it took only 10 to 11 seconds, but now it takes 3 minutes to complete. Could you explain why there is such a difference compared to before?
Thank you for your detailed feedback. Let me address your points:
-
Highlights, Composition, and Washing Instructions I will add these details to the scraper this week. I appreciate you bringing this to my attention, and I'm working on implementing these fields to provide more comprehensive product information.
-
Product IDs Could you clarify what specific type of Product IDs you're looking to extract? Farfetch typically has multiple identifiers.
-
Scraping Speed too slow Could you share more details about your current proxy setup? The type of proxy (residential, datacenter, selfhost) can significantly impact scraping performance. I'd be happy to help optimize the scraping speed and ensure smooth data extraction.
Please provide additional context about the Product IDs and proxy configuration, and I'll work on resolving these issues promptly.
promphanith
Thank you for your response.
-
Could you clarify what specific type of Product IDs you're looking to extract? In the product details, there is a section for Product IDs. Please refer to the attachment for what I am referring to. Example: https://www.farfetch.com/kh/shopping/women/sandro-layered-jacket-item-23749466.aspx
-
Could you share more details about your current proxy setup? Yes, I didn’t change anything in the proxy configuration; I am using the default settings. Please refer to my input below.
1{ 2 "maxConcurrency": 5, 3 "proxy": { 4 "useApifyProxy": true, 5 "apifyProxyGroups": [], 6 "apifyProxyCountry": "US" 7 }, 8 "startUrls": [ 9 { 10 "url": "https://www.farfetch.com/shopping/men/search/items.aspx?q=white", 11 "method": "GET" 12 }, 13 { 14 "url": "https://www.farfetch.com/shopping/women/search/items.aspx?q=white", 15 "method": "GET" 16 }, 17 { 18 "url": "https://www.farfetch.com/shopping/kids/search/items.aspx?q=white", 19 "method": "GET" 20 } 21 ], 22 "maxRequestsPerCrawl": 100 23}
thanks for your feedback.
i run your inputs with 1 concurrency using datacenter proxy. it got 100 items in 6mins which is fast enough. The scraping of 100 results from the above address in 10-11 seconds seems too fast, and I feel like this speed or the results might be problematic. You can try multiple times with the latest version to check a single-threaded speed of around 20 items per minute would be considered fast enough.
please have a try of the newest version of farfetch-scraper. fields Highlights，Composition，Washing Instructions，Product IDs infos are all supported.
promphanith
Thank you for updating these fields.
AutofactorActor Metrics
14 monthly users
-
5 stars
>99% runs succeeded
14 hours response time
Created in Jun 2022
Modified 21 days ago
