Allegro Product Detail Scraper
Pay $2.50 for 1,000 Products
Allegro Product Detail Scraper
Pay $2.50 for 1,000 Products
Allegro Scraper allows you to scrape data from allegro.pl, allegro.cz and allegro.sk, one of the most popular online shopping platforms in Europe and the largest e-commerce platform of European origin.
Do you want to learn more about this Actor?
Get a demoCant scrape anything, bot protection
Closed
Hi, I was trying to scrape data about specific products and in all cases its blocking scraper from its job.
2024-06-27T16:27:22.220Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-turystyczny-kempingowy-3-osobowy-wodoodporny-przedsionek-peme-15213870689 2024-06-27T16:27:22.820Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-turystyczny-monsun-4-pro-acamper-3500mm-gratis-15479700634 2024-06-27T16:27:23.865Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-kempingowy-quechua-2-seconds-3-osobowy-15472227114 2024-06-27T16:27:24.352Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/przedsionek-kempingowy-quechua-arpenaz-6-osobowy-13888999931 2024-06-27T16:27:24.365Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-abarqs-vigo-4-os-3000mm-przedsionek-tropik-wodoodporny-abarqs-15745234567 2024-06-27T16:27:25.887Z INFO [PRODUCT] Request failed, retrying... {"url":"https://allegro.pl/oferta/namiot-turystyczny-kempingowy-3-osobowy-wodoodporny-przedsionek-peme-15213870689","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:27.070Z INFO [PRODUCT] Request failed {"url":"https://allegro.pl/oferta/namiot-kempingowy-quechua-2-seconds-3-osobowy-15472227114","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:27.376Z INFO [PRODUCT] Request failed {"url":"https://allegro.pl/oferta/przedsionek-kempingowy-quechua-arpenaz-6-osobowy-13888999931","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:27.624Z INFO [PRODUCT] Request failed {"url":"https://allegro.pl/oferta/namiot-turystyczny-monsun-4-pro-acamper-3500mm-gratis-15479700634","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:28.497Z INFO [PRODUCT] Request failed {"url":"https://allegro.pl/oferta/namiot-abarqs-vigo-4-os-3000mm-przedsionek-tropik-wodoodporny-abarqs-15745234567","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:29.184Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-turystyczny-kempingowy-3-osobowy-wodoodporny-przedsionek-peme-15213870689 2024-06-27T16:27:31.320Z INFO [PRODUCT] Request failed, retrying... {"url":"https://allegro.pl/oferta/namiot-turystyczny-kempingowy-3-osobowy-wodoodporny-przedsionek-peme-15213870689","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:34.393Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-turystyczny-kempingowy-3-osobowy-wodoodporny-przedsionek-peme-15213870689 2024-06-27T16:27:36.731Z INFO [PRODUCT] Request failed {"url":"https://allegro.pl/oferta/namiot-turystyczny-kempingowy-3-osobowy-wodoodporny-przedsionek-peme-15213870689","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:36.813Z INFO CheerioCrawler: All requests from the queue have been processed, the crawler will shut down. 2024-06-27T16:27:37.984Z INFO CheerioCrawler: Final request statistics: {"requestsFinished":0,"requestsFailed":5,"retryHistogram":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,5],"requestAvgFailedDurationMillis":3504,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":2,"requestTotalDurationMillis":17522,"requestsTotal":5,"crawlerRuntimeMillis":103970} 2024-06-27T16:27:37.986Z INFO CheerioCrawler: Error analysis: {"totalErrors":5,"uniqueErrors":1,"mostCommonErrors":["5x: [PRODUCT] Detected bot protection, retrying... (file:///usr/src/app/dist/tools.js:66:15)"]} 2024-06-27T16:27:37.987Z INFO CheerioCrawler: Finished! Total 5 requests: 0 succeeded, 5 failed. {"terminal":true}
At last its just shuts down with 0 succeeded URLs scraped.
How can i fix it?
Hi, yes this unfortunately happens sometimes to users on the free plan due to a small/trial proxy pool, the team is already brainstorming possible improvements. I adjusted the settings of your account a bit and started a new run on your account with your input, please check it out and let me know if you have any other issues. Have a nice weekend! :)
Tri⟁angle- 15 monthly users
- 4 stars
- 99.8% runs succeeded
- 1.6 days response time
- Created in Apr 2024
- Modified 4 months ago
