Allegro Product Detail Scraper
Pay $1.50 for 1,000 Products
This Actor may be unreliable while under maintenance. Would you like to try a similar Actor instead?
See alternative ActorsAllegro Product Detail Scraper
Pay $1.50 for 1,000 Products
Allegro Scraper allows you to scrape data from allegro.pl, allegro.cz and allegro.sk, one of the most popular online shopping platforms in Europe and the largest e-commerce platform of European origin.
Do you want to learn more about this Actor?
Get a demoCant scrape anything, bot protection
Closed
Hi, I was trying to scrape data about specific products and in all cases its blocking scraper from its job.
2024-06-27T16:27:22.220Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-turystyczny-kempingowy-3-osobowy-wodoodporny-przedsionek-peme-15213870689 2024-06-27T16:27:22.820Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-turystyczny-monsun-4-pro-acamper-3500mm-gratis-15479700634 2024-06-27T16:27:23.865Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-kempingowy-quechua-2-seconds-3-osobowy-15472227114 2024-06-27T16:27:24.352Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/przedsionek-kempingowy-quechua-arpenaz-6-osobowy-13888999931 2024-06-27T16:27:24.365Z INFO CheerioCrawler: [PRODUCT] Processing request: https://allegro.pl/oferta/namiot-abarqs-vigo-4-os-3000mm-przedsionek-tropik-wodoodporny-abarqs-15745234567 2024-06-27T16:27:25.887Z INFO [PRODUCT] Request failed, retrying... {"url":"https://allegro.pl/oferta/namiot-turystyczny-kempingowy-3-osobowy-wodoodporny-przedsionek-peme-15213870689","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:27.070Z INFO [PRODUCT] Request failed {"url":"https://allegro.pl/oferta/namiot-kempingowy-quechua-2-seconds-3-osobowy-15472227114","statusCode":200,"msg":"[PRODUCT] Detected bot protection, retrying..."} 2024-06-27T16:27:27.376Z INFO [PRO... [trimmed]
Hi, yes this unfortunately happens sometimes to users on the free plan due to a small/trial proxy pool, the team is already brainstorming possible improvements. I adjusted the settings of your account a bit and started a new run on your account with your input, please check it out and let me know if you have any other issues. Have a nice weekend! :)
MAA
Hi. Two questions:
- I'm about to use Your actor at scale (hundred of thousands URLs) - i see that many issues are with a proxy. Will the starter pack be enough for this operation? If not - what can we do about this?
- Is it possible to scrape URLs like - https://archiwum.allegro.pl/oferta/061-piornik-duzy-twardy-czarny-c-kemer-i14357383989.html ?
For example this run made 34/39 URLs, rest is failed (bot protection). I'm willing to pay the price but i need to be sure that i can use it for like 1 milion urls :) https://console.apify.com/actors/Ctugh61azcuDl4nDh/runs/zyS94U2dTqeS6egOz
Hi,
- You can scrape 1 milion urls for sure, but as you say, the issue might be blocking. Bigger proxy pool is a good start, but despite that we can't guarantee the success rate, there are the retries, but even that is sometimes not enough. Are you looking for a one-time scrape of the 1M urls? Or you want to re-scrape them on regular basis?
Here you can check the results which I got with your input (with a much bigger proxy pool) - https://api.apify.com/v2/datasets/VRT5NN2D8dubTWFaU/items?clean=true&format=json
- the archiwum links are not supported
MAA
Hi, thanks for fast response!
- I will have about 1M URL to one-time scrape, i was planning to scrape it in batches - 100k~ each batch. I'm prepared that part of batch will be blocked but i'm trying to figure out what big will be this part :).
- Damn :/ If You will be looking for new actor to make, archiwum is good idea ;)
Ok, thanks for the info, I'm sending you an email.
Tri⟁angleActor Metrics
16 monthly users
-
4 stars
>99% runs succeeded
2.7 days response time
Created in Apr 2024
Modified 15 days ago
