Allegro Fast Product Scraper
Pay $0.50 for 1,000 Products
Allegro Fast Product Scraper
Pay $0.50 for 1,000 Products
Allegro Scraper allows you to fastly scrape data from allegro.pl, allegro.cz and allegro.sk from the listing page , one of the most popular online shopping platforms in Europe and the largest e-commerce platform of European origin.
Do you want to learn more about this Actor?
Get a demoHow can I get all products from one seller?
Closed
Hello, I want to crawl one user from allegro - he have over 1200 products. But I get only 60 first products. here is my input { "searchDomains": [ "allegro.pl" ], "startUrls": [ "https://allegro.pl/uzytkownik/Agrosimex?order=qd" ] }
What I understand the script should go to the next page and crawl it, and then to the next page and next and next. Here is the log: 2024-08-29T08:38:30.837Z INFO CheerioCrawler: [CATEGORY] Processing request: https://allegro.pl/uzytkownik/Agrosimex?order=qd&p=2 2024-08-29T08:38:39.766Z INFO Loaded category page {"url":"https://allegro.pl/uzytkownik/Agrosimex?order=qd"} 2024-08-29T08:38:39.841Z INFO Saved 0 new products out of 60 products on the current page {"url":"https://allegro.pl/uzytkownik/Agrosimex?order=qd"} 2024-08-29T08:38:39.937Z INFO Enqueued next page {"url":"https://allegro.pl/uzytkownik/Agrosimex?order=qd&p=2"} 2024-08-29T08:38:40.336Z INFO CheerioCrawler: All requests from the queue have been processed, the crawler will shut down. 2024-08-29T08:38:40.821Z INFO CheerioCrawler: Final request statistics: {"requestsFinished":2,"requestsFailed":0,"retryHistogram":[1,1],"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":10284,"requestsFinishedPerMinute":4,"requestsFailedPerMinute":0,"requestTotalDurationMillis":20567,"requestsTotal":2,"crawlerRuntimeMillis":29008} 2024-08-29T08:38:40.822Z INFO CheerioCrawler: Finished! Total 2 requests: 2 succeeded, 0 failed. {"terminal":true}
But the system can not get next page to be crawled. How to set it up correctly? Regards Jacek
Hi Jacek! It works like it should, your input is correct. I think the issue is high blocking and the very limited proxy pool on your (free) plan. I was able to collect all the items in one run (but I have a bigger proxy pool). Here is the run, feel free to download the data: https://console.apify.com/view/runs/cHxqzuWuupU15y7vs
Tri⟁angle- 22 monthly users
- 1 star
- 90.4% runs succeeded
- 2.3 days response time
- Created in Apr 2024
- Modified 4 months ago
