Allegro Fast Product Scraper avatar

Allegro Fast Product Scraper

Try for free

Pay $0.50 for 1,000 Products

View all Actors
Allegro Fast Product Scraper

Allegro Fast Product Scraper

tri_angle/allegro-fast-product-scraper
Try for free

Pay $0.50 for 1,000 Products

Allegro Scraper allows you to fastly scrape data from allegro.pl, allegro.cz and allegro.sk from the listing page , one of the most popular online shopping platforms in Europe and the largest e-commerce platform of European origin.

Do you want to learn more about this Actor?

Get a demo
YC

How can I get all products from one seller?

Closed

yacenty2 opened this issue
3 months ago

Hello, I want to crawl one user from allegro - he have over 1200 products. But I get only 60 first products. here is my input { "searchDomains": [ "allegro.pl" ], "startUrls": [ "https://allegro.pl/uzytkownik/Agrosimex?order=qd" ] }

What I understand the script should go to the next page and crawl it, and then to the next page and next and next. Here is the log: 2024-08-29T08:38:30.837Z INFO CheerioCrawler: [CATEGORY] Processing request: https://allegro.pl/uzytkownik/Agrosimex?order=qd&p=2 2024-08-29T08:38:39.766Z INFO Loaded category page {"url":"https://allegro.pl/uzytkownik/Agrosimex?order=qd"} 2024-08-29T08:38:39.841Z INFO Saved 0 new products out of 60 products on the current page {"url":"https://allegro.pl/uzytkownik/Agrosimex?order=qd"} 2024-08-29T08:38:39.937Z INFO Enqueued next page {"url":"https://allegro.pl/uzytkownik/Agrosimex?order=qd&p=2"} 2024-08-29T08:38:40.336Z INFO CheerioCrawler: All requests from the queue have been processed, the crawler will shut down. 2024-08-29T08:38:40.821Z INFO CheerioCrawler: Final request statistics: {"requestsFinished":2,"requestsFailed":0,"retryHistogram":[1,1],"requestAvgFailedDurationMillis":null,"requestAvgFinishedDurationMillis":10284,"requestsFinishedPerMinute":4,"requestsFailedPerMinute":0,"requestTotalDurationMillis":20567,"requestsTotal":2,"crawlerRuntimeMillis":29008} 2024-08-29T08:38:40.822Z INFO CheerioCrawler: Finished! Total 2 requests: 2 succeeded, 0 failed. {"terminal":true}

B... [trimmed]

tri_angle avatar

Hi Jacek! It works like it should, your input is correct. I think the issue is high blocking and the very limited proxy pool on your (free) plan. I was able to collect all the items in one run (but I have a bigger proxy pool). Here is the run, feel free to download the data: https://console.apify.com/view/runs/cHxqzuWuupU15y7vs

Developer
Maintained by Apify

Actor Metrics

  • 20 monthly users

  • 2 stars

  • 88% runs succeeded

  • 22 days response time

  • Created in Apr 2024

  • Modified 17 days ago

Categories