Firmy Scraper 2.0 avatar
Firmy Scraper 2.0

Pricing

$30.00/month + usage

Go to Store
Firmy Scraper 2.0

Firmy Scraper 2.0

jupri/firmy

Developed by

cat

Maintained by Community

💼 Scrape Firmy.cz Business data

0.0 (0)

Pricing

$30.00/month + usage

6

Monthly users

5

Runs succeeded

>99%

Last modified

9 months ago

JB

Internal server error

Closed
jabadabadu opened this issue
a year ago

When there is more than 3000 items to crawl, scraper ends with: 2023-12-26T19:05:29.011Z ❌ Internal server error 2023-12-26T19:05:29.486Z ❌ error: Internal server error

In this category for example: https://www.firmy.cz/Cestovni-sluzby/Ubytovaci-sluzby/Penziony

JB

jabadabadu

a year ago

It will be fine to have some choice scraping with looping delay in seconds or minutes, to let server breathe between continuous scraping..?

Jupri avatar

cat (Jupri)

a year ago

Hi @cinnabar_ocher. Thanks for reporting. I'll look into it.

JB

jabadabadu

a year ago

Diky chlape :]

JB

jabadabadu

a year ago

And photos from gallery missing, there is often just one photo

JB

jabadabadu

a year ago

Ještě nejde nikdy stáhnout vce než 4000 itemů, například z těchto kategorií: Cestovni-sluzby/Ubytovaci-sluzby/Penziony (6912 items) Cestovni-sluzby/Ubytovaci-sluzby/Ubytovani-v-bytovych-apartmanech (9 577 items)

Šlo by to řešit i omezením počtu listing page od - do (?page=XY)

Jupri avatar

cat (Jupri)

a year ago

Hello. sorry, yesterday I cant update the actor, there is a platform issue. Please try again with the new update. Don`t forget to increase your RAM a little bit. (I need 512 MB to scrape 6000 records)

JB

jabadabadu

a year ago

Hello, you really made my day, it works so great! My friend, last thing what i missing is grabbed photogallery items, can you list all urls to photos in gallery. For example here is 19 photos: https://www.firmy.cz/detail/13193273-penzion-u-chodskeho-hradu-domazlice-mesto.html. Thank you for your response! I need to grab it. I see your crawler can list booking.com photos, that is very cool too! Thanks, Ondrej

JB

jabadabadu

a year ago

And emails are missing..

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

7 days

Price

$30.00