Booking Scraper avatar
Booking Scraper
Try for free

Pay $5.00 for 1,000 results

View all Actors
Booking Scraper

Booking Scraper

voyager/booking-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape Booking with this hotels scraper and get data about accommodation on Booking.com. You can crawl by keywords or URLs for hotel prices, ratings, addresses, number of reviews, stars. You can also download all that room and hotel data from Booking.com with a few clicks: CSV, JSON, HTML, and Excel

User avatar

Not scrap everything

Closed

romain_jrds opened this issue
3 months ago

Good morning,

I would like to scrape the following url: https://www.booking.com/searchresults.fr.html?ss=Corse%2C+France&ssne=&ssne_untouched=&label=gen173nr-1FCAEoggI46AdIM1gEaE2IAQGYAQ24ARfIAQzYAQHoAQH4AQuIAgGoAgO4ArGq964GwAIB0gIkNThm NGFmMjctODQ4Yy00MDdlLWI1YTAtNDM3OTRkMGU0Mjdi2AIG4AIB&sid=c67f4e516010b0465ed7b2fbb3fb5ea1&aid=304142&lang=fr&sb=1&src_elem= sb&src =index&dest_id=1383&dest_type=region&group_adults=2&no_rooms=1&group_children=0

As you can see on this URL, there is the destination "Corse" without any filter. So there are 5,605 results.

I would therefore like to obtain these 5605 results and thus pay for your service ($5 for 1000 lists)

So I entered this URL into the actor and entered 8000 in the Max results per destination or URL field. I did not check any filters, I selected the French language and the euro currency. I launched the actor and it ended after 985 results.

Do you understand why? I would like to get my 5605 results in one go.

PS : I also tried not entering any url, but directly entering the city "Corse" in the first field. But I get the same result...

Thank you in advance for your assistance

User avatar

romain_jrds

3 months ago

Anybody ?

User avatar

Hi Romain,

thanks a lot for reporting this! Actually, Booking has a hard limit of 1000 hotels per search page.

Now, while our scraper utilizes some features to overcome this limit, it doesn't mean that you will scrape all of the results.

Though recently, booking has rolled out an update, which breaks our scraper a bit, getting less results by some significant margin.

We are currently working on a fix for this and it looks like the new update doesn't have the 1000 hotels limit anymore. Expect it to be finished in the next few days.

I will keep you updated here, thanks!

User avatar

romain_jrds

3 months ago

Great, I'm looking forward to this, because I really need to get all the results from the Booking search page at once

User avatar

romain_jrds

3 months ago

Do I need an APIFY subscription to retrieve 1000+ results with your Actor ?

User avatar

Hi again,

unfortunately it looks like the new Booking search is still limited for the maximum amount of results. This time it has a maximum of 1100...

No, you can scrape more than 1000+ results even on the free tier, this is a limitation of Booking, not ours.

Our scraper can extract all hotels for a specific stay date, but if the dates are not inputted, it can only extract as much as possible.

Note that the issue with the current search is still not fixed, we need to properly test it.

Thanks for your understanding.

User avatar

romain_jrds

3 months ago

ok thank you for your feedback, I will then wait for you to correct the problem of booking blocking at 1000 results per search. Keep me informed please

User avatar

Hi again,

I'm happy to inform you that we've just updated the Actor with the fix. You should now get more results.

Unfortunately, it turns out the new search still has the maximum amount of results limited, this time it's 1100 results per page.

Now how to overcome this limit

Our scraper can overcome the limit by either using price ranges (requires check-in and check-out dates, which limits results, but extract get all results for the given check-in-out) or by splitting the request by location filters, but they loose some results.

In your case, you do not have check-in and check-out dates, so the location filters will have to do the trick. I've tested them out and from 5771 results in Korsika, I got 5227 ;)

Unfortunately there is just no way to get all results. Theoretically you could use multiple non-overlapping hotel filters to get over the 1100 hotels limit on each URL, but this is manual work and this scraper currently doesn't support filter parameters in the input URLs.

I hope this helps. Try it out and let me know how it works, thanks!

User avatar

Sorry we've just found a small bug, which happens on pages with only a few results.

We will keep the Actor in beta before we fix this, but feel free to try it ;)

Developer
Maintained by Apify
Actor metrics
  • 148 monthly users
  • 99.4% runs succeeded
  • 4.6 days response time
  • Created in Aug 2023
  • Modified 18 days ago
Categories