Hello,

I noticed that in your run, you requested only reviews from the past week, so there are just a few results.

If you’d like more data, you can specify one of the following options: • ALL (for all available reviews) • WEEK, MONTH, SIX_MONTHS, or YEAR (for reviews from the selected time period)

Let me know how

Hi there - I have updated the options for review rating and time period but still only one result. I've also tested with another Feefo page but no luck. Any other ideas?

Can you share your input? I've tried now with

{
  "date": "ALL",
  "pages": 100,
  "url": "https://www.feefo.com/en-GB/reviews/distant-journeys-ltd"
}

and got 80 reviews

{ "date": "ALL", "pages": 100, "url": "https://www.feefo.com/en-GB/reviews/distant-journeys-ltd" }

and that yields me nothing. I have just tried it again and no results. The result should be a lot of reviews I think.

this is the response I got. Please note that even if you request only one company it returns an array with 1 element. Inside the first element you find an array "reviews"

Okay I got it. So they're not coming out in the format that I was anticipating, but that's okay. However the number of results is still incredibly small. With this criteria, there should be 2000+ reviews?

{ "date": "ALL", "pages": 100, "url": "https://www.feefo.com/en-GB/reviews/distant-journeys-ltd" }

Any further ideas or suggestions?

Yes, the original idea was to support multiple companies per run. Regarding the issue, I’ve checked and it looks like Cloudflare is stopping the actor after a few pages. I’ve now implemented a retry logic that should improve the chances of bypassing it.

However, if the issue persists, I recommend reducing the number of pages fetched per run. I’ve also introduced a new parameter called "page", which lets you define the starting page. By using "page" and "pages" together, you can now split the fetching process across multiple runs.

Indeed - every time I open Feefo I have to go through Cloudflare "prove you're human". I've tested with fetching 2 pages per run, trying from different starting pages (2/4/6) and the data fethced is all the same. :( You can see my last 3 tries all include the same data unfortunately.

Thanks for the feedback.

I checked the last 3 runs and noticed there was an overlapping page. This happened because of how I was counting pages. I was including the starting page plus the next ones, which caused an off-by-one issue.

For example, scraping 2 pages starting from page 4 was fetching pages 4, 5, and 6 instead of just 4 and 5. Similarly, scraping from page 2 fetched pages 2, 3, and 4. So page 4 ended up being duplicated.

I’ve now fixed the code: scraping 2 pages from page 2 will fetch pages 2 and 3, and scraping from page 4 will fetch pages 4 and 5, as expected