Capterra Scraper
7 days trial then $40.00/month - No credit card required now
Capterra Scraper
7 days trial then $40.00/month - No credit card required now
Extract valuable data from the Capterra software database with our Capterra Scraper. Gather product information, related products, insights, portfolio, real client reviews, and more. Explore top software listings for your business.
More 403s encountered
Closed
Hi - I am again running into a lot of 403s. These were 403s from my last run that I decided to retry and I got them again so perhaps it's something about these product IDs specifically? Please look into this. I have already paid a lot of money for usage due to these errors, I would appreciate a refund of my subscription for the month since the crawler is not working as expected.
misha_nv-owner
Also I'm not understanding the settings, I think. I have the Actor set to fetch only reviews. There is a setting for "Maximum number of listing items" and "reviews end page". I set the max number of listing items to 50, expecting to get 50 reviews per company/URL. But I have some where I am getting some with as many as 500 reviews. I set reviews end page to 10. On the website I see 25 reviews per page so I'd expect to get no more than 250. Can you tell me which setting I should be using to get 50 reviews per URL? What if I want 100?
tugkan_epctex
Hey there,
Thank you very much for reaching out. I also saw your other comment on the prior issue but let's continue the discussion from here because of the new Run ID you've shared with us.
Let me first explain the options of the actor;
- Maximum number of listing items is the total items you will receive on the output. If you enter that value as 100, the actor stops itself on the 100th data point.
- Review end page is the total number of pages that will be retrieved from each company/product. If you enter that value as 5, the actor will retrieve all the reviews per each product/company until their 5th page.
In your case, I think it would be ideal to remove the "Maximum number of listing items" completely, and set the "Reviews end page" as 4 if you want to retrieve 100 reviews per each product/company.
About the refund, unfortunately, this is out of our hands. We are a company that is providing services in the Apify Marketplace and all the billing/refund and invoice-related concerns need to be discussed with Apify Support. For further assistance with the refund, you can click on the blue button at right bottom and start a discussion with the Apify team. I'm sure they can help you out with it.
About the 403s, unfortunately, Capterra has extremely high precautions on the software security. They are using a top-notch tool called PerimeterX and this is more or less all the penetration that an actor can do. We put an eye on it already and trying to increase the... [trimmed]
epctex
