Software Advice avatar

Software Advice

Try for free

1 day trial then $12.00/month - No credit card required now

Go to Store
Software Advice

Software Advice

canadesk/software-advice
Try for free

1 day trial then $12.00/month - No credit card required now

Get Products, Reviews, Statistics and Search results from Software Advice/Capterra. It's fast and costs little.

Developer
Maintained by Community

Actor Metrics

  • 4 monthly users

  • No reviews yet

  • 4 bookmarks

  • >99% runs succeeded

  • 1.4 days response time

  • Created in Dec 2023

  • Modified 21 days ago

RE

Scraper not capturing recent reviews - gap in latest data

Closed
reecheeio opened this issue
24 days ago

Hi team,

I've noticed an issue with the Software Advice review scraper where it's not capturing the most recent reviews. Here's what I've observed in this run for Zoho CRM:

Scraper reports in the logs: 6,115 reviews found (with max set to 500) Actual number on Software Advice: 6,925 reviews (https://www.softwareadvice.com/crm/zoho-crm-profile/reviews/)

No reviews from 2025 are present in the scraped data This indicates a ~810 review gap, likely from the most recent period

I've checked multiple runs and the pattern is consistent - newer reviews are not being captured in the dataset.

Would appreciate your help in investigating this discrepancy to ensure we're getting the most current data.

Thanks for your attention to this! Looking forward to your feedback.

canadesk avatar

Hello,

Thanks for the heads up! It looks like SA changed their backend significantly with the new year.

Their legacy system still returns data prior to the change, however it's not being updated anymore.

We'll look into it.

canadesk avatar

Fixed. Make sure to use process "Get Reviews" (gn) and not "Get Reviews (Legacy)" (gr). Please note SoftwareAdvice now returns a different response format.

If you have more questions, feel free to answer this issue (no need to open a new one).

RE

reecheeio

22 days ago

Amazing, thanks a lot! A small issue though:

{ "companySize": "C", "firstName": "Frank", "industry": "Renewables & Environment", "isValidated": true, "profilePictureUrl": "https://reviews.capterra.com/cdn/profile-images/linkedin/400f8ce578711bedd25c6edbf643315dd518293c1ddf56cf8d9eb29221df6f38.jpeg" }

Here it returns last name but puts into companySize, and company size itself is not captured...

canadesk avatar

The results are the same as the ones returned by SA directly.

From the website, you can see that sizes are categorized by letters from A to I:

Self-Employed 2-10 11-50 51-200 201-500 501-1,000 1,001-5,000 5,001-10,000 10,000+

In other words, "C" is 11-50.

RE

reecheeio

22 days ago

oooh, thank you! missed that!

can you please also take a look at latest runs? some of them throw an error... https://console.apify.com/actors/vbHW0bSPkWumHGdqU/runs/UgT5xqIidJwcw7g5a#log

canadesk avatar

Please try again.

RE

reecheeio

22 days ago

Same: 💣 Something went wrong (fetching reviews)! for this latest run: https://console.apify.com/actors/vbHW0bSPkWumHGdqU/runs/3ccPnSET457MJaBTd#log

would increasing memory limit help?

canadesk avatar

No, our actors have minimal resource cost. Please try again.

The new SA engine doesn't have a single way to deal with the software, so "zendesk" was working but not "PromoTix".

Hoperfully, it is now fixed. We also mapped companySize to the filter value automatically.

{ "consText": "I wished the report on the excel spreadsheet included those who were my guests", "customerSupportRating": 5, "easeOfUseRating": 5, "frequencyOfUsing": "Monthly", "functionalityRating": 5, "generalComments": "Excellent. I have referred a couple of friends", "id": "Capterra___6672116", "overallRating": 5, "prosText": "It was easy to use and I could share it easily", "reasonsForChoosing": "", "reasonsForSwitching": "Promotix was cheaper and they had ever feature I needed", "reviewer": { "companySize": "Self-Employed", "firstName": "Ruth", "industry": "Management Consulting", "isValidated": true, "profilePictureUrl": "https://reviews.capterra.com/cdn/profile-images/linkedin/cfd4163cdff585c01ee719c1fdbc1572e4bcd5e9a1c281b3e7c66fc5320bb893.jpeg" }, "reviewerAnonymityOn": false, "reviewerIncentive": "NoIncentive", "timeUsed": "LessThan12Months", "title": "Great experience with Promotix", "valueForMoneyRating": 5, "vendorReply": null, "writtenOn": "2025-01-29T17:14:22Z" },

RE

reecheeio

22 days ago

oh yes, now seems to work perfectly fine! thanks a lot! and thank you for updating the companySize!

do you happen to know how often should I update the cookies string?

thanks again!