Rightmove Scraper avatar
Rightmove Scraper

Pricing

Pay per event

Go to Store
Rightmove Scraper

Rightmove Scraper

Developed by

Dhrumil Bhankhar

Dhrumil Bhankhar

Maintained by Community

Scrape rightmove.co.uk to crawl millions of sale/rent real estate properties from United Kingdom. Our real estate scraper also lets you monitor specific listing for new updates/listing. You can provide multiple search result listings to scrape/monitor.

3.0 (1)

Pricing

Pay per event

19

Total users

311

Monthly users

53

Runs succeeded

>99%

Issues response

2.3 hours

Last modified

a day ago

EC

23x times increase in price? no, thanks

Closed

edgy_catfish0 opened this issue
8 days ago

So, 0.5$ usually get me 1000 properties with settings like:

  • full property details
  • delisting tracking
  • price change

now, new price schema:

  • 10x more for full property details
  • 1x for delisting tracking
  • 0.5x for price tracking

total = 11.5x

11.5*2 (1$ for 1000 items) = 23x increase in price.

see screenshots attached

why so much?

dhrumil avatar

First of all let me remind you that in your screenshot you have used like 60 USD/day of scraper usage. Not a single penny is given to developer out of it. It's all platform usage and you are paying it to Apify (not developer).

In new pricing, platform usage is also on developer now. That means Apify is going to collect those 60 USD from developer. So, this cost will get passed on as subscription charge indirectly on you.

Secondly, developers also has to accomodate multiple cost components. e.g

  • Apify platform fees
  • Refunds issues by platform
  • Fraud activity charges
  • Overusage dues,
  • Unpaid invoice
  • Platform cost
  • Proxy cost
  • Sometimes docker containers get stuck for long period causing excessive billing

So, cost has to cover all these components to ensure developer is not in loss.

Thirdly, think it as developer that you are paying 30 USD per month to developer and 1000 USD to platform for scraping. Does that ratio not sound like unfair ? You never thought that it's 30x difference in terms share!

Lastly, I also discourage to put full property details setting on when you are scraping on large scale. It puts considerable amount of scraping load on rightmove server. If 100 users are doing this daily, it's unfair to rightmove to bear that much scraping load. There is 20x times more resources used when you turn on that setting. I have still kept it to 10x only.

Although, I understand your conern about cost specifically when you are scraping price history as well. This price change will not affect those who are not scraping history. I will still look into it further how components can be reduced further based on usage patterns. I have been supporting this community since long and you will not face any unnecessory troubles due to PPE pricing.

if you are scraping on large scale, please switch to API solution instead of scraping rightmove. It's drop in replacement to scraper without breaking any existing integrations. It will save you the cost instead of spending more. Please DM me dhrumil@techvasu.com for more information.

dhrumil avatar

Updates to my previous message :

  • Numbers are not as straight forward as simple multiplication like you demonstrated. Although, I appriciate your concern and I have reduced full property detail component to be 5x only now. I think, I will keep it that way for a month and hopefully, it will not burn the bills!

I would still recommend not to scrape on large scale frequently with full property details setting on rightmove. Rightmove is being good to community and let's respect and not burden their server with such load. For such usecase, like I said please switch to API solution which doesn't involve rightmove scraping and it will save your monthly bill as well.

This is best I can do. Thank you.

EC

edgy_catfish0

8 days ago

Hi Dhrumil,

Many thanks for breaking this down for me. I did not fully understand the pricing policy, and I was thinking that Apify would charge me the same on top of your pricing, but now I understand the cost structure. I'm happy to support you by paying for the tools.

And how can I connect to the API?

dhrumil avatar

Hi,

This is a public thread. Please leave your email address or DM me dhrumil@techvasu.com for API connection details.

Thanks, Dhrumil