3 days trial then $25.00/month - No credit card required now
Realtor.com Scraper
3 days trial then $25.00/month - No credit card required now
Uncover valuable insights from realtor.com's extensive property listings. Extract descriptions, images, features, property details, pricing, neighborhood details, nearby schools, and more for millions of properties. Customize your searches and filters to find the perfect real estate data.
Unreliable, slower and 10x more expensive
Closed
Not only is this scraper much more expensive than it used to be, it fails about a third of the time. A shame because this scraper used to be great. Before I could scrape 300,000+ listings for less than $40. Now it's 10x that price! I have 8,000 listings I need scraped and I only get 2,483 of them. $3 = "Finished! Total 3696 requests: 2483 succeeded, 1213 failed." What happened to the quality, speed and affordability?
Hey Brad,
It is great to see you again! This is Tugkan. When I saw your name, I wanted to personally take care of this issue.
Unfortunately, after years, the Realtor website increased its protection step by step, and they made everything harder for scrapers to retrieve. Software protections, IP bans, geotargeting, and many other blockages. Therefore, this led us to operate with higher costs and lower outputs - both in the run execution and rental price. However, if you don't mind, I would like to keep this issue open for a while and talk with the Engineering Team. Even though they are actively maintaining the actor; I want to take a look into the actor, investigate, and find a way to increase the efficiency.
Will keep you posted. Best
bradwatts
Thank you, Tugkan. I appreciate your quick response.
Hey Brad,
Again, it is great to see you, and thank you very much for letting us know about the problem. After your inquiry, we gathered up as the Engineering Team and had an investigation on Realtor Scraper. After a couple of rounds of optimization, the actor works better now. We deployed the optimized version to Apify. Please use the latest version for the best experience. Benchmarks show that the optimized version scrapes 2.6K results for around $0.28 which is way much better than before. An example run can be found here: https://console.apify.com/view/runs/pRcNqi56qaAMJbwBJ
As I mentioned earlier, the Realtor website increased the protection levels over time. Currently, the actor has the mechanisms to overcome these protections, but still, sometimes low-quality IPs become a problem. The run that I shared is a Datacenter Proxy execution. It worked well for us and it should work well for you too.
The topic I mentioned above leads us to operate with higher costs and lower outputs - both in the run execution and rental price. However, the optimized version should act better now.
I am closing the issue for Project Management purposes. But this doesn't mean that we don't check here or we will stop looking for more ways to optimize. Whenever you want to reach out, you can comment here, reopen the issue, or directly email us. We will be there for you.
Please let me know how it goes and please let us know if there is anything that we can assist you with, Best
epctex- 33 monthly users
- 99.8% runs succeeded
- 0.9 days response time
- Created in Mar 2021
- Modified about 18 hours ago
