Realtor Scraper

Crawl the Realtor real estate listings site and extract data about homes for sale. Scrape home details for multiple search locations (City, Neighborhood, Zip, and County) and various search criteria and filters. Download and use the data whatever way you want.

Features

• Multiple properties URLs
• Multiple search locations
• Multiple search types (Buy, Rent, Sold)

Cost of usage

When running the actor with memory of 1024 MB and residential proxies, average consumption is about 0.3 Compute Unit and 15 minutes per 1000 properties. This will cost about $1.5 usage credits.

Bugs, issues, features, and feedback

You can report issues on the Actor tab "Issues" or here and discuss or leave your feedback here.

Input

You can provide input either through the editor on the Apify platform or as a JSON object.

The only mandatory fields you need to provide are:

• at least one of: startUrls or searchLocations.
• if you will provide searchLocations, at least one of: searchTypeBuy, searchTypeRent, and searchTypeSold with the value true (by default, searchTypeBuy is true).

An example of minimal input:

1{
2    "startUrls": [
3        {
4            "url": "https://www.realtor.com/realestateandhomes-search/Bergen-County_NJ/"
5        },
6        {
7            "url": "https://www.realtor.com/realestateandhomes-detail/327-Springfield-Ave_Hasbrouck-Heights_NJ_07604_M60638-38753"
8        }
9    ],
10    "searchLocations": [
11        "San Francisco"
12    ],
13    "searchTypeBuy": true,
14    "sortOption": "NO_SORTING",
15    "proxyConfiguration": {
16        "useApifyProxy": true,
17        "apifyProxyGroups": [
18            "RESIDENTIAL"
19        ]
20    }
21}

The scraper forcibly use Apify Proxy so that you don’t get blocked by Realtor. You should use residential proxies to reduce blocking. Also, you should also use a low value for max concurrency.

Output

For each search location combined with the search type (Buy, Rent, or Sold), and for each start URL, you get home results.

The output of each home looks like this:

1{
2    "url": "https://www.realtor.com/realestateandhomes-detail/113-Pershing-Rd_Englewood-Cliffs_NJ_07632_M52751-23667?from=srp-list-card",
3    "query": "",
4    "searchLocation": "",
5    "photos": [
6        "http://ap.rdcpix.com/d56f7bce681634df5976ce27dc0286a2l-m2583100964s.jpg",
7        "http://ap.rdcpix.com/d56f7bce681634df5976ce27dc0286a2l-m1922830920s.jpg",
8        "http://ap.rdcpix.com/d56f7bce681634df5976ce27dc0286a2l-m630593322s.jpg"
9    ],
10    "metaDescription": "Experience unparalleled luxury in this meticulously crafted all-brick colonial, custom-built in 2006, spanning over 9, 000 sq.ft. with basement. Nestled in the prestigious north side of Englewood Cliffs, moments from NYC, this residence offers six bedrooms, six full baths, & three half baths, including a main-level en-suite. The gourmet kitchen, with top-of-the-line appliances, a charming breakfast nook, & a butler's pantry, is perfect for entertaining. A grand foyer leads to a 32-foot great room with a dual gas fireplace, office, dining, & living rooms, adorned with stunning hardwood flooring. Upstairs, find four en-suite bedrooms & a lavish primary suite. The lower level boasts additional living space. Modern amenities include an elevator, 14-zone heating, 7-zone C/A, & a full house generator. Outside, a circular driveway & concrete balusters add elegance, while a 5-zone sprinkler system ensures lush landscaping. Experience the epitome of luxury living in this timeless masterpiece.",
11    "location": {
12        "city": "Englewood Cliffs",
13        "country": "USA",
14        "line": "113 Pershing Rd",
15        "postal_code": "07632",
16        "state": "New Jersey",
17        "state_code": "NJ",
18        "street_direction": null,
19        "street_name": "Pershing",
20        "street_number": "113",
21        "street_post_direction": null,
22        "street_suffix": "Rd",
23        "unit": null,
24        "validation_code": "121",
25        "coordinates": {
26            "lat": 40.886468,
27            "lon": -73.950803
28        }
29    },
30    "price": 3395000,
31    "bedrooms": 6,
32    "bathrooms": 9,
33    "propertyType": "single_family",
34    "propertySubType": null
35}