Realtor.com Scraper Light

What does Realtor.com Scraper Light do?

This unofficial Realtor.com Scraper will get data from realtor.com search pages and output it in a variety of formats: CSV, Excel, XML, RSS, JSON, HTML.

Questions / Issues / Improvements? Contact me at telegram @arrvee or email realtor@arrv.dev

Realtor.com Scraper Light allows you to scrape search pages (with filters applied) and extract the following info about each listing:

• URL (link to the listing, e.g. https://www.realtor.com/realestateandhomes-detail/12374-N-1750-Rd_Erick_OK_73645_M78753-68220)
• status (for_sale, etc.)
• listing_id
• list_price
• beds
• baths
• stories
• type (single_family, etc.)
• lot_sqft
• sqft
• year_built
• address_line (e.g. "12374 N 1750 Rd")
• postal_code
• state_code
• city
• county_name
• fips_code (e.g. "40009")
• list_date
• main_pic (e.g. "https://ap.rdcpix.com/661a66cd87db0ac5b391d0316fd5d77cl-m167737134s.jpg",)
• secondary_pic (e.g. "https://ap.rdcpix.com/661a66cd87db0ac5b391d0316fd5d77cl-m4162004147s.jpg")
• brokered_by (e.g "UC Exploration Realty LLC")
• lat (e.g. 35.222221)
• lon (e.g. -99.858172)

How is it different from other Realtor.com scrapers?

This parser doesn't go into listing details, so you won't be able to get info like neighboring schools. On realtor.com are 42 items per page, so not visiting each details page is 43 times faster and cheaper.

How much will it cost to scrape Realtor.com? And how long does it take?

It's virtually free. You will get about 500,000 results for $1.

It takes about 30 seconds to get 1000 results.

Inputs

startUrls: Realtor.com search urls, for example Montana homes with lot size over 5 acres - and here are the results for this URL. Set as many filters as you wish, copy the resulting page addresses. These are your start urls. Make sure only to use the first search result pages.

limitPages: Want to only fetch the first 5 pages? Set this to 5.

Example:

1{
2    "startUrls": [{
3        "url": "https://www.realtor.com/realestateandhomes-search/Montana/sqft-2750/lot-sqft-653400"
4    }],
5    "limitPages": 2
6}

Output

You'll get data regarding each particular listing. You can download those results as an Excel, HTML, XML, JSON, and CSV document.

Example:

1[{
2  "href": "https://www.realtor.com/realestateandhomes-detail/196-Paul-Creek-Ln_Cascade_MT_59421_M89174-47540",
3  "status": "for_sale",
4  "listing_id": "2942617841",
5  "list_price": 215000,
6  "beds": 2,
7  "baths": 1,
8  "stories": 2,
9  "type": "single_family",
10  "lot_sqft": 467399,
11  "sqft": 800,
12  "year_built": 2010,
13  "address_line": "196 Paul Creek Ln",
14  "postal_code": "59421",
15  "state_code": "MT",
16  "city": "Cascade",
17  "list_date": "2022-04-30T23:33:50Z",
18  "brokered_by": "Canyon Properties Llc",
19  "county_name": "Cascade",
20  "fips_code": "30013",
21  "main_pic": "https://ap.rdcpix.com/f555ee7b043a81b3b1f399464951f3d7l-m2730180810s.jpg",
22  "secondary_pic": "https://ap.rdcpix.com/f555ee7b043a81b3b1f399464951f3d7l-m3798432257s.jpg",
23  "lat": 47.170208,
24  "lon": -111.926708
25}]

What else is it possible to get?

Here's the full info available on realtor.com search pages. Some of it has been omitted from results since it was deemed uninteresting by developer (me). If you need any of this - tell me and I'll add it in minimal time.

1{
2  "property_id": "9322425285",
3  "list_price": 850000,
4  "primary_photo": {
5    "href": "https://ap.rdcpix.com/aaac82742af3798f47767dd24ab786c4l-m391104037s.jpg"
6  },
7  "source": {
8    "id": "GAMT",
9    "agents": [
10      {
11        "office_name": null
12      }
13    ],
14    "type": "mls",
15    "spec_id": null,
16    "plan_id": null
17  },
18  "community": null,
19  "products": {
20    "brand_name": "essentials",
21    "products": [
22      "core.agent",
23      "core.broker",
24      "co_broke"
25    ]
26  },
27  "listing_id": "2942615386",
28  "matterport": false,
29  "virtual_tours": null,
30  "status": "for_sale",
31  "permalink": "4-Box-Canyon-Rd_Livingston_MT_59047_M93224-25285",
32  "price_reduced_amount": null,
33  "other_listings": {
34    "rdc": [
35      {
36        "listing_id": "2942615386",
37        "status": "for_sale",
38        "listing_key": null,
39        "primary": true
40      },
41      {
42        "listing_id": "2933683309",
43        "status": "off_market",
44        "listing_key": null,
45        "primary": null
46      }
47    ]
48  },
49  "description": {
50    "beds": 3,
51    "baths": 2,
52    "baths_full": 2,
53    "baths_half": null,
54    "baths_1qtr": null,
55    "baths_3qtr": null,
56    "garage": null,
57    "stories": 1,
58    "type": "mobile",
59    "sub_type": null,
60    "lot_sqft": 1540282,
61    "sqft": 897,
62    "year_built": 1992,
63    "sold_price": null,
64    "sold_date": "2012-08-10",
65    "name": null
66  },
67  "location": {
68    "street_view_url": "https://maps.googleapis.com/maps/api/streetview?channel=rdc-streetview&client=gme-movesalesinc&location=4%20Box%20Canyon%20Rd%2C%20Livingston%2C%20MT%2059047&size=640x480&source=outdoor&signature=u2jxDf8wx8IiqyQ2NUJm3EW_wd4=",
69    "address": {
70      "line": "4 Box Canyon Rd",
71      "postal_code": "59047",
72      "state": "Montana",
73      "state_code": "MT",
74      "city": "Livingston",
75      "coordinate": {
76        "lat": 45.627504,
77        "lon": -110.644814
78      }
79    },
80    "county": {
81      "name": "Park",
82      "fips_code": "30067"
83    }
84  },
85  "tax_record": {
86    "public_record_id": "183BF8F1D0C41F16A363CA3F315A8A4D"
87  },
88  "lead_attributes": {
89    "show_contact_an_agent": true,
90    "opcity_lead_attributes": {
91      "cashback_enabled": true,
92      "flip_the_market_enabled": true
93    },
94    "lead_type": "co_broke"
95  },
96  "open_houses": null,
97  "flags": {
98    "is_coming_soon": null,
99    "is_pending": null,
100    "is_foreclosure": null,
101    "is_contingent": null,
102    "is_new_construction": null,
103    "is_new_listing": true,
104    "is_price_reduced": null,
105    "is_plan": null,
106    "is_subdivision": null
107  },
108  "list_date": "2022-04-30T20:23:21Z",
109  "last_update_date": "2022-04-30T14:22:35Z",
110  "coming_soon_date": null,
111  "photos": [
112    {
113      "href": "https://ap.rdcpix.com/aaac82742af3798f47767dd24ab786c4l-m391104037s.jpg"
114    },
115    {
116      "href": "https://ap.rdcpix.com/aaac82742af3798f47767dd24ab786c4l-m2000015332s.jpg"
117    }
118  ],
119  "tags": [
120    "dishwasher",
121    "hill_or_mountain_view",
122    "lake_view",
123    "pets_allowed",
124    "river_view",
125    "view",
126    "washer_dryer",
127    "water_view",
128    "single_story",
129    "big_lot",
130    "mountain_view",
131    "pond",
132    "views"
133  ],
134  "branding": [
135    {
136      "type": "Office",
137      "photo": null,
138      "name": "Yellowstone Real Estate Group"
139    }
140  ],
141  "home_photos": {
142    "collection": [
143      {
144        "href": "https://ap.rdcpix.com/aaac82742af3798f47767dd24ab786c4l-m391104037s.jpg"
145      },
146      {
147        "href": "https://ap.rdcpix.com/aaac82742af3798f47767dd24ab786c4l-m2000015332s.jpg"
148      }
149    ],
150    "count": 2
151  }
152}