Realtor.com Agents Scraper

Overview

This actor allows you to scrape detailed information about real estate agents from Realtor.com. You can use this tool to gather valuable data about agents, such as their name, contact information, location, and other metadata. This information is useful for building marketing lists, performing research, or conducting competitor analysis.

Features

• Extract detailed information about real estate agents, including name, contact details, and office information.
• Supports scraping multiple Realtor.com agent pages, either by specifying locations or URLs.
• Scrape individual agent profiles directly using their specific URL (e.g., "https://www.realtor.com/realestateagents/56ba6c45bb954c01006b5030").
• Customize the scraping settings, such as maximum agents to scrape and request retries.
• Built-in proxy configuration for anonymous and reliable scraping.

How to Use

1. Set Up: Ensure you have an Apify account and access to the Apify platform.
2. Provide Start URLs: Copy and paste the desired agent directory link, specify the location you want to scrape from Realtor.com (e.g., "https://www.realtor.com/realestateagents/los-angeles_ca"), or use a direct agent profile URL (e.g., "https://www.realtor.com/realestateagents/56ba6c45bb954c01006b5030").
3. Adjust Scraper Settings: Modify settings like maxItems, maxConcurrency, and minConcurrency to suit your requirements.
4. Configure Proxy Settings: (Optional) Configure proxy settings for better reliability and to avoid IP blocks.
5. Run the Scraper: Execute the scraper on the Apify platform. The output will be available in various formats like JSON, CSV, or Excel, depending on your preference.

Input Configuration

Here's an example of how to set up the input for the Realtor.com Agents Scraper:

1{
2    "startUrls": [
3        "https://www.realtor.com/realestateagents/los-angeles_ca"
4        "https://www.realtor.com/realestateagents/56ba6c45bb954c01006b5030"
5        "New York, NY"
6    ],
7    "maxItems": 100,
8    "maxConcurrency": 10,
9    "minConcurrency": 1,
10    "maxRequestRetries": 3,
11    "proxyConfiguration": {
12        "useApifyProxy": true
13    }
14}

Input Fields Explanation

• Start URLs (startUrls): URLs of Realtor.com agent search pages to scrape from. This can also include specific city or state search URLs (e.g., "https://www.realtor.com/realestateagents/los-angeles_ca") or direct agent profile URLs (e.g., "https://www.realtor.com/realestateagents/56ba6c45bb954c01006b5030").
• Max Agents to Scrape per Crawl (maxItems): Maximum number of agents that will be scraped in a single run. Default is 100.
• Max Concurrency (maxConcurrency): Maximum number of pages that can be processed at the same time. Default is 10.
• Min Concurrency (minConcurrency): Minimum number of pages that will be processed at the same time. Default is 1.
• Max Request Retries (maxRequestRetries): Number of times the scraper will retry a failed request before giving up. Default is 3.
• Proxy Configuration (proxy): Specifies proxy servers that will be used by the scraper to ensure anonymity and bypass rate limits. For more details, refer to the Proxy configuration.

Output Structure

The scraper produces a list of agents, with each agent's information containing fields like:

1{
2  "first_year": 2005,
3  "user_languages": [
4    "Spanish",
5    "English"
6  ],
7  "marketing_area_cities": [
8    {
9      "city_state": "Jackson Heights_NY",
10      "name": "Jackson Heights",
11      "state_code": "NY"
12    }
13  ],
14  "role": "agent",
15  "description": "As a RE/MAX® agent, I’m dedicated to helping my clients find the home of their dreams...",
16  "phones": [
17    {
18      "ext": "",
19      "number": "(917) 683-1349",
20      "type": "Mobile"
21    }
22  ],
23  "review_count": 4,
24  "served_areas": [
25    {
26      "name": "Jackson Heights",
27      "state_code": "NY"
28    }
29  ],
30  "office": {
31    "name": "KELLER WILLIAMS REALTY LANDMARK II",
32    "address": {
33      "city": "East Elmhurst",
34      "state": "NY",
35      "line": "7525 31 St Ave 202",
36      "postal_code": "11370"
37    },
38    "phones": [
39      {
40        "number": "(347) 846-1200",
41        "type": "Office"
42      }
43    ],
44    "email": "lisapucar@kw.com"
45  },
46  "specializations": [
47    {
48      "name": "Certified buyer representative and sales person"
49    }
50  ],
51  "languages": [
52    "Spanish"
53  ],
54  "agent_rating": 5,
55  "web_url": "https://www.realtor.com/realestateagents/Edith-fernandini_East-Elmhurst_NY_1747756_649893853"
56}

Output Fields Explanation

• first_year: The first year the agent started working in real estate.
• user_languages: List of languages the agent speaks (e.g., "Spanish", "English").
• marketing_area_cities: Array of cities the agent markets in, including the city name and state code.
• role: The role of the individual (e.g., "agent").
• description: A description provided by the agent about their services and background.
• phones: List of phone numbers for the agent, including type (e.g., "Mobile").
• review_count: Number of reviews received by the agent.
• served_areas: Array of areas served by the agent, including city names and state codes.
• office: Object containing details about the agent's office, including name, address, phone number, and email.
• specializations: List of specializations or certifications held by the agent.
• languages: Languages spoken by the agent.
• agent_rating: Agent's overall rating.
• web_url: URL to the agent's profile page on Realtor.com.

Explore More Scrapers

If you found this Apify Smartbuyglasses Scraper useful, be sure to check out our other powerful scrapers and actors at memo23's Apify profile. We offer a wide range of tools to enhance your web scraping and automation needs across various platforms and use cases.

Support

• For issues or feature requests, please use the Issues section of this actor.
• If you need customization or have questions, feel free to contact the author:
  • Author's website: https://muhamed-didovic.github.io/
  • Email: muhamed.didovic@gmail.com

Additional Services

• Request customization or whole dataset: muhamed.didovic@gmail.com
• If you need anything else scraped, or this actor customized, email: muhamed.didovic@gmail.com
• For API services of this scraper (no Apify fee, just usage fee for the API), contact: muhamed.didovic@gmail.com
• Email: muhamed.didovic@gmail.com