Real Estate Agents Search Scraper: Extract NZ Property Agent Data

---

What Is Realestate.co.nz?

Realestate.co.nz is New Zealand's largest property portal, hosting thousands of residential and commercial listings alongside comprehensive agent and agency directories. Finding and organizing agent data manually is labor-intensive — the Real Estate Agents Search Scraper automates extraction of agent profiles, office information, and relationships from search results pages.

---

Overview

The Real Estate Agents Search Scraper extracts structured agent and office data from realestate.co.nz search result pages. It is designed for:

• Real estate recruiters building talent databases and competitor lists
• Lead generation professionals collecting qualified agent contacts
• Market researchers analyzing agent distribution and agency networks
• CRM managers populating systems with verified agent profiles
• Real estate analytics platforms aggregating agency data

Key advantages include high-volume scraping (up to 200 items per URL), resilient error handling via ignore_url_failures, and structured output capturing relationships between agents and offices.

---

Input Format

The scraper accepts a JSON configuration with agent search URLs:

{
  "urls": [
    "https://www.realestate.co.nz/search/results/agents/a",
    "https://www.realestate.co.nz/search/results/agencies/a"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 200
}

Parameter	Type	Description
urls	array	List of realestate.co.nz agent or office search result URLs. Start with alphabetical filters (e.g., /agents/a, /agents/b) or location-based searches.
max_items_per_url	integer	Maximum number of agent/office records to extract per URL (default: 20, max: 200). Increase for comprehensive list scraping.
ignore_url_failures	boolean	If true, the scraper continues processing remaining URLs even if one fails. If false, execution stops at first error.

Best practice: Use alphabetical search filters (/a through /z) to systematically collect nationwide agent data with pagination control.

---

Output Format

Attributes Object

{
  "relationships": {
    "listings": {
      "data": []
    },
    "offices": {
      "data": [
        {
          "id": "497456",
          "type": "office"
        },
        {
          "id": "285793",
          "type": "office"
        },
        {
          "id": "9230",
          "type": "office"
        }
      ]
    },
    "office": {
      "data": {
        "id": "497456",
        "type": "office"
      }
    }
  },
  "attributes": {
    "office-name": "Frank Commercial Ltd (Licensed: REAA 2008)",
    "image": {
      "base-url": "/per_orgs/175352/f3ffbfe8023f67c82b2c02f09cf01d8f"
    },
    "office-image": "/per_orgs/497456/fa5506b24edf5c5bbb97b857916a2be7",
    "office-brand-hex-code": "#f0802f",
    "listing-count": 827,
    "first-name": "Laura",
    "job-title": "Commercial Leasing Agent",
    "office-is-brand-colour-light": true,
    "phone-ddi": "09 303 3804",
    "website-url": "http://www.frankcommercial.co.nz",
    "name": "Laura Osborne",
    "show-profile": true,
    "phone-mobile": "021 969 480",
    "slug": "laura-osborne",
    "email": "laura@frankcommercial.co.nz",
    "last-name": "Osborne",
    "linkedin-url": "https://nz.linkedin.com/in/laosborne"
  },
  "id": "175352",
  "type": "agent",
  "from_url": "https://www.realestate.co.nz/search/results/agents/a"
}

Each scraped agent or office record contains four primary fields:

Core Fields

Field	Type	Description
ID	string	Unique identifier assigned by realestate.co.nz to the agent or office profile
Type	string	Record classification: agent (individual agent) or office (agency/brokerage)
Relationships	array	Links to associated entities (e.g., agents belonging to an office, or offices where an agent is licensed)
Attributes	object	Agent/office profile data including name, contact details, location, specializations, license info, and performance metrics

Relationships Structure

The Relationships array describes connections between records:

Relationship Type	Description
works_at	An agent is employed by or associated with an office
manages	An office manages multiple agents
licensed_in	An agent is licensed to operate in specific regions

---

How to Use

1. Identify search URLs — Navigate to realestate.co.nz and go to the agent search page. Copy URLs from alphabetical listings or location filters (e.g., https://www.realestate.co.nz/search/results/agents/a).

2. Prepare input JSON — Add URLs to the urls array. Set max_items_per_url to 200 for comprehensive scraping or lower values for faster runs.

3. Enable error handling — Keep ignore_url_failures: true to skip problematic pages without stopping the entire job.

4. Run the scraper — Execute the job and monitor the run log for completion status.

5. Download & parse results — Export data as JSON or CSV. Use the Relationships array to build agent-to-office mappings in your CRM or database.

Handling common scenarios:

• For nationwide coverage, scrape all 26 alphabetical filters (/a through /z) in separate runs or batch them.
• For regional focus, use location-filtered URLs (e.g., /agents?location=Auckland) to target specific markets.
• For office networks, start with office search pages (/offices/...) to map agency hierarchies.

---

Real-World Use Cases

• CRM enrichment: Automatically populate Salesforce or HubSpot with verified agent contact details and office associations
• Lead generation: Extract agent databases for targeted outreach campaigns by region or specialization
• Competitive intelligence: Monitor competitor agent counts, locations, and specializations across New Zealand
• Market analysis: Analyze agent density, turnover rates, and office network structures by area
• Agency directory publishing: Build a custom agency portal or real estate marketplace with up-to-date agent listings

The scraper eliminates manual data entry, delivering clean, structured records that integrate seamlessly into business workflows.

---

Compliance & Best Practices

• Respect robots.txt: Ensure your scraping complies with realestate.co.nz's usage policies
• Rate limiting: Space out requests to avoid overwhelming the server
• Data accuracy: Cross-reference extracted license numbers with the Real Estate Authority's official registry
• Privacy: Use scraped agent data responsibly and in compliance with New Zealand's Privacy Act 2020