Domain.com.au Scraper With Agents

Slug: fatihtahta/domain-com-au-scraper

Overview

Domain.com.au Scraper With Agents collects structured property listing records together with agent and agency information from Domain pages. Output can include listing identity, address and location fields, pricing text, property attributes, media links, inspection timing, and contact-related fields when available. Domain.com.au is a major Australian property marketplace, so this data is useful for market intelligence, pipeline enrichment, and suburb-level trend analysis. The actor automates recurring collection workflows from direct URLs and filter-based searches, helping teams avoid manual collection work. Runs are consistent and repeatable, which reduces operational overhead and saves time.

Why Use This Actor

• Market research / analytics teams: Build recurring datasets for pricing, inventory mix, listing velocity, and suburb-level market comparisons.
• Product & content teams: Power property dashboards, editorial snapshots, comparison pages, and location insights with structured listing data.
• Developers / data engineering teams: Feed JSON records into ETL jobs, data warehouses, BI tools, and downstream APIs with minimal transformation.
• Lead generation / enrichment teams: Enrich account and opportunity records with listing context, agency details, and agent-level metadata.
• Monitoring / competitive tracking teams: Track listing changes, promotional status, inspections, and availability signals over time.

Input Parameters

Provide direct URLs, free-text queries, or query-builder filters to collect the records you need. When startUrls is present, it overrides the query builder inputs.

Parameter	Type	Description	Default
startUrls	array<string>	One or more Domain page URLs to scrape directly. Supports search result pages and individual listing pages. When provided, these override all query builder inputs.	-
location	string	Free-text location or Domain location slug used by the query builder (for example: Sydney or elizabeth-bay-nsw-2011). Required when startUrls is not provided. The actor resolves free-text to the first Domain location suggestion before building the search URL.	-
saleType	string	Market segment to collect. Allowed values: buy, rent, sold.	buy
priceMin	integer	Minimum price filter for generated searches. Leave empty for no lower bound.	-
priceMax	integer	Maximum price filter for generated searches. Leave empty for no upper bound.	-
bedrooms	string	Minimum bedrooms filter. Allowed values: any, 1+, 2+, 3+, 4+, 5+.	any
bathrooms	string	Minimum bathrooms filter. Allowed values: any, 1+, 2+, 3+, 4+, 5+.	any
parking	string	Minimum parking spaces filter. Allowed values: any, 1+, 2+, 3+, 4+, 5+.	any
propertySizeMin	string	Minimum property or land size in m2. Allowed values: any, 50, 75, 100, 200, 300, 400, 500, 600, 700, 800, 900, 1000, 1250, 1500, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000.	any
propertySizeMax	string	Maximum property or land size in m2. Allowed values: any, 50, 75, 100, 200, 300, 400, 500, 600, 700, 800, 900, 1000, 1250, 1500, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, 10000.	any
features	array<string>	Optional feature filters. Allowed values: Pets allowed, Built in wardrobes, Gas, Garden / courtyard, Balcony / deck, Internal laundry, Study, Swimming pool, Air conditioning.	-
newEstablished	string	Property age segment filter. Allowed values: any, new, established.	any
excludeUnderOffer	boolean	For buy searches, exclude listings marked under offer.	false
propertyTypes	array<string>	Property categories to include. Allowed values: All, House, Apartment, Townhouse, Retirement.	-
enrich_data	boolean	Collect richer listing details for each saved search result. When disabled, the actor saves the lightweight listing record available from search results without enrichment-only detail requests.	false
limit	integer	Maximum listings to save per query or per start URL. Use smaller values for sampling and larger values for broader coverage.	50000

Example Input

{
  "location": "Sydney",
  "saleType": "buy",
  "bedrooms": "2+",
  "propertyTypes": ["Apartment"],
  "excludeUnderOffer": true,
  "limit": 500
}

When startUrls is empty, the actor resolves location through Domain's location suggestions API and uses the first returned nameSlug to build the search URL. When startUrls is present, the actor skips query building and ignores the query-builder fields.

Agent Directory Mode

Set get_agents to true to crawl Domain's agent or agency directory instead of property listings.

Parameter	Type	Description	Default
get_agents	boolean	Switches the actor from listing search mode to Domain's agent directory mode.	false
agents_location	string	Free-text suburb/postcode or Domain location slug used to build the agent directory URL. This controls the directory location context. If omitted, the actor falls back to location.	-
agent_type	string	Directory variant to scrape. Allowed values: Sales Agents, Property Managers, Agencies.	Sales Agents
agent_keyword	string	Optional Domain keyword filter appended as keywordName and interpreted by Domain as agentNameKeyword in the directory payload. This is a name/keyword search term, not a replacement for agents_location, so numeric values such as 2000 can legitimately return zero matches.	-

Agent Mode Example Input

{
  "get_agents": true,
  "agents_location": "Sydney",
  "agent_type": "Sales Agents",
  "agent_keyword": "bryn fowler",
  "limit": 500
}

Output

Output destination

The actor writes JSON records to an Apify dataset. Records are already normalized for downstream ETL, warehousing, analytics, and API ingestion.

Top-level structure

Every record includes:

• record_type: listing, agent, or agency
• source_context: shared provenance metadata for all record types
• url: the primary entity URL when available
• one primary entity block depending on the record type, plus semantic groups such as pricing, property, location, media, contacts, and search_context

source_context contains:

• source_url: the search, directory, or detail page that discovered the record
• domain: source hostname
• seed_type: url or query_builder
• seed_value: the original seed value used by the run
• seed_id and parent_seed_id when present
• scraped_at: UTC timestamp for when the record was produced

Listing example

Arrays are shortened in this example for readability, but the object structure matches the actor output. With enrich_data disabled, listing records still include valuable search-card fields such as project name, child listing IDs, price text, keywords, images, responsive image metadata, contacts, and search context. With enrich_data enabled, the actor keeps those same fields and adds detail-page fields such as headline, description, gallery, inspection, documents, richer location data, and agency/contact details when available.

{
  "record_type": "listing",
  "listing_id": "2020301768",
  "url": "https://www.domain.com.au/castlereagh-sydney-nsw-2000-2020301768",
  "title": "Castlereagh, Sydney NSW 2000",
  "headline": "City Energy, Everyday Luxury",
  "source_context": {
    "source_url": "https://www.domain.com.au/project/4839/111-castlereagh-sydney-nsw/",
    "domain": "www.domain.com.au",
    "seed_type": "url",
    "seed_value": "https://www.domain.com.au/project/4839/111-castlereagh-sydney-nsw/",
    "scraped_at": "2026-04-29T11:52:35Z"
  },
  "listing": {
    "project_name": "111 Castlereagh",
    "child_listing_ids": [2020301768],
    "listing_category": "listing",
    "category": "project",
    "mode": "buy",
    "status": "newDevelopment",
    "dates": {
      "listed_at": "2025-09-29T10:45:43+10:00"
    }
  },
  "pricing": {
    "display_price": "Contact Agent",
    "exact_price": 4700000,
    "can_display_price": false
  },
  "property": {
    "primary_property_type": "New Developments",
    "secondary_property_type": "New Apartments / Off the Plan",
    "bedroom_count": 2,
    "bathroom_count": 2,
    "parking_count": 1,
    "keywords": ["Sydney CBD", "Luxury apartments"],
    "image_urls": ["https://images.example.com/card.jpg"],
    "features": "Air conditioning, Dishwasher, Intercom"
  },
  "location": {
    "display_address": "Castlereagh, Sydney NSW 2000",
    "suburb": "Sydney",
    "state": "NSW",
    "postcode": "2000",
    "latitude": -33.8710578,
    "longitude": 151.2092956
  },
  "media": {
    "image_urls": ["https://images.example.com/card.jpg"],
    "skeleton_images": [
      {
        "images": {
          "original": {
            "url": "https://images.example.com/original.jpg",
            "width": 1440,
            "height": 1080
          }
        },
        "media_type": "image"
      }
    ],
    "banner_url": "https://images.example.com/banner.jpg",
    "logo_url": "https://images.example.com/project-logo.jpg",
    "hero_images": {
      "small": "https://images.example.com/hero-small.jpg"
    },
    "gallery_count": 16
  },
  "contacts": {
    "agency": {
      "name": "Cbus Property",
      "phone": "03 96390131",
      "profile_url": "https://www.domain.com.au/real-estate-agencies/cbusproperty-39330/"
    },
    "agents": []
  },
  "search_context": {
    "discovery_url": "https://www.domain.com.au/sale/sydney-nsw-2000/",
    "listing_type": "project",
    "result_position": 1,
    "result_id": "2020301768",
    "search_page_number": 1,
    "search_total_pages": 12,
    "mode": "sale",
    "product_segment": "sale"
  }
}

Agent example

{
  "record_type": "agent",
  "agent_id": "900362",
  "agent_secondary_id": "A31461",
  "url": "https://www.domain.com.au/real-estate-agent/bryn-fowler-900362/",
  "name": "Bryn Fowler",
  "source_context": {
    "source_url": "https://www.domain.com.au/real-estate-agents/sydney-nsw-2000/",
    "seed_type": "query_builder",
    "seed_value": "https://www.domain.com.au/real-estate-agents/sydney-nsw-2000/",
    "scraped_at": "2026-04-29T11:52:35Z"
  },
  "agent": {
    "telephone": "02 8259 3333",
    "mobile": "0423 663 663",
    "profile_tier": "platinum"
  },
  "agency": {
    "agency_id": 6877,
    "agency_name": "Sydney Cove Property"
  },
  "performance": {
    "total_for_sale": 19
  },
  "reviews": {
    "number_of_reviews": 7,
    "overall_star_rating": 5
  },
  "search_context": {
    "page_number": 1,
    "total_pages": 1,
    "total_results": 1
  }
}

Agency example

{
  "record_type": "agency",
  "agency_id": "6877",
  "url": "https://www.domain.com.au/real-estate-agencies/sydneycoveproperty-6877/",
  "name": "Sydney Cove Property",
  "source_context": {
    "source_url": "https://www.domain.com.au/real-estate-agencies/sydney-nsw-2000/",
    "seed_type": "query_builder",
    "seed_value": "https://www.domain.com.au/real-estate-agencies/sydney-nsw-2000/",
    "scraped_at": "2026-04-29T11:52:35Z"
  },
  "agency": {
    "display_address": "Level 1 / 111 George St, The Rocks NSW 2000",
    "telephone": "02 92411288",
    "email": "info@sydneycoveproperty.com"
  },
  "agents": []
}

Field reference

Common fields

• record_type (string, required): Output entity type: listing, agent, or agency.
• url (string, optional): Primary URL for the listing, agent, or agency.
• title / name (string, optional): Primary display label for the entity.
• source_context.source_url (string, required): Page that discovered or loaded the entity.
• source_context.seed_type (string, required): Input mode used for the seed.
• source_context.seed_value (string, required): Original seed value.
• source_context.scraped_at (string, required): UTC scrape timestamp.
• search_context.* (object, optional): Search-card or directory pagination context discovered before detail enrichment.

Listing fields

• listing_id (string, required for listings): Stable listing identifier.
• headline and description (string/array, optional): Main listing marketing text.
• listing.* (object, optional): Tagline, category, mode, status, timestamps, sale method, project URL, development details, child listings, related projects, suburb profile, auction info, sold info, and other listing-specific details.
• pricing.* (object, optional): Display price, exact/min/max raw price values, display eligibility, and bond when present.
• property.* (object, optional): Property types, bedroom/bathroom/parking counts, IDs, features, structured features, image URLs, land/building data, and sale or rental attributes.
• location.* (object, optional): Coordinates, display address parts, display/viewing address objects, map metadata, school catchment, suburb insights, and related location profile data.
• media.image_urls, media.skeleton_images, media.thumbnails, media.banner_url, and media.logo_url (optional): Search-card media and responsive image metadata collected without requiring detail enrichment.
• media.hero_images (object, optional): Hero image variants keyed by small, medium, large, and xLarge.
• media.gallery (array