Domain.com.au Property Scraper

Comprehensive Australian real estate data extraction tool for Domain.com.au. Efficiently scrape property listings, prices, features, and market insights with advanced automation capabilities.

What does Domain.com.au Property Scraper do?

This powerful scraper extracts detailed property information from Australia's leading real estate platform, Domain.com.au. It collects comprehensive data including property details, pricing information, location data, agent information, and inspection times.

Key Features

• Multi-Method Extraction - Combines JSON-LD parsing and HTML extraction for maximum data quality
• Intelligent Fallback - Automatically switches between extraction methods to ensure reliable data collection
• Comprehensive Data - Captures property details, prices, features, images, agent info, and inspection times
• Advanced Filtering - Search by location, state, property type, price range, and bedroom count
• Smart Pagination - Handles multiple result pages automatically with configurable limits
• Detail Collection - Optional deep scraping of individual property pages for complete information
• Rate Limiting - Built-in delays and concurrency control to ensure stable operation
• Proxy Support - Residential proxy integration for reliable access

Why choose this scraper?

• ✅ Production Ready - Tested and optimized for reliability
• ✅ High Performance - Efficient extraction with minimal resource usage
• ✅ Quality Data - Structured output with comprehensive property information
• ✅ Easy Configuration - Simple input schema with sensible defaults
• ✅ Cost Effective - Optimized to minimize compute units and proxy usage
• ✅ Maintained - Regular updates to adapt to website changes

Input Configuration

Configure the scraper using these parameters to customize your data extraction:

Parameter	Type	Description	Default
startUrl	String	Domain.com.au search URL to begin scraping from	All Australian properties for sale
location	String	Specific location to search (e.g., 'sydney-nsw', 'melbourne-vic')	null
state	String	Australian state code (nsw, vic, qld, wa, sa, tas, act, nt)	null
propertyType	String	Filter by type: house, apartment, townhouse, villa, land	null (all types)
minPrice	Integer	Minimum property price in AUD	null (no minimum)
maxPrice	Integer	Maximum property price in AUD	null (no maximum)
minBeds	Integer	Minimum number of bedrooms (0-10)	null
maxBeds	Integer	Maximum number of bedrooms (0-10)	null
excludeUnderOffer	Boolean	Exclude properties that are under offer	true
sortBy	String	Sort order: dateupdated-desc, price-asc, price-desc, suburb-asc	dateupdated-desc
collectDetails	Boolean	Visit each property page for complete details (slower but comprehensive)	true
maxResults	Integer	Maximum number of properties to extract (1-1000)	50
maxPages	Integer	Maximum number of result pages to process (1-50)	3
maxConcurrency	Integer	Concurrent requests for detail collection (1-10)	3
proxyConfiguration	Object	Proxy settings (residential proxies recommended)	Apify residential proxy

Output Data

Each property listing includes the following structured data:

Core Information

• id - Unique property identifier
• url - Direct link to the property listing
• address - Complete street address
• suburb - Suburb/locality name
• state - Australian state code
• postcode - Postal code
• price - Property price (may be range or text)
• propertyType - Type of property

Property Features

• beds - Number of bedrooms
• baths - Number of bathrooms
• parking - Number of parking spaces
• landSize - Land area in square meters
• floorSize - Internal floor area
• features - Array of property features and amenities

Listing Details

• description - Full property description
• agent - Listing agent name
• agency - Real estate agency name
• inspectionTimes - Scheduled viewing times
• isNew - New listing indicator

Media & Location

• imageUrl - Primary property image
• images - Array of all property images
• latitude - Geographic coordinate
• longitude - Geographic coordinate

Metadata

• scrapedAt - Timestamp of data collection
• source - Data source identifier

Usage Examples

Example 1: Search Sydney Properties

{
  "location": "sydney-nsw",
  "propertyType": "house",
  "minPrice": 800000,
  "maxPrice": 1500000,
  "minBeds": 3,
  "maxResults": 100,
  "collectDetails": true
}

This configuration searches for houses in Sydney, NSW priced between $800,000 and $1,500,000 with at least 3 bedrooms.

Example 2: Melbourne Apartments

{
  "state": "vic",
  "propertyType": "apartment",
  "maxPrice": 600000,
  "minBeds": 2,
  "maxBeds": 3,
  "maxResults": 50,
  "collectDetails": true
}

Extracts apartments in Victoria under $600,000 with 2-3 bedrooms.

Example 3: Queensland Land

{
  "state": "qld",
  "propertyType": "land",
  "sortBy": "price-asc",
  "maxResults": 30,
  "collectDetails": false
}

Quickly scrapes vacant land listings in Queensland, sorted by price (lowest first).

Example 4: Custom URL Search

{
  "startUrl": "https://www.domain.com.au/sale/brisbane-city-qld-4000/",
  "maxResults": 200,
  "maxPages": 10,
  "collectDetails": true
}

Uses a specific Domain.com.au URL to scrape properties with deep detail collection.

How to Use

1. Configure Input - Set your search parameters in the input schema
2. Set Proxy - Use residential proxies for best results (included in default configuration)
3. Run Scraper - Start the actor and monitor progress in real-time
4. Export Data - Download results in JSON, CSV, Excel, or other formats

Quick Start

The simplest way to get started is using the default configuration, which will scrape the latest property listings across Australia:

{
  "maxResults": 50,
  "collectDetails": true
}

This collects 50 recent property listings with full details - perfect for testing.

Performance & Best Practices

Performance Tips

• Disable Detail Collection - Set collectDetails to false for faster extraction of basic listing data
• Adjust Concurrency - Increase maxConcurrency to 5-7 for faster detail collection (requires more proxy IPs)
• Limit Pages - Set realistic maxPages values to control runtime and costs
• Use Filters - Apply property type and price filters to reduce irrelevant results

Cost Optimization

• Basic listing scraping (without details): ~0.01-0.02 compute units per property
• Full detail collection: ~0.05-0.08 compute units per property
• Use datacenter proxies for testing, residential proxies for production
• Process properties in batches to optimize resource usage

Reliability Tips

• Always Use Proxies - Residential proxies recommended for consistent access
• Respect Rate Limits - Keep maxConcurrency at 3-5 for stable operation
• Monitor Results - Check logs for any extraction issues
• Handle Errors - The scraper includes automatic retries for failed requests

Integration & Export

Output Formats

Export your scraped data in multiple formats:

• JSON - Structured data with full hierarchy
• CSV - Flat format for spreadsheet applications
• Excel - Formatted workbook with data
• XML - Structured markup format
• RSS - Feed format for monitoring

API Integration

Access scraped data programmatically using the Apify API:

https://api.apify.com/v2/acts/YOUR-ACTOR-ID/runs/last/dataset/items

Webhooks

Set up webhooks to receive notifications when scraping completes or trigger downstream processes automatically.

Use Cases

Real Estate Professionals

• Market research and competitive analysis
• Property portfolio tracking
• Lead generation for buyers and sellers
• Comparative market analysis (CMA)

Property Investors

• Investment opportunity identification
• Market trend analysis
• Price monitoring and alerts
• ROI calculations and forecasting

Data Analysts & Researchers

• Real estate market research
• Price trend analysis
• Geographic market comparison
• Statistical modeling and predictions

Property Portals & Aggregators

• Data aggregation for listings
• Market intelligence gathering
• Competitive monitoring
• Database enrichment

Technical Details

Extraction Methods

The scraper employs multiple extraction techniques for maximum reliability:

• JSON-LD Parsing - Extracts structured data from JSON-LD schema markup (highest quality)
• HTML Parsing - Cheerio-based extraction from HTML elements (fast and efficient)
• Playwright Fallback - Browser automation for JavaScript-rendered content (most reliable)

Smart Features

• Automatic Deduplication - Prevents duplicate property entries
• Intelligent Pagination - Automatically follows next page links
• Error Recovery - Automatic retries with exponential backoff
• Rate Limiting - Built-in delays to prevent blocking

Data Quality

• Validates and normalizes all extracted data
• Handles missing or incomplete information gracefully
• Preserves data relationships and hierarchies
• Includes metadata for tracking and debugging

Frequently Asked Questions

How many properties can I scrape?

You can scrape up to 1000 properties per run. For larger datasets, run the scraper multiple times with different search criteria or increase the maxPages parameter.

Do I need proxies?

Yes, proxies are highly recommended. The default configuration uses Apify residential proxies, which provide the best reliability. Domain.com.au may block requests from datacenter IPs or rate-limit repeated requests.

How long does scraping take?

Without detail collection: ~1-2 seconds per property. With full details: ~3-5 seconds per property. Total runtime depends on maxResults, maxPages, and collectDetails settings.

What if the scraper stops working?

Website structures change over time. If you encounter issues, please report them and a fix will be deployed promptly. The scraper is regularly updated to maintain compatibility.

Can I scrape rental properties?

This scraper is configured for properties for sale. For rental properties, modify the startUrl to use Domain's rental search URLs (e.g., domain.com.au/rent/).

Is this legal?

Web scraping publicly available data is generally legal. However, always review Domain.com.au's terms of service and robots.txt. Use responsibly and respect rate limits. This tool is intended for personal research and analysis.

How much does it cost?

Cost depends on usage. Approximate costs: Basic scraping (50 properties, no details): ~$0.10-0.20. Full detail collection (50 properties): ~$0.40-0.60. Costs include compute units and proxy usage.

Support & Updates

This scraper is actively maintained and regularly updated to ensure compatibility with Domain.com.au. For support, feature requests, or bug reports, please contact through the Apify platform.

Version History

• 1.0.0 - Initial release with comprehensive feature set

Compliance & Ethics

This tool is designed for legitimate use cases such as market research, investment analysis, and data aggregation. Users are responsible for:

• Complying with Domain.com.au's terms of service
• Respecting robots.txt directives
• Using reasonable rate limits
• Not overloading servers
• Handling personal data responsibly
• Following applicable data protection regulations

Always use web scraping tools responsibly and ethically.

---

Disclaimer: This scraper is an independent tool and is not affiliated with, endorsed by, or connected to Domain.com.au or its parent companies. All trademarks and brand names are properties of their respective owners.