Domain.com.au Smart Property Scraper 🏠

The only Domain.com.au scraper that actually respects your search filters. Stop wasting compute units on data you didn't ask for.

🎯 Why This Scraper?

Other scrapers have a critical flaw: they ignore your URL filters and scrape everything. Ask for 14 days of listings? They scrape the entire database.

This scraper is different:

• ✅ Filter-aware pagination - listedsince=14 actually means 14 days
• ✅ Full descriptions - Gets the complete listing text (not just cards)
• ✅ All listing types - Buy, rent, and sold properties
• ✅ 40+ data fields - Everything you need for analysis
• ✅ Stealth mode - Residential proxy support, human-like behavior

📊 What You Get

Every listing includes:

{
  "listingId": "2019350271",
  "propertyUrl": "https://www.domain.com.au/...",
  
  "fullAddress": "123 Example Street, Sydney NSW 2000",
  "streetAddress": "123 Example Street",
  "suburb": "Sydney",
  "state": "NSW",
  "postcode": "2000",
  
  "listingType": "rent",
  "propertyType": "Apartment",
  
  "priceText": "$650 per week",
  "price": 650,
  "pricePerWeek": 650,
  "bond": 2600,
  
  "bedrooms": 2,
  "bathrooms": 1,
  "parking": 1,
  "landSize": null,
  "buildingSize": "75 sqm",
  
  "description": "Stunning apartment with harbour views featuring modern kitchen, air conditioning, built-in wardrobes...",
  "featuresList": ["Air Conditioning", "Built-in Wardrobes", "Gym", "Pool"],
  
  "agentName": "John Smith",
  "agencyName": "Ray White Sydney",
  "agentPhone": "0400 000 000",
  
  "listedDate": "Listed 3 days ago",
  "availableDate": "Available Now",
  "inspectionTimes": ["Sat 10:00am - 10:30am"],
  
  "imageUrls": ["https://...", "https://..."],
  
  "scrapedAt": "2024-01-15T10:30:00.000Z"
}

🚀 Quick Start

1. Prepare your URLs

Use Domain.com.au's search to filter exactly what you want, then copy the URL:

https://www.domain.com.au/rent/sydney-nsw-2000/?sort=dateupdated-desc&listedsince=14&ptype=apartment-unit-flat

2. Configure the actor

{
  "startUrls": [
    { "url": "https://www.domain.com.au/rent/sydney-nsw-2000/?sort=dateupdated-desc&listedsince=14&ptype=apartment-unit-flat" }
  ],
  "scrapeDescriptions": true,
  "maxConcurrency": 5
}

3. Run and export

Results available in JSON, CSV, or Excel format.

⚙️ Input Parameters

Parameter	Type	Default	Description
startUrls	array	required	Domain.com.au search URLs
maxListingsPerUrl	number	0 (unlimited)	Limit listings per URL
scrapeDescriptions	boolean	true	Visit detail pages for full descriptions
scrapeImages	boolean	true	Extract all image URLs
maxConcurrency	number	5	Parallel page processing (lower = safer)
maxRequestRetries	number	3	Retry failed requests
minDelayMs	number	2000	Min delay between requests
maxDelayMs	number	5000	Max delay between requests
proxyConfiguration	object	Apify proxy	Proxy settings

📋 Supported URL Filters

All Domain.com.au search parameters are preserved:

Parameter	Example	Description
listedsince	14	Days since listing (1, 7, 14, 30)
ptype	apartment-unit-flat	Property type
sort	dateupdated-desc	Sort order
bedrooms	2-3	Bedroom range
bathrooms	1-	Minimum bathrooms
price	400-600	Price range
carspaces	1-	Minimum parking

💡 Pro Tips

1. Use residential proxies - Domain blocks datacenter IPs aggressively
2. Start with small batches - Test with 1-2 URLs first
3. Lower concurrency if blocked - Try maxConcurrency: 3
4. Schedule weekly runs - Use Apify scheduler for fresh data

⚡ Performance

Scenario	Est. Time	Est. Cost
100 listings (with descriptions)	10-15 min	~$0.50
1,000 listings (with descriptions)	1-2 hours	~$3-5
10,000 listings (with descriptions)	8-12 hours	~$25-40

Times vary based on proxy speed and Domain.com.au response times.

🔧 Troubleshooting

"No listings found"

• Check your URL is valid on Domain.com.au first
• Try increasing delays (minDelayMs: 3000)

"Request failed" errors

• Switch to residential proxies
• Lower concurrency to 3
• Increase retry count

Missing descriptions

• Ensure scrapeDescriptions: true
• Some listings genuinely have no description

📜 Terms of Use & Data Notice

By using this actor, you acknowledge:

1. Compliance: You are responsible for ensuring your use complies with Domain.com.au's Terms of Service and applicable laws.

2. Data Collection: This actor collects anonymized, aggregated usage metrics to improve performance and reliability. No personally identifiable information is collected. Scraped property data statistics (counts, suburbs covered, property types) may be aggregated for service improvement.

3. Fair Use: Please use reasonable request rates. Excessive usage may impact service for all users.

4. No Warranty: Data accuracy depends on Domain.com.au's website structure. The actor maintainer is not responsible for data completeness or accuracy.

🆘 Support

• Issues? Use the Issues tab on this actor's page
• Feature requests? Leave a comment below
• Commercial/bulk needs? Contact via Apify messaging

📝 Changelog

v1.0.0 (2024)

• Initial release
• Smart pagination with filter preservation
• Full description extraction
• Stealth mode with residential proxy support

---

Built for Australian property professionals, investors, and researchers.