Real Estate Agent & Lead Scraper

Extract real estate agent profiles, contact info (phone & email), reviews, recent sales, and active listings from Zillow and Realtor.com. Includes lead quality scoring for prioritizing outreach.

Features

• Multi-Platform: Scrape Zillow and Realtor.com simultaneously
• Contact Data: Phone numbers and emails (when publicly displayed) with verification flags
• Reviews: Agent reviews with ratings and text
• Sales History: Recent sold properties with prices
• Active Listings: Current for-sale inventory
• Lead Scoring: Automatic lead quality calculation (0-100)
• Deduplication: Intelligently merge agents found on both platforms (keeps best data)
• Monitoring Mode: Only return NEW agents not seen in previous runs
• Email Verification: Flags showing email source and verification status

Use Cases

• Mortgage Brokers: Find active agents for referral partnerships
• Title Companies: Build agent relationship databases
• Real Estate Tech: Agent data for proptech applications
• Recruiting: Identify top-performing agents
• Market Research: Analyze agent activity by location

Data Output

Agent Profile

Field	Description	Platforms
name	Agent full name	Both
company	Brokerage/office name	Both
phone	Phone number	Both
email	Email address (if publicly visible)	Both
emailVerified	True if email found via mailto link	Both
emailSource	'mailto' or null	Both
photo	Profile photo URL	Both
rating	Average rating (1-5)	Both
reviewCount	Total number of reviews	Both
homesSoldLast12	Homes sold in last 12 months	Realtor only
totalHomesSold	Lifetime sales count	Realtor only
salesCount	Sales count (varies by source)	Zillow only
salesVolume	Total sales volume in dollars	Zillow only
listingsActive	Current active listings count	Realtor only
yearsExperience	Years in real estate	Both
specializations	Buyer agent, listing agent, etc.	Both
languages	Languages spoken	Both
licenseNumber	Real estate license number	Both
serviceAreas	Areas served	Both
bio	Agent biography (max 1000 chars)	Both
leadScore	Lead quality score (0-100)	Computed
platform	'zillow' or 'realtor'	Both
agentId	Platform-specific agent ID	Both
url	Agent profile URL	Both
scrapedAt	ISO timestamp of scrape	Both

Note: Field availability depends on what the agent has on their profile. Many fields may be null if not publicly displayed.

Reviews (Optional)

Field	Description
rating	Review rating
text	Review content
date	Review date
reviewer	Reviewer name

Recent Sales (Optional)

Field	Description	Platforms
address	Property address	Both
price	Sale price	Both
soldDate	Date sold	Both
beds	Bedrooms	Realtor only
baths	Bathrooms	Realtor only
sqft	Square footage	Realtor only
propertyType	Property type	Zillow only
url	Property listing URL	Both

Active Listings (Optional)

Field	Description	Platforms
address	Property address	Both
price	List price	Both
beds	Bedrooms	Both
baths	Bathrooms	Both
sqft	Square footage	Both
status	Listing status	Realtor only
url	Property listing URL	Both

Lead Score Calculation

Agents are scored 0-100 based on:

• Contact Info (30 pts): Phone + email availability
• Reviews (25 pts): Rating quality + review count
• Activity (25 pts): Recent sales + active listings
• Experience (10 pts): Years in business
• Profile (10 pts): Completeness (photo, bio, etc.)

Example Input

Search by Location

{
    "platforms": ["zillow", "realtor"],
    "location": "Austin, TX",
    "maxAgents": 100,
    "includeReviews": true,
    "includeSales": true,
    "includeListings": true,
    "deduplicateByName": true
}

Search for Specific Agent

{
    "platforms": ["zillow", "realtor"],
    "location": "Los Angeles, CA",
    "agentName": "John Smith",
    "maxAgents": 10
}

Direct Profile URLs

{
    "agentUrls": [
        "https://www.zillow.com/profile/agent-username",
        "https://www.realtor.com/realestateagents/agent-name"
    ],
    "includeReviews": true,
    "includeSales": true
}

Monitoring Mode (New Agents Only)

{
    "platforms": ["zillow", "realtor"],
    "location": "Austin, TX",
    "maxAgents": 100,
    "monitoringMode": true,
    "previousRunDatasetId": "abc123xyz"
}

To use monitoring mode:

1. Run the actor once normally
2. Copy the Dataset ID from your run's Storage tab
3. On subsequent runs, enable monitoringMode and paste the Dataset ID
4. The actor will only return agents NOT found in the previous run

Tips

1. Use Residential Proxies: Required - see Proxy Requirements section
2. Start Small: Test with 5-10 agents first to verify proxy is working
3. Location Format: Use "City, State" format (e.g., "Miami, FL")
4. Deduplication: Enable when scraping both platforms
5. Lead Scoring: Sort by leadScore for best prospects
6. Monitoring Mode: Use for regular scraping to track new market entrants
7. Email Verification: Filter by emailVerified: true for emails found via mailto links
8. If Blocked: Try a different proxy provider or reduce maxAgents

Pricing

Estimated compute usage (actual costs depend on site response times and proxy usage):

• Approximately 0.5-1 compute unit per 50 agents
• Including reviews/sales/listings increases runtime

Proxy Requirements

⚠️ Important: Both Zillow and Realtor.com have extremely aggressive anti-bot protection. These are among the most difficult sites to scrape.

What Works

1. Premium Residential Proxies Required - Standard datacenter proxies will be immediately blocked
2. Recommended Providers:
   • Bright Data - Best success rates for real estate sites
   • Oxylabs - Good residential network
   • SmartProxy/Decodo - Budget-friendly option
3. US-Based IPs - Both sites perform better with US residential IPs
4. Low Volume - Start with 5-10 agents to test your proxy configuration

What the Actor Does

• Session Rotation - Automatically rotates browser sessions to avoid fingerprinting
• Random Delays - 2-6 second delays between requests
• Stealth Mode - Uses playwright-extra with stealth plugin to evade detection
• Realistic Fingerprints - Mimics real Chrome browser behavior

Expected Errors

• 403 (Forbidden) - Proxy or browser fingerprint detected
• 429 (Too Many Requests) - Rate limited, reduce maxAgents or add delays
• Timeout - Proxy too slow or blocked, try different proxy

Troubleshooting

1. If getting 403s: Try a different proxy provider or use premium residential proxies
2. If getting 429s: Reduce maxAgents to 10-20 and increase delays
3. If timing out: Check proxy connectivity separately before running actor

Limitations

• Proxy dependency: Requires high-quality residential proxies for reliable scraping
• Email addresses are only extracted if publicly visible on the profile (many agents hide their email)
• Data availability varies by agent - some fields may be null if not displayed on their profile
• Field names and availability differ slightly between Zillow and Realtor.com (see tables above)
• Success rates vary based on proxy quality and site changes

Legal Notice

This actor extracts publicly available data from Zillow and Realtor.com. Users are responsible for ensuring compliance with each site's terms of service and applicable laws (including CCPA, CAN-SPAM, etc.). Data should be used for legitimate business purposes only.

---

Built by JCD