Yad2 Real Estate Scraper

A robust web scraper for Yad2.co.il (Israel's leading real estate platform) built with Python, Playwright, and Crawlee. Features automatic CAPTCHA solving using AntiCaptcha service.

Features

• 🏠 Comprehensive Scraping: Extracts property listings with price, location, rooms, and description
• 🤖 CAPTCHA Solving: Automatic reCAPTCHA solving using AntiCaptcha service
• 🌐 Proxy Support: Uses Apify residential proxies with Israel geo-targeting
• 🔄 Retry Logic: Intelligent retry mechanism for failed requests
• 📊 Structured Data: Exports clean, structured JSON data
• 🛡️ Anti-Detection: Browser fingerprint masking and human-like behavior

Quick Start

Required Input

{
  "start_urls": [
    "https://www.yad2.co.il/realestate/rent?city=6200",
    "https://www.yad2.co.il/realestate/forsale?city=5000"
  ],
  "anticaptcha_key": "your_anticaptcha_api_key_here"
}

Input Parameters

Parameter	Type	Required	Description
start_urls	Array	✅	List of Yad2 URLs to scrape
anticaptcha_key	String	❌	AntiCaptcha API key for CAPTCHA solving
proxy_country	String	❌	Proxy country code (default: "IL")
headless	Boolean	❌	Run in headless mode (default: true)
max_listings_per_page	Integer	❌	Max listings per page (default: 100)

Output Format

Each scraped listing includes:

{
  "url": "https://www.yad2.co.il/realestate/rent?city=6200",
  "listing_index": 1,
  "title": "דירת 3 חדרים בתל אביב",
  "price": "₪4,500",
  "address": "תל אבי