A robust web scraper for Yad2.co.il (Israel's leading real estate platform) built with Python, Playwright, and Crawlee. Features automatic CAPTCHA solving using AntiCaptcha service.

Features

🏠 Comprehensive Scraping: Extracts property listings with price, location, rooms, and description
🤖 CAPTCHA Solving: Automatic reCAPTCHA solving using AntiCaptcha service
🌐 Proxy Support: Uses Apify residential proxies with Israel geo-targeting
🔄 Retry Logic: Intelligent retry mechanism for failed requests
📊 Structured Data: Exports clean, structured JSON data
🛡️ Anti-Detection: Browser fingerprint masking and human-like behavior

Quick Start

Required Input

{
  "start_urls": [
    "https://www.yad2.co.il/realestate/rent?city=6200",
    "https://www.yad2.co.il/realestate/forsale?city=5000"
  ],
  "anticaptcha_key": "your_anticaptcha_api_key_here"
}

Input Parameters

Parameter	Type	Required	Description
`start_urls`	Array	✅	List of Yad2 URLs to scrape
`anticaptcha_key`	String	❌	AntiCaptcha API key for CAPTCHA solving
`proxy_country`	String	❌	Proxy country code (default: "IL")
`headless`	Boolean	❌	Run in headless mode (default: true)
`max_listings_per_page`	Integer	❌	Max listings per page (default: 100)

Output Format

Each scraped listing includes:

{
  "url": "https://www.yad2.co.il/realestate/rent?city=6200",
  "listing_index": 1,
  "title": "דירת 3 חדרים בתל אביב",
  "price": "₪4,500",
  "address": "תל אבי