Dom.ria Property Search Scraper & Parser

A fast, highly optimized, and robust hybrid web scraper for extracting real estate listing details from dom.ria.com (Ukraine's leading real estate platform).

Designed to bypass anti-bot detections, rotate proxy IPs, and scale efficiently to scrape thousands of properties.

---

🚀 Key Features

• Hybrid Architecture (High Speed & Low Cost): Scrapes search catalog pages and details using fast HTTP API calls (httpx + BeautifulSoup), utilizing browser automation (Playwright) only as a targeted fallback for clicking phone number buttons.
• Apify Proxy Integration: Native support for Apify Residentials and rotating proxy pools to bypass anti-bot challenges and IP blocks.
• Concurrent Scraping (Semaphore Control): Fetches property details in parallel (default: 4 concurrent tasks) to speed up crawling without overloading the target server.
• Resilient Retry Strategy: Implements automatic exponential backoff retry logic to handle 429 Too Many Requests rate limiting and network glitches.
• Single & Multi-Listing Support: Scrapes entire search lists (with pagination support) or processes a single listing URL.
• Zero Maintenance Debugging: Automatically saves raw HTML to Key-Value Store if catalog selectors change, making debugging seamless.

---

📥 Input Parameters

Define search targets in the Apify Console with the following parameters:

Field Name	Type	Description	Default
url	String	Required. DOM.RIA search category URL or a direct listing URL.	https://dom.ria.com/uk/prodazha-kvartir/
include_phone	Boolean	Whether to extract owner/agency phone numbers (requires more proxy/browser requests).	false
max_pages	Integer	Maximum search pages to crawl (0 = unlimited).	0
max_items	Integer	Maximum property objects to scrape (0 = unlimited).	0
proxyConfiguration	Object	Proxy configuration settings. Recommended to enable Apify Proxy.	{"useApifyProxy": true}

---

📤 Output Structure

The output is exported in a structured JSON format to the Apify Dataset. Each item contains:

{
  "page_number": 1,
  "id": "domria_33423362",
  "title": "Квартира, 3 кімн., 60 м²",
  "link": "https://dom.ria.com/uk/realty-prodaja-kvartira-kiev-lesnoy-massiv-bratislavskaya-ulitsa-33423362.html",
  "price": "66 000 $",
  "location_date": "Київ, Братиславська вулиця, Київська",
  "image": "https://cdn.riastatic.com/photosnew/dom/photo/prodaja-kvartira-kiev-lesnoy-massiv-bratislavskaya-ulitsa__336029452fl.jpg",
  "description": "Ухоженное жилое состояние. Стены выровнены и оштукатурены. Окна выходят и во двор, и на улицу...",
  "user_name": "Олександр",
  "phones": [
    "+380671234567"
  ],
  "photos": [
    "https://cdn.riastatic.com/photosnew/dom/photo/prodaja-kvartira-kiev-lesnoy-massiv-bratislavskaya-ulitsa__336029452fl.jpg",
    "https://cdn.riastatic.com/photosnew/dom/photo/prodaja-kvartira-kiev-lesnoy-massiv-bratislavskaya-ulitsa__336029453fl.jpg"
  ],
  "params": [
    {
      "name": "Стіни",
      "value": "з цегли"
    },
    {
      "name": "Побутова техніка",
      "value": "Плита, Духова шафа"
    }
  ]
}

---

💼 Ideal For:

• Real Estate Agencies: Track competitor pricing, new properties, and market changes.
• Investment Analytics: Monitor average price per square meter across different regions/cities.
• CRM Integrations: Feed qualified buyer leads directly into your database.