Airbnb Multi-Listing Scraper (Apify Actor)

Purpose

High-speed Airbnb scraper for market research, price tracking, and geo coverage analysis. Python + async aiohttp with resilient proxy fallbacks and live dataset saving.

Key Features

• Concurrent scraping of search pages and listing details
• Proxy ladder: direct → datacenter → residential (sticky) with clear log events
• Cursor-based pagination and de-duplication
• Rich fields: id, url, title, description, rating breakdown, price breakdown, coordinates, thumbnail, currency/locale
• Live dataset pushes to avoid data loss
• Retry with jitter (3 attempts) and light pacing

Inputs (actor.json)

• startItems (required, array, stringList editor): keywords or Airbnb URLs, e.g. ["https://www.airbnb.com/s/London/homes", "Paris"]
• sortOrder (string): relevance | price_asc | price_desc (default: relevance)
• maxComments (integer): review comments per listing (0 to skip)
• proxyConfiguration (object): starts direct; on block → datacenter; on next block → residential and stays; all transitions logged
• maxItems (integer): listings limit (default 20, max 5000)
• checkin / checkout (string): YYYY-MM-DD (defaults: 2025-01-01 / 2025-01-08)
• currency (string): currency code (default USD)
• locale (string): locale header (default en-US)

Proxy Strategy

1. No proxy by default
2. If blocked (HTTP 403/429): switch to datacenter proxy
3. If blocked again: switch to residential and keep it for the session
4. All escalations are logged via Actor.log

Output (Dataset)

Each item includes:

• id, url, title, description, thumbnail
• rating: guestSatisfaction, reviewsCount, accuracy, cleanliness, communication, location, value
• price: label, qualifier, price, breakdown (basePrice, total, placeholders for fees/discounts)
• coordinates: latitude, longitude
• currency, locale

How to Run on Apify

1. Deploy the actor.
2. In Apify Console, set input: startItems, adjust maxItems, dates, currency/locale, and proxy settings.
3. Run and monitor logs for proxy mode and progress.
4. Download results from the Dataset tab (JSON/CSV/XLSX).

How to Run Locally

1. Create storage/key_value_stores/default/INPUT.json:

{
  "startItems": ["https://www.airbnb.com/s/London/homes"],
  "maxItems": 5,
  "sortOrder": "relevance",
  "checkin": "2025-01-01",
  "checkout": "2025-01-08",
  "currency": "USD",
  "locale": "en-US",
  "proxyConfiguration": { "useApifyProxy": false }
}

2. From Airbnb-Scraper/: python -m src
3. Results: storage/datasets/default

Logging You’ll See

• Start/end of run
• Current proxy mode and any escalation
• Page fetches, cursor updates, detail fetch batches
• Retry warnings and errors per URL
• Final “Run complete. Pushed N items.”

SEO Keywords

Airbnb scraper, Airbnb listings scraper, Airbnb data extraction, Airbnb price scraper, Apify Airbnb actor, Airbnb crawler Python, Airbnb market research, Airbnb dataset export, Airbnb automation, Airbnb proxy scraper.