Apify Airbnb Scraper

This Apify-based web scraper is designed to extract detailed information from Airbnb listings. It gathers SEO data, room pricing, booking availability, and other relevant details for given check-in and check-out dates. The script processes input URLs, retrieves the necessary data, and stores the results in an Apify dataset.

Key Features

• SEO Data Extraction: Retrieves important SEO-related information such as title, meta description, canonical URL, and room-related details.
• Room Pricing Breakdown: Extracts price information including primary price, cleaning fee, service fee, and total price.
• Booking Availability: Retrieves availability details, including check-in/check-out dates and capacity.
• Error Handling: The script includes error handling for common issues such as request failures, missing data, or invalid responses.
• Apify Dataset Integration: Directly stores the collected data in an Apify dataset for further processing and analysis.

Input Format

You can provide the input data in the following structure:

• startUrls: A list of URLs to scrape.
• check_in_date: (Optional) The check-in date. Defaults to 2024-11-21 if not provided.
• check_out_date: (Optional) The check-out date. Defaults to 2024-11-21 if not provided.
• numberOfDays: (Optional) The number of days to generate check-in/check-out date pairs. Defaults to 10.

Example Input:

1{
2  "startUrls": [
3    {"url": "https://www.airbnb.co.uk/rooms/12345678"},
4    {"url": "https://www.airbnb.co.uk/rooms/87654321"}
5  ],
6  "check_in_date": "2024-12-01",
7  "check_out_date": "2024-12-10",
8  "numberOfDays": 5
9}

Output Format

The script returns structured data with the following fields:

• Check-In Date
• Check-Out Date
• SEO Data: (e.g., Title, Meta Description, Canonical URL)
• Room Pricing Breakdown: (e.g., Primary Price, Cleaning Fee, Taxes)
• Property Details: (e.g., Location, Capacity, Rating)

The data is saved into an Apify Dataset and also available in JSON format.

Example Output (JSON):

1[
2  {
3    "Check-In Date": "2024-12-01",
4    "Check-Out Date": "2024-12-02",
5    "Title": "Cozy Apartment in London",
6    "Meta Description": "A beautiful apartment in the heart of London.",
7    "Room Rating": 4.5,
8    "Total Reviews": 158,
9    "Price Breakdown Title": "Nightly Rate",
10    "Strike Through Price": "£120",
11    "Primary Price": "£95",
12    "Cleaning Fee": "£10",
13    "Service Fee": "£12",
14    "Total Price": "£117",
15    "Location": "London, UK",
16    "Capacity": 4
17  }
18]

Error Handling

The script includes error handling to manage:

• Request Errors: Catches and logs errors related to HTTP requests (e.g., failed connection, invalid URL).
• Key Errors: Handles cases where expected keys are missing in the response data (e.g., missing room pricing or SEO data).
• General Exceptions: Catches other unexpected errors and logs the details.

Run the script directly within the Apify platform by creating a new Actor.

Conclusion

This Apify Airbnb scraper provides a comprehensive solution for extracting SEO and pricing information from Airbnb listings. It is fully integrated with the Apify platform, making it easy to use, scale, and manage your web scraping tasks. The data is saved into an Apify dataset, ready for further analysis or use.