Airbnb Scraper

Overview

Explore the extensive Airbnb landscape with our sophisticated scraper, designed to efficiently harvest detailed data from listings and experiences. Tailored for analytics and enriching projects, it navigates search results to capture comprehensive details.

Who Can Use It

• 🔍 Market Researchers & Analysts: Dive into market trends, pricing, and demand insights.
• 🌍 Travel & Hospitality Businesses: Tailor your services with competitor insights and customer preferences.
• 💡 Data Scientists & Developers: Create predictive models and enrich apps with Airbnb data.
• ✍️ Content Creators & Bloggers: Discover and share unique homes and experiences.
• 🏠 Real Estate Professionals: Analyze short-term rental market dynamics and opportunities.

Features

• 🚀 Effortless Initialization: Start with predefined Airbnb URLs for targeted scraping.
• 📊 Flexible Pagination: Control the depth of your searches with customizable pagination.
• 🔍 In-Depth Scraping: Obtain detailed data from individual listings and experiences.
• 🌐 Robust Proxy Support: Navigate freely with proxy configurations to ensure seamless data access.

Input Schema

• startUrls (required): Array of Airbnb search URLs. Supports both home and experience searches with a minimum requirement of one URL.
• pagination: Integer specifying the number of pages to scrape. Set to 0 for unlimited pages.
• pdpPage: Boolean flag to enable scraping of Airbnb home detail pages.
• experiencePage: Boolean flag to enable scraping of Airbnb experience detail pages.
• proxyUrls (required): Object for proxy configuration, pre-filled to use Apify Proxy results can vary related to proxy country.

Getting Started

1. Define Start URLs: List the Airbnb search URLs you want to scrape in the startUrls property.
2. Set Pagination Limit: Specify the number of pages to scrape for each URL in the pagination property.
3. Enable Detailed Page Scraping: Choose whether to scrape home or experience detail pages by setting pdpPage and experiencePage respectively.
4. Configure Proxies: Ensure the proxyUrls property is correctly set to manage IP rotation and avoid blocking.

Example Usage

1{
2    "experiencePage": false,
3    "pdpPage": false,
4    "proxyUrls": {
5        "useApifyProxy": true,
6        "apifyProxyGroups": [],
7        "apifyProxyCountry": "CA"
8    },
9    "startUrls": [
10        {
11            "url": "https://www.airbnb.com/rooms/6060569?adults=2&category_tag=Tag%3A8175&children=1&enable_m3_private_room=true&infants=1&pets=1&photo_id=43323555&check_in=2024-08-24&check_out=2024-09-21%2B&previous_page_section_name=1000&federated_search_id=813f81f2-7a1d-4554-9c16-fae6f903d998"
12        },
13        {
14            "url": "https://www.airbnb.com/s/experiences?tab_id=experience_tab&refinement_paths%5B%5D=%2Fexperiences&flexible_trip_lengths%5B%5D=one_week&monthly_start_date=2024-03-01&monthly_length=3&monthly_end_date=2024-06-01&price_filter_input_type=0&channel=EXPLORE&date_picker_type=calendar&checkin=2024-02-24&checkout=2024-03-12&source=structured_search_input_header&search_type=filter_change"
15        },
16        {
17            "url": "https://www.airbnb.com/s/Spain/homes?tab_id=home_tab&refinement_paths%5B%5D=%2Fhomes&monthly_start_date=2024-03-01&monthly_length=3&monthly_end_date=2024-06-01&price_filter_input_type=0&channel=EXPLORE&date_picker_type=flexible_dates&source=structured_search_input_header&search_type=filter_change&rank_mode=default&place_id=ChIJi7xhMnjjQgwR7KNoB5Qs7KY&flexible_trip_dates%5B%5D=august&flexible_trip_lengths%5B%5D=one_month&adults=2&children=1&infants=1&pets=1"
18        }
19    ]
20}

This example configuration will scrape the first two pages of both home and experience search results for New York and Paris, including detailed information pages, using Apify's proxies.

Output

The scraper outputs JSON files containing detailed data on Airbnb listings and experiences, including titles, descriptions, pricing, reviews, and more. Here's a sample structure of an output file for a home listing:

Home Listing Example

1{
2  "url": "https://www.airbnb.com/rooms/51619634",
3  "name": "Untitled at 3 Freeman - Studio Queen",
4  "title": "Apartment in New York",
5  "type": "entire_home",
6  "avgRating": "4.88 (1313 reviews)",
7  "images": [
8    "https://a0.muscache.com/im/pictures/miso/Hosting-51619634/original/6f6b97f7-e3f5-482a-8e11-723f16bb7fb2.jpeg",
9    "...other images..."
10  ],
11  "location": {
12    "latitude": 40.72301,
13    "longitude": -73.99201
14  },
15  "badges": ["Superhost"],
16  "pricingQuote": {
17    "label": "$142 per night, originally $197",
18    "discountedPrice": "$142",
19    "originalPrice": "$197",
20    "qualifier": "night"
21  },
22  "metadata": {
23    "rank": 1,
24    "page": 1,
25    "url": "https://www.airbnb.com/s/homes?query=New%20York",
26    "pageType": "homes"
27  }
28}

Experience Listing Example

1{
2  "url": "https://www.airbnb.com/experiences/4500619",
3  "name": "No Diet Club - Amazing street food in Brooklyn",
4  "tags": ["Food and drink", "Street food"],
5  "highlights": ["Excellent value", "Top-rated Host"],
6  "reviewsCount": 193,
7  "overallRating": 4.97,
8  "duration": "3.5 hours",
9  "price": "$69 per person"
10  ...
11}

For detailed output examples and further documentation, refer to the output files generated by the scraper.

Notes

• Ensure your proxies are properly configured to avoid scraping issues.
• If the Actor returns empty results, this may be due to broken links. Please verify that your URLs are functioning correctly.

We’re always working on improving the performance of our Actors. so for support, issues, or customization, please contact the development team or submit an issue on Issues tab in Apify Console.