Agoda Hotel Scraper

An Apify Actor that scrapes hotel data from Agoda.com. Provide a destination, check-in date, and check-out date, and the scraper will extract comprehensive hotel information including prices, ratings, reviews, amenities, and more.

Features

• 🏨 Scrapes hotel listings from Agoda search results
• 💰 Extracts pricing information (per night, original price, discounts)
• ⭐ Captures star ratings and review scores
• 📍 Gets location and address details
• 🛏️ Extracts room types and amenities
• 🖼️ Collects hotel images and URLs
• 📄 Handles pagination and lazy-loaded content

Input Parameters

Parameter	Type	Required	Default	Description
destination	string	Yes	"Goa"	City or location to search for hotels
checkInDate	string	Yes	"2025-01-15"	Check-in date in YYYY-MM-DD format
checkOutDate	string	Yes	"2025-01-17"	Check-out date in YYYY-MM-DD format
adults	integer	No	2	Number of adults (1-10)
rooms	integer	No	1	Number of rooms (1-10)
maxHotels	integer	No	50	Maximum number of hotels to scrape (1-500)
proxyConfiguration	object	No	-	Proxy settings for anti-bot protection

Example Input

{
    "destination": "Goa",
    "checkInDate": "2025-01-15",
    "checkOutDate": "2025-01-17",
    "adults": 2,
    "rooms": 1,
    "maxHotels": 50,
    "proxyConfiguration": {
        "useApifyProxy": true
    }
}

Output Data

Each hotel in the output dataset contains the following fields:

Field	Type	Description
hotelName	string	Name of the hotel
location	string	Location/area of the hotel
rating	number	Star rating (1-5)
reviewScore	number	Review score (e.g., 8.5/10)
reviewCount	number	Total number of reviews
pricePerNight	number	Price per night
originalPrice	number	Original price (before discount)
discount	string	Discount percentage
totalPrice	number	Total price for the stay
currency	string	Currency code (e.g., "INR")
roomType	string	Type of room
amenities	array	List of amenities
imageUrl	string	URL of hotel image
hotelUrl	string	Direct link to hotel page
checkInDate	string	Check-in date
checkOutDate	string	Check-out date
destination	string	Search destination
scrapedAt	string	Timestamp when data was scraped

Example Output

{
    "hotelName": "Taj Exotica Resort & Spa, Goa",
    "location": "South Goa",
    "rating": 5,
    "reviewScore": 9.2,
    "reviewCount": 1250,
    "pricePerNight": 25000,
    "originalPrice": 32000,
    "discount": "22% off",
    "totalPrice": 50000,
    "currency": "INR",
    "roomType": "Deluxe Room",
    "amenities": ["Free WiFi", "Pool", "Spa", "Beach Access", "Restaurant"],
    "imageUrl": "https://example.com/hotel-image.jpg",
    "hotelUrl": "https://www.agoda.com/en-in/taj-exotica-resort-spa-goa/hotel/...",
    "checkInDate": "2025-01-15",
    "checkOutDate": "2025-01-17",
    "destination": "Goa",
    "scrapedAt": "2025-01-10T14:30:00.000Z"
}

Running Locally

1. Install dependencies:

   pip install -r requirements.txt
   playwright install chromium
   

2. Create input file at storage/key_value_stores/default/INPUT.json:

   {
       "destination": "Mumbai",
       "checkInDate": "2025-02-01",
       "checkOutDate": "2025-02-03"
   }
   

3. Run the actor:

   $apify run
   

Deployment to Apify

1. Login to Apify:

   $apify login
   

2. Push to Apify platform:

   $apify push
   

Technical Details

• Framework: Crawlee with Playwright
• Browser: Chromium (headless)
• Language: Python 3.13
• Anti-bot measures: Uses Apify Proxy, realistic browser fingerprinting

Notes

• The scraper uses Playwright for browser automation since Agoda is a JavaScript-heavy website
• Proxy usage is recommended to avoid rate limiting and blocks
• Respects Agoda's terms of service - use responsibly
• Scraping speed is limited to avoid overloading the server

License

ISC License