🏍️ OLX Product Listings Scraper

This Apify actor scrapes classified ads data from OLX India, one of India's largest platforms for buying and selling used goods. Scrape motorcycles, cars, electronics, real estate, and other categories to collect comprehensive listing information including title, description, price, images, location, seller details, and product parameters. Perfect for market research, price comparison, and classified ads analytics.

✅ Use Cases

• 📊 Conduct market research on used goods and classified ads
• 💰 Monitor pricing trends across different categories
• 🏷️ Track product availability and seller patterns
• 📈 Build price comparison and market analysis datasets
• 🎯 Analyze geographic distribution of listings
• 🔍 Research specific product categories or brands

📥 Input Configuration

You can customize the actor using the following input fields:

{
    "startUrls": [
        {
            "url": "https://www.olx.in/kerala_g2001160/motorcycles_c81"
        }
    ],
    "maxItems": 50,
    "maxPages": 5
}

🧾 Fields Explained

Field	Type	Description
startUrls	array	Array of OLX category or search URLs to scrape (e.g., motorcycles, cars, electronics)
maxItems	number	Maximum number of listings to scrape (0 = unlimited, default: 50)
maxPages	number	Maximum number of pages to scrape per start URL (1-100, default: 5)

🔗 Example Start URLs

Category	URL
Motorcycles (Kerala)	https://www.olx.in/kerala_g2001160/motorcycles_c81
Cars (Mumbai)	https://www.olx.in/mumbai_g4058877/cars_c84
Electronics	https://www.olx.in/electronics-appliances_g5
Real Estate	https://www.olx.in/properties_g5

📤 Output

The actor returns a dataset containing structured listing records. Each record includes comprehensive details extracted from the product detail page.

🧩 Sample Output

{
    "id": "1733271487",
    "product_url": "https://www.olx.in/item/bullet-350cc-excellent-condition-exchange-available-iid-1733271487",
    "title": "Bullet 350cc excellent condition / exchange available",
    "description": "Restored With all new parts, showroom condition",
    "price": "₹ 1,40,000",    "price_raw": 140000,
    "category": "Motorcycles",
    "location": "Fort Kochi, Kerala",
    "posted_date": "2 days ago",
    "seller_name": "Ramesh Kumar",
    "seller_type": "Individual",
    "mobile_number": "+91XXXXXXXXXX",
    "images": [
        "https://apollo-singapore.akamaized.net:443/v1/files/48z6jxi9i76z2-IN/image",
        "https://apollo-singapore.akamaized.net:443/v1/files/5dtb7z3tivqt-IN/image"
    ],
    "mainImage": "https://apollo-singapore.akamaized.net:443/v1/files/48z6jxi9i76z2-IN/image",
    "status": "active",
    "parameters": [
        {
            "key_name": "Brand",
            "value": "Royal Enfield"
        },
        {
            "key_name": "Model",
            "value": "Bullet"
        },
        {
            "key_name": "Year",
            "value": "1991"
        },
        {
            "key_name": "KM driven",
            "value": "2,000 km"
        }
    ]
}

📋 Output Fields

Field	Type	Description
id	string	Unique listing identifier
product_url	string	Direct listing page URL
title	string	Listing title
description	string	Detailed listing description
price	string	Formatted price with currency symbol
price_raw	number	Numeric price value
category	string	Product category
location	string	Listing location
posted_date	string	Date when listing was posted
seller_name	string	Name of the seller
seller_type	string	Type of seller (Individual, Dealer, etc.)
mobile_number	string	Seller's mobile number (if available)
images	array	Array of all product image URLs
mainImage	string	Primary product image URL
status	string	Listing status (active, sold, etc.)
parameters	array	Product-specific parameters (brand, model, year, etc.)

🔍 Data Source

• ✓ Visits each product detail page individually
• ✓ Extracts data from visible page content (HTML selectors only)
• ✓ No API calls - pure browser automation
• ✓ Supports multiple categories (motorcycles, cars, electronics, etc.)
• ✓ Comprehensive listing information extraction
• ✓ Extracts seller information and contact details
• ✓ Captures all product images
• ✓ Geographic and temporal data included

🔒 Proxy Configuration

This actor uses Playwright with stealth settings. For production use, configure proxy:

{
  "useApifyProxy": true,
  "apifyProxyGroups": ["RESIDENTIAL"],
  "apifyProxyCountry": "IN"
}

🚀 How to Use

1. Open the actor in Apify Console
2. Click "Try actor" or create a new task
3. Enter your start URLs (e.g., "https://www.olx.in/kerala_g2001160/motorcycles_c81")
4. Configure maxItems and maxPages settings
5. Run the actor
6. Download results in JSON, CSV, or Excel format

⚙️ Advanced Input Example

{
    "startUrls": [
        {
            "url": "https://www.olx.in/kerala_g2001160/motorcycles_c81"
        },
        {
            "url": "https://www.olx.in/mumbai_g4058877/cars_c84"
        }
    ],
    "maxItems": 100,
    "maxPages": 10
}

🛠️ Tech Stack

• Apify SDK — actor orchestration and data handling
• Playwright — browser automation with stealth capabilities
• Node.js 18+ — runtime environment

📊 Data Processing Features

• ✓ Browser-based scraping to extract listing data
• ✓ Stealth mode with anti-detection measures
• ✓ Automatic pagination handling
• ✓ Structured data parsing and normalization
• ✓ Comprehensive logging and error handling
• ✓ Support for multiple categories and locations

🔧 Local Development

Installation

$npm install

Running the Actor

$npm start

Validation

Validate all generated datasets against the schema:

$node validate-datasets.js

Code Quality

Format code:

$npm run format

Check linting:

$npm run lint

🤝 Support

For issues, questions, or feature requests, please refer to the Apify documentation or contact support.