Doctor.com Scraper

An Apify Actor that scrapes doctor information from Doctor.com, including specialities, locations, insurances, doctor profiles, and reviews.

Features

• Search and filter medical specialities
• Search locations via autocomplete
• Search and filter insurance providers
• Get all supported languages
• Search doctors with multiple filters (location, speciality, rating, etc.)
• Get detailed doctor profiles
• Get doctor reviews with pagination

Actions

1. search_specialities

Search or filter medical specialities from the database.

Parameters:

• query (optional): Search query to filter specialities

Example Input:

{
    "action": "search_specialities",
    "query": "cardio"
}

2. search_locations

Search locations via Doctor.com's autocomplete API.

Parameters:

• query (required): Location search query (e.g., "New York", "Los Angeles")

Example Input:

{
    "action": "search_locations",
    "query": "New York"
}

3. search_insurances

Search or filter insurance providers from the database.

Parameters:

• query (optional): Search query to filter insurances

Example Input:

{
    "action": "search_insurances",
    "query": "Blue Cross"
}

4. get_all_languages

Get all supported languages for filtering doctors.

Parameters: None

Example Input:

{
    "action": "get_all_languages"
}

5. search_doctors

Search doctors with multiple filters.

Parameters:

• location_id (required): Location ID from search_locations results
• location_name (required): Location name (e.g., "New York, NY")
• speciality (optional): Medical speciality to filter by
• language_spoken (optional): Filter by language spoken
• rating (optional): Minimum rating filter (0-5)
• board_certified (optional): Filter by board certification (0 or 1)
• online_scheduling (optional): Filter by online scheduling availability (0 or 1)
• verified (optional): Filter by verified profiles (0 or 1)
• distance (optional): Search radius in miles (5, 10, 25, 50, 100)
• proof_points (optional): Minimum profile proof points (0-100)
• page (optional): Page number for pagination (default: 1)

Example Input:

{
    "action": "search_doctors",
    "location_id": "12345",
    "location_name": "New York, NY",
    "speciality": "Cardiologist",
    "rating": "4",
    "page": 1
}

6. get_doctor_details

Get detailed information about a specific doctor.

Parameters:

• profile_id (required): Doctor profile URL path (e.g., "/Dr-John-Smith-MD")

Example Input:

{
    "action": "get_doctor_details",
    "profile_id": "/Dr-John-Smith-MD"
}

7. get_doctor_reviews

Get reviews for a specific doctor with pagination.

Parameters:

• friendly_url (required): Doctor's friendly URL slug (e.g., "Dr-John-Smith")
• provider_id (required): Doctor's provider ID (from get_doctor_details)
• page (optional): Page number for pagination (default: 1)

Example Input:

{
    "action": "get_doctor_reviews",
    "friendly_url": "Dr-John-Smith",
    "provider_id": "123456",
    "page": 1
}

Output Format

All actions return data in a consistent format:

{
    "action": "action_name",
    "success": true,
    "data": { ... },
    "error": null,
    "timestamp": "2024-01-01T00:00:00.000Z"
}

On error:

{
    "action": "action_name",
    "success": false,
    "data": null,
    "error": "Error message",
    "timestamp": "2024-01-01T00:00:00.000Z"
}

Typical Workflow

1. Search for a location using search_locations to get the location_id
2. Search for doctors using search_doctors with the location and optional filters
3. Get doctor details using get_doctor_details with the profile_id from search results
4. Get doctor reviews using get_doctor_reviews with friendly_url and provider_id from doctor details

Data Sources

• Specialities: Local database of 120+ medical specialities
• Insurances: Local database of 1,100+ insurance providers
• Languages: Local database of 110+ supported languages
• Doctors, Profiles, Reviews: Live data from Doctor.com

Notes

• The Actor uses standard HTTP requests (no anti-bot bypass needed)
• Rate limiting may apply for high-volume requests
• Some doctor profiles may have limited information based on their verification status