Doctor Coxhealth Scraper

Introduction

The Doctor Coxhealth Scraper is a powerful Apify Actor designed to extract detailed profiles of doctors from the Coxhealth website. By inputting clinical keywords, it scrapes comprehensive information such as names, specialties, insurance accepted, and appointment details, making it an invaluable tool for healthcare research and data aggregation. This actor ensures reliable data extraction with built-in proxy support to handle potential restrictions and deliver high-quality results efficiently.

Features

• Comprehensive Data Extraction: Scrapes full doctor profiles including personal details, specialties, languages, insurance options, and appointment types.
• Keyword-Based Search: Allows targeted scraping using clinical keywords to find relevant doctors quickly.
• Proxy Integration: Utilizes residential proxies for anonymity and to bypass geo-restrictions, ensuring uninterrupted operation.
• High Performance: Built with Python Scrapy for fast and efficient scraping, minimizing runtime.
• Structured Output: Delivers clean, JSON-formatted data ready for integration into databases or analysis tools.
• Reliability: Handles errors gracefully and provides detailed logging for monitoring.
• Scalability: Suitable for large-scale extractions with configurable parameters.

Input Parameters

Parameter	Type	Required	Description	Example
clinical_keywords	string	Yes	Keywords related to clinical specialties or conditions to search for doctors (e.g., "bloody diarrhea").	"bloody diarrhea"
proxyConfiguration	object	No	Configuration for proxy servers to hide the scraper's origin, including Apify Proxy settings.	{"useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"]}

Example Usage

Input JSON

{
  "clinical_keywords": "bloody diarrhea",
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Output JSON

[
  {
    "full_name": "J-Pia Kim Spruill",
    "first_name": "J-Pia",
    "last_name": "Spruill",
    "middle_name": "Kim",
    "gender": "Female",
    "specialties": [
      "Family Medicine"
    ],
    "languages": [
      "English"
    ],
    "accepting_new_patients": true,
    "years_in_practice": 15,
    "degrees": [
      "MD"
    ],
    "insurance_accepted": [
      "Prime Health (f/k/a Missouri PPO)\u00a0(Workers Compensation Only) (Branson only)",
      "Xerox (Workers Compensation Only)\u00a0(Springfield Hospital only)",
      "WellCare by Allwell",
      "United HealthCare Community (Managed Medicaid Plan)",
      "United HealthCare Medicare Advantage Products",
      "United HealthCare Commercial Products",
      "Tribute Health Plans (Formerly Arkansas Superior Select)",
      "Three Rivers (Workers Compensation Only)\u00a0(Branson only)",
      "Show Me Healthy Kids - Home State Health",
      "Providers Partners Health Plan Medicare Advantage",
      "Optum (United Behavioral Health)",
      "Novasys Health Inc. (Workers Compensation Only)\u00a0(Branson only)",
      "National Preferred Provider Network \u00a0(Workers Compensation Only) (Branson only)",
      "Mercy Behavioral Health",
      "MedRisk, LLC (Workers Compensation Only)",
      "Healthy Blue Missouri (Managed Medicaid)",
      "Humana Medicare Advantage",
      "Home State Health (Managed Medicaid)",
      "Triwest Healthcare Alliance",
      "HealthLink\u00a0(Branson and Barton County only)",
      "Devoted Health, Inc",
      "Cox HealthPlans Medicare Advantage",
      "Cox HealthPlans Commercial Products",
      "Corvel (Workers Compensation Only)",
      "CareWorks Managed Care Services\u00a0(Workers Compensation Only) (Branson Hospital and CoxHealth employed providers and facilities)",
      "CompAlliance (Workers Compensation Only)\u00a0(Branson Hospital and CoxHealth employed providers and facilities)",
      "Cigna Commercial Products",
      "Arkansas BlueCross BlueShield (Medicare Advantage Plans Only)\u00a0(Branson and Harrison Clinic only)",
      "Arkansas BlueCross BlueShield Commercial Plans\u00a0(Harrison, AR Clinic only)",
      "Anthem Medicare Advantage",
      "Anthem Commercial Products",
      "Arkansas Allwell",
      "AMCO - Arkansas Managed Care Organization\u00a0(Branson only)",
      "Align Network (Workers Compensation Only) (Branson and Monett Hospitals only)",
      "Aetna Medicare Advantage",
      "Aetna Commercial Products",
      "PHCS/Multiplan/Savility",
      "FirstHealth Network (Rental Network PPO & Workers Compensation)"
    ],
    "book_online_url": "https://doctors.coxhealth.com/book/913005",
    "image_url": "https://cdn-images.kyruus.com/providermatch/coxhealth/photos/500/spruill-jpia-1306027297.jpg",
    "video_url": null,
    "locations": [],
    "appointment_types": [
      {
        "name": "Established Patient Appointment",
        "patient_relationship": "established",
        "visit_methods": [
          "in_person"
        ]
      },
      {
        "name": "Annual Physical",
        "patient_relationship": "established",
        "visit_methods": [
          "in_person"
        ]
      }
    ]
  }
]

Use Cases

• Healthcare Research: Gather data on doctors' specialties and experience for academic studies or market analysis.
• Patient Matching: Help patients find providers based on insurance, languages, and availability.
• Medical Directories: Build or update databases for healthcare apps and websites.
• Insurance Analysis: Analyze accepted insurance plans to inform policy decisions.
• Competitive Intelligence: Monitor doctor profiles for business insights in the healthcare sector.
• Appointment Scheduling: Integrate with systems to automate booking based on scraped availability.

Installation and Usage

1. Search for "Doctor Coxhealth Scraper" in the Apify Store.
2. Click "Try for free" or "Run".
3. Configure input parameters (e.g., enter clinical keywords and adjust proxy settings).
4. Click "Start" to begin extraction.
5. Monitor progress in the log.
6. Export results in your preferred format (JSON, CSV, Excel).

Output Format

The actor outputs a JSON array of objects, each representing a doctor's profile. Key fields include:

• full_name, first_name, last_name, middle_name: Doctor's name components.
• gender, specialties, languages: Demographic and professional details.
• accepting_new_patients, years_in_practice, degrees: Practice information.
• insurance_accepted: List of accepted insurance providers.
• book_online_url, image_url, video_url: Links for booking and media.
• locations, appointment_types: Physical locations and available appointment options. This structured format ensures easy parsing and integration.

Support

For custom/simplified outputs or bug reports, please contact:

• Email: support@getdataforme.com
• Subject line: "custom support"
• Contact form: https://getdataforme.com/contact/

We're here to help you get the most out of this Actor!