Healthgrades Family Practice Scraper

Extract comprehensive family practice and primary care provider data from Healthgrades at scale. Collect profile-level information including names, specialties, locations, ratings, contact details, and profile links in structured datasets. Ideal for healthcare research, directory building, market intelligence, and network analysis.

Features

• Comprehensive provider records - Collect rich profile data with nested details when available.
• Location-focused discovery - Target specific cities, states, or broad regions.
• Clean normalized output - Removes empty values and duplicate records automatically.
• Flexible collection limits - Set your own result volume and page depth for every run.
• Production-ready datasets - Export data in formats suited for analytics and operations.

---

Use Cases

Healthcare Market Intelligence

Track provider presence and specialty distribution across markets. Use consistent datasets to compare regions, identify opportunities, and monitor local competition.

Provider Directory Enrichment

Build or enrich healthcare directories with provider profile links, identifiers, specialty data, and contact signals for better search and matching experiences.

Insurance Network Research

Support network planning and analysis by collecting provider coverage snapshots across targeted geographies.

Referral and Outreach Strategy

Discover providers in specific service areas and specialties to support referral development and outreach workflows.

Academic and Policy Analysis

Generate structured datasets for research projects on access, provider density, and geographic healthcare availability.

---

Input Parameters

Parameter	Type	Required	Default	Description
startUrl	String	No	-	Direct Healthgrades search URL. If provided, it is used as the search source.
keyword	String	No	Family Practice	Search keyword or specialty.
location	String	No	""	Geographic location such as state, city, or city/state combination.
results_wanted	Integer	No	20	Target number of provider records to save. The run stops when this count is reached or no more data is available.
max_pages	Integer	No	10	Target number of result pages to request. The run stops earlier if the data ends.
proxyConfiguration	Object	No	Apify Proxy enabled if not provided	Proxy settings for more reliable collection.

---

Output Data

Each dataset item contains non-empty fields only. Exact fields vary by provider record availability.

Field	Type	Description
id	String	Unique provider identifier (when available).
url	String	Canonical provider profile URL.
source	String	Extraction source label.
imageUrl	String	Best available provider image URL.
displayName	String	Provider display name with credentials (when available).
name	String	Provider name.
providerId	String	Provider identifier or NPI-like value (when available).
specialty	String	Primary specialty label (when available).
specialties	Array	Specialty list (when available).
location	String	Provider location label (when available).
rating	Number	Rating score (when available).
reviewCount	Number	Number of reviews or survey entries (when available).
phone	String	Contact phone number (when available).
address	Object	Structured address object (when available).
...additionalFields	Mixed	Additional non-empty provider fields are preserved when present.

---

Usage Examples

Basic State Search

{
  "keyword": "Family Practice",
  "location": "California",
  "results_wanted": 20
}

City-Level Collection

{
  "keyword": "Primary Care",
  "location": "Dallas, TX",
  "results_wanted": 75,
  "max_pages": 8
}

Direct Search URL

{
  "startUrl": "https://www.healthgrades.com/usearch?what=Family+Practice&where=Texas",
  "results_wanted": 50,
  "max_pages": 10,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

The actor respects the values you provide at runtime. If the source has fewer records than requested, the run stops when the data ends.

---

Sample Output

{
  "id": "xsk9m",
  "url": "https://www.healthgrades.com/physician/dr-jane-doe-xsk9m",
  "source": "provider_search_api",
  "imageUrl": "https://photos.healthgrades.com/img/prov/x/s/k/xsk9m_w120h160.jpg",
  "displayName": "Dr. Jane Doe, DO",
  "name": "Dr. Jane Doe",
  "specialty": "Family Medicine",
  "specialties": ["Family Medicine", "Primary Care"],
  "location": "Waco, TX",
  "rating": 4.8,
  "reviewCount": 142,
  "phone": "(254) 555-1234",
  "address": {
    "line1": "7300 Bosque Blvd",
    "city": "Waco",
    "state": "TX",
    "postalCode": "76710"
  }
}

---

Tips for Best Results

Start Small, Then Scale

• Test with results_wanted: 20 first.
• Increase volume after validating your target geography.
• Set max_pages only as high as you need for the target search.

Use Precise Location Inputs

• Prefer specific city/state combinations when possible.
• Use broader state searches for regional mapping projects.

Keep Output Quality High

• Build downstream processing for optional fields.
• Expect different field coverage between provider records.

Proxy Recommendation

• Residential proxy settings improve consistency for larger runs.
• Keep request sizes realistic for stable performance.

---

Integrations

Connect extracted datasets with:

• Google Sheets - Spreadsheet analysis and quick collaboration.
• Airtable - Searchable provider databases and internal tools.
• Slack - Notifications after completed runs.
• Make - Automated data routing and enrichment flows.
• Zapier - Trigger business actions from fresh records.
• Webhooks - Send results directly to custom systems.

Export Formats

• JSON - Structured programmatic usage.
• CSV - Spreadsheet-friendly analysis.
• Excel - Business reporting workflows.
• XML - Legacy and enterprise integrations.

---

Frequently Asked Questions

How many providers can I collect in one run?

You can request as many records as you need. Actual results depend on search scope and available listings, and the run stops when your requested count is reached or the source has no more records.

Can I search outside family practice?

Yes. Use the keyword parameter for specialties like internal medicine, pediatrics, or primary care.

Why do some records have fewer fields?

Provider profile completeness can vary. The actor only returns non-empty values.

Can I use a direct Healthgrades search URL?

Yes. Set startUrl to a valid search URL to drive collection from that source.

Does the actor remove duplicates?

Yes. Duplicate provider records are filtered before saving.

Can I automate recurring runs?

Yes. Use schedules in Apify to run this actor periodically.

---

Support

For issues or feature requests, use the Apify Console support channels.

Resources

• Apify Documentation
• Apify API Reference
• Apify Schedules

---

Legal Notice

This actor is intended for legitimate data collection and analysis workflows. Users are responsible for compliance with applicable laws, platform terms, and data usage requirements.