Healthgrades Doctor Scraper

Scrape US healthcare provider profiles from Healthgrades.com — doctors, dentists, specialists with NPI, ratings, reviews, insurance, education, hospital affiliations and locations — for medical lead generation and healthcare market research. Search by specialty + city, or paste provider profile URLs.

Main Use Cases

• Healthcare lead generation — build provider lists (name, NPI, practice, specialty, phone, address, insurance) for medical sales, recruiting and pharma rep targeting.
• Doctor & physician database — enrich a CRM or directory with ratings, reviews, education, board certifications and hospital affiliations.
• Medical reputation monitoring — track provider review counts and ratings over time for healthcare marketing.
• Market & network analysis — map provider distribution by specialty/city, or research insurance acceptance for patient-access strategy.

How It Works

Healthgrades serves pages from Akamai behind a geo-fence (US residential IPs only, TLS fingerprinting, database backend). The actor drives a real Chromium browser through header-level anti-bot with US residential proxies built in, reading the database-driven JSON payloads that render each profile page. It accepts either a list of search queries (searchQueries) or direct provider URLs (startUrls). Search results are de-duplicated, skipped if the profile is unavailable, and each profile page is scraped through detail + reviews to full depth. A free preview returns the first 10 results for testing.

Build Doctor & Healthcare Provider Databases Without an Official Healthgrades API

Healthgrades has no public API and its data is scattered across HTML, JSON payloads and CDN assets. This actor assembles every public provider field into one clean JSON object per profile: name, NPI, specialty, practice details, phone, address, education, board certifications, insurance accepted, hospital affiliations, ratings and patient reviews — ready for a healthcare CRM, provider directory or lead-gen pipeline.

Track Patient Ratings & Reviews for Reputation Monitoring

Each profile carries the full provider rating (1–5 stars), review count, and — when includeReviews is on — the patient review timeline with text, rating, and date. Schedule weekly or monthly runs to monitor how ratings and new reviews evolve for the doctors you track.

Input

Field	Type	Required	Default	Notes
searchQueries	array	No	—	Free-text searches like "cardiologist New York, NY" or "dentist 90210". Each query runs as its own search; results de-duplicated.
startUrls	array	No	—	Direct provider profile URLs, e.g. https://www.healthgrades.com/physician/nick-berg-3z7w6 (must be internal profile links from alerts/other sources — search results are ignored).
sortBy	enum	No	bestmatch	bestmatch, ratings (highest rated first), distance, experience (most years of experience first).
maxItems	integer	No	50	Hard cap on provider rows for the whole run.
includeProfileDetails	boolean	No	true	Fetch the full profile: summary, education, certifications, hospitals, insurance, reviews preview.
includeReviews	boolean	No	true	Also fetch reviews on the provider's profile (implies details; adds paying time).
maxReviewsPerProfile	integer	No	10	Cap on review entries kept per provider (max 100).
maxReviews	integer	No	500	Hard cap on review rows for the whole run.
maxRequestsPerCrawl	integer	No	500	Cap on page requests (details/reviews pages count too).
maxConcurrency	integer	No	0	Number of parallel pages; 0 = auto. Use profiler to tune.
debug	boolean	No	false	Output full logs to the dataset/console as #debug rows.

Note on proxy input

You must select a proxy configuration — use Residential proxies; the author recommends the pre-configured value {{ RESIDENTIAL_PROXY_PASS }}. Without a US residential proxy, Healthgrades' geo-fence blocks the run.

Example Input

{
  "searchQueries": ["cardiologist New York, NY"],
  "sortBy": "ratings",
  "maxItems": 50,
  "includeProfileDetails": true,
  "includeReviews": true,
  "maxReviewsPerProfile": 10,
  "proxy": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }
}

Output

Two datasets: providers (default) and reviews (separate, when includeReviews is on).

Provider row

{
  "url": "https://www.healthgrades.com/physician/nick-berg-3z7w6",
  "name": "Nick Berg",
  "npi": "1255003242",
  "specialty": "Internal Medicine",
  "subspecialties": ["Cardiac Disease"],
  "rating": 4.4,
  "reviewCount": 312,
  "location": "New York, NY",
  "phone": "(212) 555-0134",
  "insurancesAccepted": ["Aetna", "Empire Blue Cross Blue Shield", "UnitedHealthcare"],
  "education": ["University of Wisconsin School of Medicine"],
  "certifications": [],
  "hospitals": ["Mount Sinai Hospital"],
  "yearsExperience": 19,
  "isMale": true,
  "telehealthAvailability": false
}

Review rows (reviews dataset) include providerName, providerUrl, reviewDate, rating, text, reviewerUsername, category (e.g. a specialty tag) and issueFlag.

Dataset schema (default dataset — overview view)

providerName, specialty, rating, reviewCount, npi (when available), location / address, phone, url / sourceUrl, scrapedAt (schema-backed fields; the actor's dataset schema is being completed by the developer).

Scrape Insurance Acceptance & Hospital Affiliations for Network Planning

Profile rows include which insurance plans each provider accepts and which hospitals they are affiliated with — a ready-made dataset for healthcare network analysis, insurer directory enrichment and care-access research.

Integrations & Automation

• Apify API — feed provider rows into a healthcare CRM, sales tool or ERP.
• Webhooks — notify your pipeline when a scrape finishes.
• Scheduling — weekly reputation monitoring, monthly market sweeps.
• Export — JSON, CSV, HTML, Excel.

Recommended schedule: weekly for reputation monitoring; monthly for market research.

Related Actors

• Healthgrades Scraper - Doctors, Reviews & Details — most-used Healthgrades actor (75 users).
• Zocdoc & Healthgrades Scraper - Doctor Details & Reviews — Healthgrades + Zocdoc in one actor.
• Healthgrades Doctor Scrapper - Profiles & Reviews — paste-a-URL Healthgrades doctor scraper.
• Healthgrades Scraper — lowest-priced Healthgrades competitor.
• Vivian Health Scraper - Travel Nurse Job Listings — healthcare workforce data for staffing research beyond providers.

FAQ

Why use this actor instead of the official CMS NPI registry?

The free NPI registry carries only the basics: name, specialty, practice address. It has no ratings, no patient reviews, no insurance acceptance, no education/certifications, no hospital affiliations, and no review history. Healthgrades' profiles layer all of the above on top — this actor captures the full public profile, not just the directory stub.

What are alternatives to this actor / US provider data?

• jaybird/healthgrades-scraper and crawlerbros/zocdoc-healthgrades-scraper (also Zocdoc) — comparable coverage; pricing varies by volume.
• memo23/healthgrades-doctor-scraper — paste-a-URL alternative.
• shahidirfan/Healthgrades-Scraper — cheapest Store competitor (~$0.001/provider).
• Non-Apify: RxNORM/CMS datasets cover billing data but not reputation or insurance-acceptance detail.

How can I get all cardiologists in a city?

Use searchQueries like "cardiologist New York, NY", set sortBy (ratings, experience, distance) and raise maxItems. The actor de-duplicates and paginates the search results automatically.

What is the best way to track a provider's rating over time?

Save the provider's profile URL in startUrls and run weekly with includeReviews: true. The reviews dataset keeps date stamps so you can diff new reviews and rating changes.

Why do I need a US residential proxy?

Healthgrades geo-fences its content to US IP addresses (Akamai + TLS fingerprinting). The actor works reliably through residential proxies — the proxy input is mandatory, not optional.

For AI Agents & LLM Apps

• Purpose: given search queries or provider URLs, returns one structured healthcare-provider record per Healthgrades profile (name, NPI, specialty, address, phone, rating, review count, insurance, education, hospitalization, reviews).
• Minimal input:

{
  "searchQueries": ["dentist 90210"],
  "maxItems": 10,
  "includeProfileDetails": true,
  "includeReviews": false,
  "proxy": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }
}

• Variant — reviews mode:

{
  "searchQueries": ["cardiologist New York, NY"],
  "sortBy": "ratings",
  "maxItems": 20,
  "includeProfileDetails": true,
  "includeReviews": true,
  "maxReviewsPerProfile": 20,
  "proxy": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }
}

• Output field list (providers dataset): url, name, npi, specialty, subspecialties, rating, reviewCount, location, address, phone, insurancesAccepted, education, certifications, hospitals, yearsExperience, isMale, telehealthAvailability, scrapedAt, plus reviews ({providerName, providerUrl, reviewDate, rating, text, reviewerUsername, category}).

Behaviors an agent should know:

• proxy is required — use Residential; without it Healthgrades' geo-fence (Akamai, TLS pinning) blocks the run.
• startUrls accept internal profile links only (e.g. from alerts); search-result URLs in startUrls are ignored — use searchQueries for discovery.
• includeReviews implies details and adds paying time; respect maxReviewsPerProfile/maxReviews caps to bound cost.
• maxRequestsPerCrawl counts page requests (search, detail, reviews), so a few hundred profiles can consume it — raise it for large runs.
• Some fields (npi occasionally absent; certifications sometimes empty) can legitimately be []/absent — don't treat as errors.
• Billing: pay-per-event — result $0.0015/provider row, Review $0.001/review row.

Legal & Compliance Disclaimer

This actor is an independent tool and is not affiliated with, endorsed by, or sponsored by Healthgrades Marketplace LLC. It reads only publicly available provider profile and review pages — no login bypass. It scrapes personal contact data (names, provider phones, addresses); users are responsible for complying with Healthgrades' Terms of Service and applicable data-protection laws (e.g. HIPAA applies to protected health information — Healthgrades public profiles are provider-self-provided, but handle carefully; GDPR/CCPA for any personal data). Provider contact data should not be used for unsolicited commercial outreach in violation of applicable laws (CAN-SPAM, TCPA).

SEO Keywords

healthgrades scraper, doctor database, physician data, healthcare provider data, healthgrades reviews, doctor ratings data, npi data enrichment, medical lead generation, healthcare sales leads, physician directory data, patient reviews data, doctor reputation monitoring, healthcare market research, provider insurance acceptance data, specialist data by city, telehealth provider data, healthcare crm enrichment, us provider database