WebMD Doctor Scraper 👨‍⚕️

Extract comprehensive doctor information from WebMD search results. This actor helps you gather detailed data about healthcare providers, their practices, and patient reviews.

🔍 Features

• Scrapes detailed doctor profiles including:
  • Basic information (name, gender, NPI number)
  • Professional details (specialties, degrees, education)
  • Practice locations and contact information
  • Patient ratings and reviews
  • Insurance acceptance details
  • Profile photos and videos
  • Appointment booking links

💡 Use Cases

• Healthcare provider research and analysis
• Medical practice competitive analysis
• Patient satisfaction research
• Healthcare network development
• Insurance network analysis

📊 Output

The actor outputs JSON data containing detailed information for each doctor, including:

• Personal and professional information
• Practice locations and contact details
• Patient ratings and reviews
• Insurance acceptance
• Educational background
• Profile URLs and booking links

🔧 Input Parameters

The actor accepts the following input parameters:

• searchUrls (Required): Array of WebMD search result URLs to scrape
• maxItems (Optional): Maximum number of doctor profiles to scrape
• proxyConfiguration (Optional): Proxy settings for making requests

💪 Limitations

• Only works with WebMD doctor search result pages
• Rate limiting may affect scraping speed
• Some doctor profiles may have incomplete information

Input Example

A full explanation of an input example in JSON.

1{
2    "searchUrls": [
3        "https://doctor.webmd.com/results?q=heart&d=40&newpatient=false&isvirtualvisit=false&entity=all&gender=all&exp=min_max&hospPromo=false&pt=33.9745,-118.2475&zc=90001&city=Los+Angeles&state=CA"
4    ],
5    "maxItems": 30
6}

Output sample

The results will be wrapped into a dataset which you can always find in the Storage tab. Here's an excerpt from the data you'd get if you apply the input parameters above:

And here is the same data but in JSON. You can choose in which format to download your data: JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML.

1[
2    {
3        "searchUrl": "https://doctor.webmd.com/results?q=heart&d=40&newpatient=false&isvirtualvisit=false&entity=all&gender=all&exp=min_max&hospPromo=false&pt=33.9745,-118.2475&zc=90001&city=Los+Angeles&state=CA",
4        "providerid": "E4F63621-2D8F-4AA8-8D9E-3D7AB35FC879",
5        "name": {
6            "first": "Stephanie",
7            "middle": "",
8            "last": "Najarro",
9            "full": "Stephanie Najarro",
10            "suffix": ""
11        },
12        "gender": "F",
13        "npi": "1376973354",
14        "specialties": [
15            "Family Medicine",
16            "Internal Medicine",
17            "Primary Care",
18            "Preventative Medicine"
19        ],
20        "degrees": [
21            "FNP-C"
22        ],
23        "education": {
24            "graduationYear": 2019
25        },
26        "photos": {
27            "profile": "https://img.lb.wbmdstatic.com/lhd/provider_prod/2882672_providerprofileimage_e57623f6-6795-4930-bbca-d01f2554100a.png"
28        },
29        "bio": "<p><b>What makes you passionate about being a healthcare provider?</b><br> I enjoy educating my patients about their health, preventive care, while being able to tailor care to each individual.</p><p><b>In your opinion, what should be the role of a primary care provider for a patient, taking into account both physical health and behavioral health needs?</b><br> Primary care providers are an essential part of the patient's healthcare team. Our goal is to support patient's in their health needs using a comprehensive and holistic approach to ensure their physical and behavioral health needs are supported. </p><p><b>Tell us a little bit about yourself. What do you like to do in your spare time?</b><br> I enjoy spending time with my loved ones and our 3 dogs, exploring new places, trying new food, and reading in front of the fire place or outdoors.</p><p>Patients love Circle Medical because we are a full-service primary care clinic, with over 350 board-certified providers offering easy-to-access care in 26 states. Circle Medical accepts most PPO insurance and Medicare, has no membership fees, and makes it easy to schedule same or next-day appointments that you can attend from anywhere. Our highly trained and friendly staff is accessible via our 4.8/5-star rated app, as well as three clinic locations, with more coming soon.</p><p>Circle medical offers a wide variety of appointment types including Annual Wellness Exams, Sleep Apnea treatment, Gender-Affirming care, Mental Healthcare, ADHD diagnosis and treatment, and much more. Circle Medical provides a safe space for all people to access exceptional quality, evidence-based healthcare. Book your appointment today.</p>",
30        "ratings": {
31            "reviewCount": 11,
32            "averageRating": 5,
33            "categoryRatings": {
34                "c1": 5,
35                "c2": 5,
36                "c3": 5,
37                "c4": 5
38            }
39        },
40        "location": {
41            "name": "Circle Medical",
42            "address": "415 N Crescent Dr Ste 320",
43            "city": "Beverly Hills",
44            "state": "CA",
45            "zipcode": "90210",
46            "acceptsNewPatients": true,
47            "acceptsMedicare": true,
48            "acceptsMedicaid": false,
49            "insurances": [
50                "Aetna_48240_",
51                "Blue Cross Blue Shield of Oklahoma_48335_",
52                "Blue Cross Blue Shield_48310_",
53                "Blue Shield of California_48359_",
54                "CareFirst BlueCross BlueShield_48343_",
55                "Meritain Health_48753_",
56                "Moda Health_48768_",
57                "Moda Health_48768_",
58                "PacificSource Health Plans_48815_",
59                "PacificSource Health Plans_48815_",
60                "PacificSource Health Plans_48815_",
61                "UnitedHealthcare_48957_"
62            ],
63            "coordinates": "34.0966,-118.412",
64            "distance": "12.66"
65        },
66        "urls": {
67            "profile": "https://doctor.webmd.com/doctor/stephanie-najarro-e4f63621-2d8f-4aa8-8d9e-3d7ab35fc879-overview",
68            "appointment": "https://booking-v2.circlemedical.com/provider/?slug=stephanie-najarro-fnp-c?utm_source=webmd&utm_medium=web&utm_campaign=webmd&utm_id=referral",
69            "website": "https://booking-v2.circlemedical.com/provider/?slug=stephanie-najarro-fnp-c?utm_source=webmd&utm_medium=web&utm_campaign=webmd&utm_id=referral"
70        },
71        "reviews": [
72            {
73                "rating": "5",
74                "text": "Very compassionate and kind, Dr. Najarro has a very warm bedside manner. She is very professional and goes above and beyond to ensure quality care in everything she does. I felt very comfortable with her and wouldn’t hesitate to recommend her.",
75                "date": "1/29/2025 12:38:35 PM",
76                "isHighlighted": true
77            },
78            {
79                "rating": "5",
80                "text": "Very professional and insightful.",
81                "date": "1/25/2024 1:30:13 PM",
82                "isHighlighted": false
83            },
84            {
85                "rating": "5",
86                "text": "Very professional, kind & understanding. thank you.",
87                "date": "1/24/2024 12:25:47 PM",
88                "isHighlighted": false
89            },
90            {
91                "rating": "5",
92                "text": "Very thorough! Was very helpful",
93                "date": "1/24/2024 12:24:08 PM",
94                "isHighlighted": false
95            },
96            {
97                "rating": "5",
98                "text": "Very professional, listens great",
99                "date": "1/23/2024 11:03:21 AM",
100                "isHighlighted": false
101            },
102            {
103                "rating": "5",
104                "text": "Very thorough. Good listener. Excellent personality.",
105                "date": "1/23/2024 11:02:49 AM",
106                "isHighlighted": false
107            },
108            {
109                "rating": "5",
110                "text": "Warm, personable, and efficient! she makes care feel like a group project, and makes you feel like she’s on your side!",
111                "date": "1/22/2024 2:27:54 PM",
112                "isHighlighted": false
113            },
114            {
115                "rating": "5",
116                "text": "what an amazing provider. I’m incredibly impressed with Circle Medical now Just because of her. so much care and attention to detail",
117                "date": "1/22/2024 2:27:23 PM",
118                "isHighlighted": false
119            },
120            {
121                "rating": "5",
122                "text": "wonderful to work with. great listener and took time to hear all the issues before making a recommendation",
123                "date": "1/19/2024 4:37:13 PM",
124                "isHighlighted": false
125            },
126            {
127                "rating": "5",
128                "text": "wonderful. professional. thank you.",
129                "date": "1/19/2024 4:36:45 PM",
130                "isHighlighted": false
131            },
132            {
133                "rating": "5",
134                "text": "you are amazing",
135                "date": "1/19/2024 4:36:16 PM",
136                "isHighlighted": false
137            }
138        ]
139    },
140    ...
141]

Related Actors

• 👨‍⚕️ Practo Doctor Scraper - Extract comprehensive doctor profiles from Practo.com with qualifications and practice details.
• 🏥 Netmeds Product Scraper - Scrape detailed medical product information from Netmeds.com with prices and inventory status.
• 🔍 Google Search Scraper - Extract up to 5000 search results with flexible search options and language support.
• 📊 Email & Contact Extractor From Any Web - Extract emails, phone numbers and social media profiles from any website.
• 🎯 Discover & Verify Professional Emails - Find and verify professional email addresses with smart pattern generation.
• 🔍 Article Content Extractor - Extract clean article content and metadata from any web page.
• 📚 PubMed Search Scraper - Extract research papers and academic articles from PubMed with comprehensive metadata.
• 🔍 Google Maps Scraper - Collect up to 5000 place results with detailed business information.
• 🏥 Practo Doctor Scraper - Extract detailed healthcare provider information from Practo.com.
• 📱 All-in-One Social Media Phone Number Scraper - Extract contact information across 30+ social platforms.
• 📧 All-in-One Social Media Email Scraper - Discover emails across 30+ social platforms.
• 🔍 URL Metadata Crawler - Extract comprehensive metadata from web pages.
• 🌍 Countries Data Scraper - Extract comprehensive country information and geographical data.
• 🔍 Keyword Discovery Tool - Discover new keyword ideas and uncover valuable search insights.
• 📊 Text Sentiment Analysis - Analyze sentiment of text content with detailed breakdown reports.