# Healthprofs Scraper (`lexis-solutions/healthprofs-scraper`) Actor Scrape HealthProfs.com listing pages to extract structured health professional profile data, including names, specialties, locations, credentials, education, availability, and profile attributes. Ideal for lead generation, directory monitoring, and market research. - **URL**: https://apify.com/lexis-solutions/healthprofs-scraper.md - **Developed by:** [Lexis Solutions](https://apify.com/lexis-solutions) (community) - **Categories:** Lead generation, AI, Agents - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $1.90 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Healthprofs Scraper ![banner](https://i.imgur.com/rjijrq1.png) Healthprofs (healthprofs.com) is a US directory of health professionals. This actor collects structured professional profile data from Healthprofs listing pages. ### Introduction The Healthprofs scraper starts from listing URLs, goes through result pages, and extracts structured profile data such as name, profile type, locations, education, credentials, profile attributes, appointment availability, and more. ### Use Cases - **Lead generation**: Build structured lists of health professionals in selected specialties and locations. - **Market research**: Analyze practitioner coverage, profile distribution, and specialization patterns by city or region. - **Directory monitoring**: Track changes in profile information, credentials, and profile availability over time. - **Analytics pipelines**: Feed BI tools, CRMs, and enrichment workflows with normalized profile records. ### Input Provide the following fields: - `startUrls` (array, required): Healthprofs listing URLs. - `maxItems` (integer, optional): Maximum number of profile items to extract per start URL. - `proxyConfiguration` (object, optional): Apify proxy settings. Notes: - The actor is designed for Healthprofs listing/search result pages, for example category and location pages. - Pagination is handled automatically across listing pages. - Crawling stops per source URL when `maxItems` is reached. ### Input Examples **1) Start URLs** ```json { "startUrls": [ { "url": "https://www.healthprofs.com/us/acupuncturists/ny/new-york" }, { "url": "https://www.healthprofs.com/us/acupuncturists/ny/new-york?page=2" } ], "maxItems": 10, "proxyConfiguration": { "useApifyProxy": true } } ```` ### Output Each dataset item contains fields like: ```json { "id": 558880, "uuid": "95085bc2-815d-11e8-a6ad-06142c356176", "url": "https://www.healthprofs.com/us/acupuncturists/rong-lu-new-york-ny/558880", "fullName": "Rong Lu", "firstName": "Rong", "lastName": "Lu", "profileType": "ACUPUNCTURIST", "suffixes": ["HealthRoles.ACUPUNCTURIST", "LAc"], "verificationStatus": "VERIFIED", "phone": "(646) 430-8691", "acceptsAppointments": "YES", "appointmentTypes": { "inPerson": true, "online": false }, "primaryLocation": { "name": "ACA Acupuncture & Wellness Fertility Center", "address1": "141 E 55th St", "address2": "9A", "city": "New York", "region": "New York", "regionCode": "NY", "postalCode": "10022", "countryCode": "US", "phone": "(646) 430-8691", "latitude": 40.7595575, "longitude": -73.96939379999999 }, "education": { "institution": "Nanjing University of Chinese Medicine", "degree": "Master", "yearCompleted": 2006, "yearPracticeStarted": 2006, "yearsInPractice": 20 }, "credentials": [ { "type": "license", "organization": "New York", "identifier": "5347", "expiration": "2029-02-01", "verificationStatus": "VERIFIED_WITH_CHECKMARK" } ], "statement": "If you're trying to conceive and feel your body needs deeper support...", "attributes": { "issues": ["Infertility", "Facial Acupuncture", "Pain Management"], "language": ["Mandarin"], "insurance": ["Aetna", "Cigna"], "payment_method": ["Cash", "Visa"], "treatment_techniques": ["Cupping", "Herbal Medicine"] }, "photoUrl": "https://photos.healthprofs.com/594a8bd5-46cd-11ea-a6ad-06142c356176/2/320x400.jpeg", "lastUpdated": "2026-03-02T15:19:22-08:00" } ``` The scraper paginates through listing results and stops when `maxItems` is reached per start URL or when no more profile items are found. ### Why use the Healthprofs Scraper? - **Focused**: Built specifically for Healthprofs listing and profile flows. - **Structured output**: Returns normalized profile records ready for automation and analysis. - **Per-URL limits**: `maxItems` is enforced per start URL. - **Pagination support**: Automatically continues through listing pages while limits allow. - **Flexible attributes**: Captures profile attributes in a structured way for easier downstream use. ### FAQ - **How many profiles can it extract?**\ Controlled by `maxItems` per source URL. - **Do I need proxies?**\ Not always, but proxies are recommended for larger runs and stability. - **What if Healthprofs changes their page structure?**\ The actor may require updates to keep extraction stable. ### Need to scrape other directory platforms? Check out our other scrapers: - [Search.ch Scraper](https://apify.com/lexis-solutions/search-ch-scraper). - [192.com Businesses Scraper](https://apify.com/lexis-solutions/192-com-businesses-scraper). - [Dasoertliche.de Scraper](https://apify.com/lexis-solutions/dasoertliche-de-scraper). *** **Need help or want a custom solution?** Lexis Solutions is a certified Apify Partner. We can help with custom data extraction projects. Contact us over [Email](mailto:scraping@lexis.solutions) or [LinkedIn](https://www.linkedin.com/company/lexis-solutions). ### Support Our Work If you're happy with our work and scrapers, you're welcome to leave us a company review [here](https://apify.com/partners/find/lexis-solutions/review) and leave a review for the scrapers you're subscribed to. ### Image Credit Image credit: [healthprofs.com](https://www.healthprofs.com/). # Actor input Schema ## `startUrls` (type: `array`): Healthprofs listing URLs to start with. ## `maxItems` (type: `integer`): Maximum number of profile items to scrape per original URL. ## `proxyConfiguration` (type: `object`): Your proxy configuration from Apify. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.healthprofs.com/us/acupuncturists/ny/new-york" } ], "maxItems": 10, "proxyConfiguration": { "useApifyProxy": false } } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.healthprofs.com/us/acupuncturists/ny/new-york" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("lexis-solutions/healthprofs-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.healthprofs.com/us/acupuncturists/ny/new-york" }] } # Run the Actor and wait for it to finish run = client.actor("lexis-solutions/healthprofs-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.healthprofs.com/us/acupuncturists/ny/new-york" } ] }' | apify call lexis-solutions/healthprofs-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=lexis-solutions/healthprofs-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Healthprofs Scraper", "description": "Scrape HealthProfs.com listing pages to extract structured health professional profile data, including names, specialties, locations, credentials, education, availability, and profile attributes. Ideal for lead generation, directory monitoring, and market research.", "version": "1.0", "x-build-id": "q9b1HWEypTxDeEwfv" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/lexis-solutions~healthprofs-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-lexis-solutions-healthprofs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/lexis-solutions~healthprofs-scraper/runs": { "post": { "operationId": "runs-sync-lexis-solutions-healthprofs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/lexis-solutions~healthprofs-scraper/run-sync": { "post": { "operationId": "run-sync-lexis-solutions-healthprofs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "Healthprofs listing URLs to start with.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "maxItems": { "title": "Maximum number of items", "type": "integer", "description": "Maximum number of profile items to scrape per original URL.", "default": 10 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Your proxy configuration from Apify.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```