PsychologyToday Scraper (Apify Actor)

Scrape PsychologyToday listings by category and US state with optional details enrichment. Fast Cheerio parsing for list/profile pages, and Playwright only for opening the PT “website” interstitial and extracting therapist-site emails.

---

Features

• Categories: therapists, psychiatrists, groups, treatment-rehab
• Scope: one or many US states, or all states
• Modes: List-only or List + Details
• Captures on list page: name, title, address, phone, image, profile URL, short description
• Captures on details page:
  • long description
  • PT website URL (psychologytoday_website)
  • Therapist website URL (website)
  • emails from therapist website (cleaned, de-duplicated, params removed, dummy/sentry excluded)
  • insurance, qualifications
  • top specialties, expertise, client focus, treatment approach
  • locations (from .address-line, joined by commas)
• Clean, comma-separated list fields (no section headers)

Note: Playwright is used only on the /profile/{id}/website page to click the interstitial “Still here? This way” link and load the therapist’s actual website.

---

Example Input

{
  "category": "psychiatrists",
  "states": ["alabama", "new-jersey"],
  "scrapeMode": "LIST_AND_DETAILS",
  "maxItems": 500,
  "maxPagesPerState": 50,
  "minDelayMs": 1500,
  "maxDelayMs": 3000,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}

Example Output

[{
    "name": "John Doe",
    "title": "Psychiatric Nurse Practitioner, PMHNP-C, FNP-BC",
    "address": "Online Only",
    "shortDescription": "Our interaction a relaxed, safe session where we carefully assess your circumstances, diagnosis, and the treatment options. My goal for you is to know how to proceed. You are not alone; there are quick steps you can take (and includes processing feelings) to start feeling better.",
    "image": "https://photos.psychologytoday.com/xxxx/3/320x400.jpeg",
    "detailsUrl": "https://www.psychologytoday.com/us/psychiatrists/xxxx/000000",
    "phone": "(315) 000-0000",
    "longDescription": "Our interaction a relaxed, safe session where we carefully assess your circumstances, diagnosis, and the treatment options. My goal for you is to know how to proceed. You are not alone; there are quick steps you can take (and includes processing feelings) to start feeling better. I run a small practice, and each client receives the time and care they deserve. I tailor my services to each person. And ensure your privacy with no other staff or office clients. Our first session will be in-depth. I'd like the opportunity to work with you. Adler wrote, \"When 'I' is replaced by 'We,' illness becomes wellness\". I'm here and ready to help.",
    "psychologytoday_website": "https://www.psychologytoday.com/us/profile/000000/website",
    "website": "https://care.headway.co/providers/john-doe",
    "emails": "email1@xxx.co,email2@hotmail.com",
    "insurances": "Aetna,Anthem,Blue Cross,Blue Shield,BlueCross and BlueShield,Cigna and Evernorth,Empire Blue Cross Blue Shield,Quest Behavioral Health",
    "qualifications": "Verified by Psychology Today License: New York / 401606 Lynn M Hale Education and Years In Practice Upstate Medical University, Syracuse NY, Graduated 2013",
    "topSpecialties": "Coping Skills,Anxiety,Women's Issues",
    "expertise": "Coping Skills,Anxiety,Women's Issues,Addiction,Alcohol Use,Bipolar Disorder,Cancer,Chronic Illness,Chronic Pain,Depression,Drug Abuse,Dual Diagnosis,Family Conflict,Geriatric and Seniors,Grief,Life Transitions,Medication Management,Men's Issues,Peer Relationships,Relationship Issues,Self Esteem,Sleep or Insomnia,Stress,Substance Use,Veterans",
    "clientFocus": "Age Children (6 to 10),Preteen,Teen,Adults,Elders (65+) Participants Individuals Age Children (6 to 10),Preteen,Teen,Adults,Elders (65+) Participants Individuals",
    "treatmentApproach": "Cognitive Behavioral (CBT),Mindfulness-Based (MBCT),Motivational Interviewing,Person-Centered,Strength-Based",
    "locations": "La Fayette, NY 13084"
  }]