RealSelf Provider & Treatment Scraper

What does this Actor do?

RealSelf Provider & Treatment Scraper extracts publicly available doctor, clinic, and practice listings from RealSelf.com provider-finder search pages and individual profile pages. For each provider it collects the name, specialty, treatments/services offered, location, publicly listed phone number, external website, and profile URL.

RealSelf is protected by PerimeterX bot detection, which blocks plain HTTP requests outright. This Actor uses a real browser with browser fingerprinting and a residential proxy to reliably load pages, then reads the same structured (JSON-LD) data RealSelf embeds for search engines.

Why scrape RealSelf provider data?

• Build a lead list of cosmetic/medical providers by treatment and city
• Research competitor providers, their specialties, and treatment menus
• Track which practices offer a specific treatment in a given market
• Collect publicly listed provider contact/website info for outreach
• Monitor provider profile changes (specialties, services, locations) over time

Features

• Reads RealSelf's own structured provider data (name, specialty, treatments, address, phone, website)
• Follows "Show more" pagination on search-results pages
• Real browser with fingerprinting + residential proxy to get past PerimeterX bot protection
• Automatic retry with backoff and fresh proxy sessions on blocked requests
• Deduplicates providers by profile URL
• Respects maxItems

Input

Field	Type	Required	Default	Description
startUrls	array	Yes	-	RealSelf search URLs (e.g. .../find/California/Los-Angeles/Botox) or direct doctor/practice profile URLs
maxItems	integer	No	20	Maximum provider records to scrape. Set 0 for unlimited
proxyConfiguration	object	Yes	RESIDENTIAL	A residential proxy is required - RealSelf blocks datacenter IPs

Output

{
    "productName": "Botox",
    "description": "Meet Behnoush Zarrini, MD, a trusted Board Certified Anesthesiologist...",
    "category": "Fillers and Other Injectables, Skin Rejuvenation and Resurfacing",
    "certifications": ["Doctor of Medicine, Tehran University of Medical Sciences, 1984-1992"],
    "supplierName": "Behnoush Zarrini, MD",
    "supplierUrl": "https://www.realself.com/dr/behnoush-zarrini-beverly-hills-ca",
    "supplierType": "Physician",
    "industry": "Fillers and Other Injectables, Skin Rejuvenation and Resurfacing",
    "phone": "+1 424-401-7825",
    "website": "https://www.bwaesthetics.com/medical-spa-beverly-hills/",
    "address": "9100 Wilshire Blvd Suite 363 W",
    "city": "Beverly Hills",
    "state": "California",
    "zipCode": "90212",
    "country": "US",
    "services": ["Botox", "Daxxify", "Dermal Fillers", "PRP Injections", "Cheek Fillers"],
    "profileUrl": "https://www.realself.com/dr/behnoush-zarrini-beverly-hills-ca",
    "source": "RealSelf",
    "scrapedAt": "2026-08-19T02:05:57.828Z"
}

Fields with no RealSelf equivalent (e.g. brand, employeeCount, manufacturer) are always returned as null rather than guessed.

Output fields

Field	Description
supplierName, supplierType	Provider/practice name and provider type
productName, category, services	Treatment searched for, medical specialty, and full treatment list
certifications	Credentials listed on the profile
phone, website	Publicly listed phone number and the provider's own external website
address, city, state, zipCode, country	Practice location
profileUrl	RealSelf provider profile URL
source, scrapedAt	Data provenance and fetch timestamp

Use cases

• Generate provider lead lists filtered by treatment and location
• Feed a CRM with cosmetic/medical provider contacts
• Competitive research on treatment menus and specialties by market
• Track provider website and contact info for partnership outreach
• Build regional directories of medical aesthetics providers

Pricing

Apify usage is billed according to this Actor's configured pricing plan on the Apify Store.

FAQ

Why does this Actor require a residential proxy? RealSelf uses PerimeterX bot protection, which blocks datacenter IPs and non-browser requests. A residential proxy plus a real, fingerprinted browser is required to load pages reliably.

Why might a run return fewer items than maxItems? PerimeterX blocking is probabilistic - even with a residential proxy, some requests are blocked and retried with a fresh session. The Actor retries generously, but a heavily-flagged proxy pool can occasionally still result in a partial run.

Does this include reviews or ratings? No. This Actor focuses on provider/practice and treatment information, not individual patient reviews.

Why isn't verifiedSupplier ever populated? RealSelf doesn't publish an "equipment supplier" style verification badge equivalent to this schema's meaning, so it's always left null rather than guessed.

Disclaimer

This Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by RealSelf. It only accesses publicly available page content. Users are responsible for complying with applicable terms of use, laws, and privacy requirements when using the collected data.

Preview