WhatToExpect Scraper

Scrape WhatToExpect.com for pregnancy, baby, and parenting articles. Extract titles, authors, medical reviewers, publish dates, categories, summaries, and full article content.

Features

• Search by topic — search for any pregnancy, baby, or parenting topic
• Article metadata — title, author, medical reviewer, publish/update dates, category
• Full content extraction — optionally visit article pages for complete text and images
• JSON-LD parsing — extracts structured data including medical reviewer credentials
• Pay per result — only pay for what you scrape

Input

Field	Type	Default	Description
searchQueries	string[]	["morning sickness"]	Topics to search for
maxListings	integer	50	Max articles per query (1-500)
scrapeDetails	boolean	false	Visit articles for full content, authors, reviewers
proxyConfiguration	object	—	Optional proxy settings

Output

Each result contains:

Field	Description
title	Article title
url	Article URL
author	Author name
publishedDate	Original publish date
updatedDate	Last update date
category	Article category (Pregnancy, Products, etc.)
summary	Article description/summary
content	Full article text (when scrapeDetails is true)
imageUrl	Article featured image
reviewedBy	Medical reviewer name and credentials
sourceUrl	Canonical URL
searchQuery	The search query that found this article
scrapedAt	ISO timestamp of when the data was scraped

Example Output

{
    "title": "Easing the Quease: How to Cope With Morning Sickness During Pregnancy",
    "url": "https://www.whattoexpect.com/pregnancy/morning-sickness/",
    "author": "Catherine Donaldson-Evans, Managing Editor",
    "publishedDate": "2015-08-28 10:27:29",
    "updatedDate": "2025-07-29 00:00:00",
    "category": "Pregnancy",
    "summary": "Morning sickness, or nausea of pregnancy, is a queasy feeling that pregnant women get during their first trimester.",
    "content": "Morning sickness is one of the most common symptoms of pregnancy...",
    "imageUrl": "https://images.agoramedia.com/wte3.0/gcms/morning-sickness.jpg",
    "reviewedBy": "Jennifer Wu, M.D., F.A.C.O.G.",
    "sourceUrl": "https://www.whattoexpect.com/pregnancy/morning-sickness/",
    "searchQuery": "morning sickness",
    "scrapedAt": "2026-04-26T12:00:00.000Z"
}

How It Works

1. Uses WhatToExpect's internal search API to find articles matching your queries
2. Without scrapeDetails, returns search result data (title, category, summary)
3. With scrapeDetails enabled, visits each article page and extracts full data from JSON-LD structured data and HTML

Use Cases

• Health content research — analyze pregnancy and parenting topics
• Medical information tracking — monitor article updates and reviewer credentials
• Content analysis — study article categories, publishing patterns, and topics
• SEO research — analyze content structure and metadata patterns

Cost

This actor uses pay-per-event pricing. You are charged $0.005 per result scraped.