🐝 Beehiiv Newsletter Scraper

🚀 Pull every public post from one or many Beehiiv newsletters. Multi-source fanout reaches 100+ posts. No login, no API key, no manual scrolling.

🕒 Last updated: 2026-05-01 · 📊 10 fields per post · 🐝 50K+ newsletters on Beehiiv · ⚡ multi-newsletter fanout · 🆓 sitemap-based discovery

The Beehiiv Newsletter Scraper discovers post URLs via each newsletter's public sitemap and returns title, description, image, publish date, author, word count, excerpt, slug, canonical URL, and scrape timestamp per post. Provide one or many newsletters and the scraper fans across all of them, parallelizing fetches to reach 100+ posts in under two minutes.

Beehiiv powers more than 50,000 newsletters from creators, media brands, and SaaS companies. The platform's growth has put it second only to Substack in the creator-economy newsletter space. This Actor exposes the full post history of any Beehiiv-hosted newsletter as clean structured data for content research, cadence analysis, and competitive benchmarking.

🎯 Target Audience	💡 Primary Use Cases
Newsletter operators, content strategists, marketers, founders, content writers	Newsletter research, content gap analysis, competitive benchmarking, audience discovery

---

📋 What the Beehiiv Newsletter Scraper does

Four filtering workflows in a single run:

• 🐝 Multi-newsletter fanout. Submit an array of newsletter URLs and the Actor walks each sitemap.
• 📑 Sitemap discovery. Each newsletter's /sitemap.xml lists all public posts; the Actor filters to real post URLs.
• 🔍 Keyword filter. Substring match on post URL to narrow by topic across all newsletters.
• ⚡ Parallel fetch. Up to 8 concurrent post fetches with retry logic to keep total run time low.

Each row reports the post URL, slug, title from og:title, description from og:description, image from og:image, publish date from article:published_time, author from article:author, word count, 600-character excerpt, canonical URL, and scrape timestamp.

💡 Why it matters: Beehiiv newsletters are a fast-growing slice of independent media. Top writers cross 100k subscribers and influence narratives in finance, tech, and AI. The platform exposes a clean public sitemap on every newsletter, which makes structured discovery practical without browser automation.

---

🎬 Full Demo

🚧 Coming soon: a 3-minute walkthrough showing how to go from sign-up to a downloaded dataset.

---

⚙️ Input

Input	Type	Default	Behavior
maxItems	integer	10	Posts to return. Free plan caps at 10, paid plan at 1,000,000.
newsletterUrls	array of strings	6 default Beehiiv newsletters	Newsletter homepages. The Actor reads each sitemap.
keywordFilter	string	empty	Substring filter on post URL slug. Case-insensitive.

Example: 100 posts from a single newsletter.

{
    "maxItems": 100,
    "newsletterUrls": ["https://www.therundown.ai"]
}

Example: 100 posts about AI across multiple newsletters.

{
    "maxItems": 100,
    "newsletterUrls": [
        "https://www.therundown.ai",
        "https://newsletter.theaibreak.com",
        "https://aiweekly.com"
    ],
    "keywordFilter": "ai"
}

⚠️ Good to Know: post body text on Beehiiv is paywall-aware; paid posts return only the free preview portion. Posts are URL-encoded by the publisher; the Actor extracts metadata from OG tags rather than relying on platform-specific JSON.

---

📊 Output

Each post record contains 10 fields. Download as CSV, Excel, JSON, or XML.

🧾 Schema

Field	Type	Example
🔗 url	string	"https://www.therundown.ai/ai-for-marketers"
🔖 slug	string	"ai-for-marketers"
📰 title	string	"AI for Marketers | The Rundown AI"
📝 description	string | null	"Get the latest AI news..."
🖼️ image	string | null	"https://media.beehiiv.com/cdn-cgi/..."
📅 publishedAt	ISO 8601 | null	"2026-04-15T13:00:00.000Z"
✍️ author	string | null	"Rowan Cheung"
📊 wordCount	integer	1842
💬 excerpt	string | null	First 600 chars of body text
🔗 canonical	string | null	"https://www.therundown.ai/ai-for-marketers"
🕒 scrapedAt	ISO 8601	"2026-05-01T01:38:21.144Z"

📦 Sample records

---

✨ Why choose this Actor

	Capability
🆓	No login. Reads public sitemaps and post HTML, no auth.
🐝	Multi-newsletter fanout. Submit many newsletters, get aggregated results in one run.
⚡	Parallel fetch. Up to 8 concurrent fetches with retry.
🔍	Keyword filter. Cross-newsletter substring match on slug.
📊	Word count and excerpt. Quick sense of post length and tone.
🚀	Sub-2-minute runs. Typical 100-post pull from 6 newsletters finishes in around 73 seconds.
🏷️	OG metadata. Title, description, image pulled from standard meta tags.

📊 In a single 73-second run the Actor returned 100 posts across 6 default Beehiiv newsletters.

---

📈 How it compares to alternatives

Approach	Cost	Coverage	Refresh	Filters	Setup
Manual subscribe + scroll	Free	Limited per session	One-shot	None	Account per newsletter
RSS readers	Free	Latest 20 only	Live	None	Per-feed setup
Generic web scrapers	$$ subscription	Brittle CSS	Daily	None	Engineer hours
⭐ Beehiiv Newsletter Scraper (this Actor)	Pay-per-event	Full sitemap	Live	Keyword, multi-source	None

Same sitemap and per-post HTML Beehiiv publishes for search engines, exposed as structured rows.

---

🚀 How to use

1. 🆓 Create a free Apify account. Sign up here and get $5 in free credit.
2. 🔍 Open the Actor. Search for "Beehiiv Newsletter" in the Apify Store.
3. ⚙️ Add newsletter URLs. One or many Beehiiv newsletter homepages.
4. ▶️ Click Start. A 100-post run typically completes in 60 to 90 seconds.
5. 📥 Download. Export as CSV, Excel, JSON, or XML.

⏱️ Total time from sign-up to first dataset: under five minutes.

---

💼 Business use cases

📰 Newsletter operators Reverse-engineer top newsletter cadence and word count Compare image and headline strategies Track competitor launch announcements Build editorial calendars from real archives	📊 Content strategy Mine high-engagement post angles for inspiration Map topic mix per newsletter over time Identify gap topics audiences ask for Benchmark your own newsletter against operators in the same niche
📰 Journalism Track newsletter consolidation and migrations Cite specific posts with stable canonical URLs Pull background research from creator archives Cross-reference posts with public reactions	🤖 AI training Build domain corpora from creator content Train style models on author-specific archives Generate retrieval datasets for newsletter chat agents Power summarization tools across publications

---

🌟 Beyond business use cases

Data like this powers more than commercial workflows. The same structured records support research, education, civic projects, and personal initiatives.

🎓 Research and academia Empirical datasets for papers, thesis work, and coursework Longitudinal studies tracking changes across snapshots Reproducible research with cited, versioned data pulls Classroom exercises on data analysis and ethical scraping	🎨 Personal and creative Side projects, portfolio demos, and indie app launches Data visualizations, dashboards, and infographics Content research for bloggers, YouTubers, and podcasters Hobbyist collections and personal trackers
🤝 Non-profit and civic Transparency reporting and accountability projects Advocacy campaigns backed by public-interest data Community-run databases for local issues Investigative journalism on public records	🧪 Experimentation Prototype AI and machine-learning pipelines with real data Validate product-market hypotheses before engineering spend Train small domain-specific models on niche corpora Test dashboard concepts with live input

---

🔌 Automating Beehiiv Newsletter Scraper

Run this Actor on a schedule, from your codebase, or inside another tool:

• Node.js SDK: see Apify JavaScript client for programmatic runs.
• Python SDK: see Apify Python client for the same flow in Python.
• HTTP API: see Apify API docs for raw REST integration.

Schedule daily, weekly, or monthly runs from the Apify Console. Pipe results into Google Sheets, S3, BigQuery, or your own webhook with the built-in integrations.

---

🤖 Ask an AI assistant about this scraper

Open a ready-to-send prompt about this ParseForge actor in the AI of your choice:

• 💬 ChatGPT
• 🧠 Claude
• 🔍 Perplexity
• 🅒 Copilot

---

❓ Frequently Asked Questions

🐝 What newsletters does this support?

Any Beehiiv-hosted newsletter, whether it sits on slug.beehiiv.com or a custom domain. The Actor reads the public /sitemap.xml exposed for search engines.

🔍 How do I find the right newsletter URL?

Use the homepage URL of the newsletter as it appears in the browser. Custom domains and beehiiv.com subdomains both work.

📦 How many newsletters can I submit at once?

The newsletterUrls array has no hard cap. The Actor walks each sitemap in order until maxItems is reached.

📅 Why do some posts have no publishedAt?

Beehiiv only emits article:published_time on actual newsletter posts. Topic pages and course chapters often omit it. The Actor returns null rather than guessing.

📝 Does it return full body content?

The excerpt field gives the first 600 characters of body text. Full body extraction would require a different parsing strategy and is not the primary goal of this Actor.

🔠 What is the difference between url, slug, and canonical?

url is the URL the Actor visited. slug is the path portion of that URL. canonical is the URL Beehiiv declares as canonical via <link rel="canonical">. They usually match.

🛡️ Does this work with paid Beehiiv tiers?

The Actor reads only the public preview HTML. Paid posts return their free preview text in the excerpt. Subscriber-only full content is not exposed by the Actor.

💼 Can I use this for commercial work?

Yes. The Actor reads the public sitemap and the public OG tags Beehiiv emits. Always honor each newsletter's terms when republishing content.

💳 Do I need a paid Apify plan?

The free plan returns up to 10 posts per run. Paid plans return up to 1,000,000.

⚠️ What if a newsletter sitemap returns nothing?

A small number of Beehiiv newsletters disable their sitemap or move to a non-standard path. Confirm /sitemap.xml opens in a browser. Open a contact form with the newsletter URL if a real one returns empty.

🔁 How fresh is the data?

Live. Each run hits each newsletter's sitemap and post HTML at run time.

⚖️ Is this legal?

Yes. The Actor reads sitemaps explicitly published for search engine indexing and OG meta tags emitted by every public post.

---

🔌 Integrate with any app

• Make - drop run results into 1,800+ apps.
• Zapier - trigger automations off completed runs.
• Slack - post run summaries to a channel.
• Google Sheets - sync each run into a spreadsheet.
• Webhooks - notify your own services on run finish.
• Airbyte - load runs into Snowflake, BigQuery, or Postgres.

---

🔗 Recommended Actors

• 📰 Substack Publication Scraper - the same workflow for Substack-hosted newsletters.
• 💼 Indie Hackers Posts Scraper - mine founder commentary that often parallels newsletter content.
• 📚 Wikipedia Pageviews Scraper - cross-reference newsletter trends with public-interest spikes.
• 🅱️ Bing Search Scraper - track which posts rank for which keywords.
• 🐙 GitHub Trending Repos Scraper - capture the developer-attention layer next to newsletter coverage.

💡 Pro Tip: browse the complete ParseForge collection for more pre-built scrapers and data tools.

---

🆘 Need Help? Open our contact form and we'll route the question to the right person.

---

Beehiiv is a registered trademark of Beehiiv, Inc. This Actor is not affiliated with or endorsed by Beehiiv. It reads only the public sitemap and OG meta tags every Beehiiv newsletter exposes for search engines.