1 day trial then $20.00/month - No credit card required now

Substack Scraper

qpayre/substack-scraper

1 day trial then $20.00/month - No credit card required now

The Substack Author Scraper is a powerful Apify actor that makes it easy for content creators to scrape and retrieve all posts from their favorite Substack authors. With structured data presented in a user-friendly format, analyzing and processing valuable information has never been easier.

Back to issues Create new issue

Is it possible to scrape articles behind the paywall?

Closed

MordaxTenebrae opened this issue

Is it possible to scrape articles behind the paywall? If yes, how can I do this?

qpayre-owner

Hello,

What do you mean behind the paywall ?

MordaxTenebrae

On Substack there are free articles and there are articles for which you need to have a paid subscription. I tried your scraper and it returned me only free articles but ignored the paid ones.

QPS (qpayre)

Hello,

No sorry we do not handle this case unfortunately

regards

Add comment

Developer

QPS

Actor metrics

11 monthly users
4 stars
71.9% runs succeeded
7.5 days response time
Created in Apr 2023
Modified 5 months ago

Categories

Automation

Business

Social media

Substack Publication Scraper

easyapi/substack-publication-scraper

Easily extract a wide range of data from Substack publications, including author IDs, copyrights, creation dates, subscriber counts, and more. Whether you're conducting market research, analyzing industry trends, or building a Substack database, this tool has you covered.

EasyApi

Hacker News Data Scraper

epctex/hackernews-scraper

Extract Y Combinator's Hacker News based on any search criteria. Crawl the front page, Show HN, Ask HN, news, job listings, and historical data. Get links, titles, comments, ratings, and more!

epctex

LinkedIn Job Postings Scraper

eunit/linkedin-job-postings-scraper

Designed for both personal and professional use, simply enter your job search keywords and location to extract tailored job titles, companies names, locations, job URL and more. This scraper handles infinite scrolling and exports data to any format such CSV, JSON, XML and more. Try it today 🚀

Emmanuel Uchenna

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

9.2k

146

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

20.9k

451

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

14.4k

119

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

12.1k

118

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

50.9k

299

Tiktok Profile Scraper

clockworks/tiktok-profile-scraper

Extract data from TikTok profiles and videos they post. Get TikTok profile data, URLs, numbers of shares, followers, comments, hearts, video and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

3.9k

202

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!