Substack Scraper avatar

Substack Scraper

Try for free

1 day trial then $20.00/month - No credit card required now

View all Actors
Substack Scraper

Substack Scraper

qpayre/substack-scraper
Try for free

1 day trial then $20.00/month - No credit card required now

The Substack Author Scraper is a powerful Apify actor that makes it easy for content creators to scrape and retrieve all posts from their favorite Substack authors. With structured data presented in a user-friendly format, analyzing and processing valuable information has never been easier.

LU

The subscription baed substack accounts are impossible to scrape

Closed

lusavkaedu opened this issue
8 months ago

this is one of the subsctiption based accounts I tried to scrape:

2024-04-03T09:07:38.678Z ACTOR: Pulling Docker image of build 79Jhj6dXdLhgwsEkQ from repository. 2024-04-03T09:07:41.656Z ACTOR: Creating Docker container. 2024-04-03T09:07:41.741Z ACTOR: Starting Docker container. 2024-04-03T09:07:44.037Z INFO Initializing actor... 2024-04-03T09:07:44.038Z INFO System info ({"apify_sdk_version": "1.0.0", "apify_client_version": "1.0.0", "python_version": "3.11.6", "os": "linux"}) 2024-04-03T09:07:44.126Z 2024-04-03 09:07:44 [INFO] substack_scraper.main - Scraping 10 most recent posts from asiancenturystocks, (scrape article content: True) - (main.py:20) 2024-04-03T09:07:44.128Z 2024-04-03 09:07:44 [INFO] substack_scraper.posts_scraper - Scraping posts from author asiancenturystocks using url https://asiancenturystocks.substack.com (profile: https://asiancenturystocks.substack.com) - (posts_scraper.py:32) 2024-04-03T09:07:44.235Z ERROR Actor failed with an exception 2024-04-03T09:07:44.236Z Traceback (most recent call last): 2024-04-03T09:07:44.237Z File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 971, in json 2024-04-03T09:07:44.238Z return complexjson.loads(self.text, **kwargs) 2024-04-03T09:07:44.239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2024-04-03T09:07:44.239Z File "/usr/local/lib/python3.11/json/init.py", line 346, in loads 2024-04-03T09:07:44.240Z return _default_decod... [trimmed]

qpayre avatar

QPS (qpayre)

8 months ago

Hello,

It's because the input require the author of the article. In your case the author name is "fritz"

Please give it a try and let us know if that resolve your issue

Regards, Yoann

qpayre avatar

QPS (qpayre)

8 months ago

Hello, the issue has been fixed

Developer
Maintained by Community

Actor Metrics

  • 10 monthly users

  • 6 stars

  • 73% runs succeeded

  • 2.7 days response time

  • Created in Apr 2023

  • Modified 8 months ago