![Reddit Scraper avatar](https://images.apifyusercontent.com/hMSvFE3kBdF0jftxxDxZlWszr1gZ9ZUVkI5mnnpcYNQ/rs:fill:250:250/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMuYW1hem9uYXdzLmNvbS9GZ0p0akR3SkNMaFJIOXNhTS94aHJ5UFFuZTgza2hMckNXeS1yZWRkaXRfcGFpZC5wbmc.webp)
1 day trial then $45.00/month - No credit card required now
![Reddit Scraper](https://images.apifyusercontent.com/hMSvFE3kBdF0jftxxDxZlWszr1gZ9ZUVkI5mnnpcYNQ/rs:fill:250:250/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMuYW1hem9uYXdzLmNvbS9GZ0p0akR3SkNMaFJIOXNhTS94aHJ5UFFuZTgza2hMckNXeS1yZWRkaXRfcGFpZC5wbmc.webp)
Reddit Scraper
1 day trial then $45.00/month - No credit card required now
Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.
won't collect beyond a certain limit
Closed
I've tried two different runs now of trying to collect a significant portion of a subreddit's activity (2+ years), but the scraper stops after about 50,000 lines of data
runs: https://li2vbaesoevb.runs.apify.net and https://cargcpdn5cbn.runs.apify.net
one further detail or question - it'd be great to pick up where a previous run stopped. is there some way to use the previous pagination marker to start collecting where it left off?
![trudax avatar](https://apify-image-uploads-prod.s3.amazonaws.com/i4pLQa9FeyTq8RwTD/SLmmggbwZMqHzzE7a-Gustavo.jpg)
can you share the run ID?
lemon_normalcy
I think they're both in the original post aren't they? Those 2 links?
![trudax avatar](https://apify-image-uploads-prod.s3.amazonaws.com/i4pLQa9FeyTq8RwTD/SLmmggbwZMqHzzE7a-Gustavo.jpg)
I don't think so, there is no usefull information when I click on those links. Ff you go to the run you should be able to see a share button on the right upper side that will provide you with the correct link.
lemon_normalcy
Sorry about that. Here you go:
https://console.apify.com/view/runs/dP9XSbh7cxCArL5c8 (first run)
https://console.apify.com/view/runs/GkjTkfGQ9cNnN9JpF (second run)
lemon_normalcy
what do you think?
![trudax avatar](https://apify-image-uploads-prod.s3.amazonaws.com/i4pLQa9FeyTq8RwTD/SLmmggbwZMqHzzE7a-Gustavo.jpg)
I will try to replicate the run here but at first glance, I don't see anything wrong besides some blocked request, but that is expected.
lemon_normalcy
okay - what about picking up a new run where the old one left off though? currently there isn't an option to do that.
lemon_normalcy
what do you think?
![trudax avatar](https://apify-image-uploads-prod.s3.amazonaws.com/i4pLQa9FeyTq8RwTD/SLmmggbwZMqHzzE7a-Gustavo.jpg)
I have got the same results, seems like it is returning everything that it can.
lemon_normalcy
right - but my question is why we can't start the scraping at somewhere other than the beginning of the subreddit?
![trudax avatar](https://apify-image-uploads-prod.s3.amazonaws.com/i4pLQa9FeyTq8RwTD/SLmmggbwZMqHzzE7a-Gustavo.jpg)
You can, you just need to know the last URL used for paginating.
lemon_normalcy
Okay. How do I implement that within this actor then?
![trudax avatar](https://apify-image-uploads-prod.s3.amazonaws.com/i4pLQa9FeyTq8RwTD/SLmmggbwZMqHzzE7a-Gustavo.jpg)
I will add a change to log the last page so you can copy from the logs and use it.
lemon_normalcy
okay - where do I paste in the last URL used?
lemon_normalcy
hello?
![trudax avatar](https://apify-image-uploads-prod.s3.amazonaws.com/i4pLQa9FeyTq8RwTD/SLmmggbwZMqHzzE7a-Gustavo.jpg)
the last usedr url is on the logs
- 365 monthly users
- 37 stars
- 99.9% runs succeeded
- 1.2 days response time
- Created in Feb 2022
- Modified 9 days ago