Reddit Scraper
Pricing
$45.00/month + usage
Reddit Scraper
Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.
3.9 (2)
Pricing
$45.00/month + usage
101
Total users
6.4k
Monthly users
361
Runs succeeded
>99%
Response time
2.2 days
Last modified
6 days ago
I cannot scrape from https://www.reddit.com/r/thenetherlands
Closed
Apparantly, not all urls are supported.
Mgt5015
2023-11-15T22:23:24.844Z ACTOR: Pulling Docker image of build a6khIitUdsWTBK0kL from repository. 2023-11-15T22:23:30.784Z ACTOR: Creating Docker container. 2023-11-15T22:23:31.246Z ACTOR: Starting Docker container. 2023-11-15T22:23:31.655Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1280x720x16 -nolisten tcp 2023-11-15T22:23:31.657Z Executing main command 2023-11-15T22:23:32.906Z INFO System info {"apifyVersion":"3.1.4","apifyClientVersion":"2.7.1","crawleeVersion":"3.3.1","osType":"Linux","nodeVersion":"v16.15.0"} 2023-11-15T22:23:32.978Z INFO Found startUrl. Search params will be ignored. 2023-11-15T22:23:32.980Z ERROR Url search type not supported! {"url":"https://www.reddit.com/r/thenetherlands/s/XEVbz4qXjQ"}
This URL is indeed not supported yet, but when I tried to load it got redirected to https://www.reddit.com/r/thenetherlands/comments/17v4qpu/ns_wat_doen_ze_eigenlijk_met_alle_poep_en_plas/?share_id=pGbwQLuD2jB8DbvvaEhOd&utm_content=1&utm_medium=ios_app&utm_name=ioscss&utm_source=share&utm_term=1 which is supported. How did you come across this URL? I can add it if I can understand how is being used.
