Reddit Scraper
Pricing
$45.00/month + usage
Reddit Scraper
Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.
3.9 (2)
Pricing
$45.00/month + usage
118
Total users
7.1K
Monthly users
453
Runs succeeded
>99%
Issues response
2.4 days
Last modified
8 days ago
No items scraped
Closed
I first tried the free-reddit-scraper and then this. Both of them return 0 items!
I am trying to find posts and comments with particular search terms.
Here is my config:
{ "debugMode": false, "maxComments": 0, "maxCommunitiesAndUsers": 2, "maxItems": 0, "maxLeaderBoardItems": 2, "maxPostCount": 0, "proxy": { "useApifyProxy": true }, "scrollTimeout": 40, "searchComments": true, "searchCommunities": false, "searchPosts": true, "searchUsers": false, "searches": [ "keyword1", "keyword2", "keyword3", "keyword4", "keyword5", ] }
(I want to search for any of the search keywords, not all.
Here is my log
2023-06-19T22:23:06.521Z ACTOR: Pulling Docker image from repository. 2023-06-19T22:23:06.676Z ACTOR: Creating Docker container. 2023-06-19T22:23:06.780Z ACTOR: Starting Docker container. 2023-06-19T22:23:08.850Z INFO System info {"apifyVersion":"3.0.2","apifyClientVersion":"2.7.1","osType":"Linux","nodeVersion":"v16.20.0"} 2023-06-19T22:23:09.616Z ACTOR: Actor run will metamorph 2023-06-19T22:23:09.619Z ACTOR: Sending Docker container SIGTERM signal. 2023-06-19T22:23:09.644Z ACTOR: Pulling Docker image from repository. 2023-06-19T22:23:09.747Z ACTOR: Creating Docker container. 2023-06-19T22:23:10.026Z ACTOR: Starting Docker container. 2023-06-19T22:23:11.254Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1280x720x16 -nolisten tcp 2023-06-19T22:23:11.256Z Executing main command 2023-06-19T22:23:12... [trimmed]
You need to provide a value greater than zero for maxItems. maxPostCount and maxComments.
bravura
I tried this (making the values non-zero), and enabled the trial, but get this log:
2023-06-20T07:44:16.248Z ACTOR: Pulling Docker image from repository. 2023-06-20T07:44:16.378Z ACTOR: Creating Docker container. 2023-06-20T07:44:16.456Z ACTOR: Starting Docker container. 2023-06-20T07:44:18.367Z INFO System info {"apifyVersion":"3.0.2","apifyClientVersion":"2.7.1","osType":"Linux","nodeVersion":"v16.20.0"} 2023-06-20T07:44:18.513Z ERROR Metamorphing to an Actor that is paid per dataset item is not yet possible. 2023-06-20T07:44:18.516Z ApifyApiError: Metamorphing to an Actor that is paid per dataset item is not yet possible.(details: type=cannot-metamorph-to-paid-actor) 2023-06-20T07:44:18.518Z clientMethod: RunClient.metamorph 2023-06-20T07:44:18.520Z statusCode: 403 2023-06-20T07:44:18.521Z type: cannot-metamorph-to-paid-actor 2023-06-20T07:44:18.523Z attempt: 1 2023-06-20T07:44:18.525Z httpMethod: post 2023-06-20T07:44:18.527Z path: /v2/actor-runs/FDnf679nLWzszzDzm/metamorph 2023-06-20T07:44:18.529Z stack: 2023-06-20T07:44:18.531Z at makeRequest (/usr/src/app/node_modules/apify-client/dist/http_client.js:184:30) 2023-06-20T07:44:18.533Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2023-06-20T07:44:18.535Z at async RunClient.metamorph (/usr/src/app/node_modules/apify-client/dist/resource_clients/run.js:76:26) 2023-06-20T07:44:18.537Z at async Actor.metamorph (/usr/src/app/node_modu... [trimmed]
This error started today and should be fixed now.
