Reddit Scraper avatar
Reddit Scraper

Pricing

$45.00/month + usage

Go to Store
Reddit Scraper

Reddit Scraper

Developed by

Gustavo Rudiger

Maintained by Community

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

3.9 (2)

Pricing

$45.00/month + usage

98

Monthly users

343

Runs succeeded

>99%

Response time

4 days

Last modified

a day ago

BR

No items scraped

Closed

bravura opened this issue
2 years ago

I first tried the free-reddit-scraper and then this. Both of them return 0 items!

I am trying to find posts and comments with particular search terms.

Here is my config:

{ "debugMode": false, "maxComments": 0, "maxCommunitiesAndUsers": 2, "maxItems": 0, "maxLeaderBoardItems": 2, "maxPostCount": 0, "proxy": { "useApifyProxy": true }, "scrollTimeout": 40, "searchComments": true, "searchCommunities": false, "searchPosts": true, "searchUsers": false, "searches": [ "keyword1", "keyword2", "keyword3", "keyword4", "keyword5", ] }

(I want to search for any of the search keywords, not all.

Here is my log

2023-06-19T22:23:06.521Z ACTOR: Pulling Docker image from repository. 2023-06-19T22:23:06.676Z ACTOR: Creating Docker container. 2023-06-19T22:23:06.780Z ACTOR: Starting Docker container. 2023-06-19T22:23:08.850Z INFO System info {"apifyVersion":"3.0.2","apifyClientVersion":"2.7.1","osType":"Linux","nodeVersion":"v16.20.0"} 2023-06-19T22:23:09.616Z ACTOR: Actor run will metamorph 2023-06-19T22:23:09.619Z ACTOR: Sending Docker container SIGTERM signal. 2023-06-19T22:23:09.644Z ACTOR: Pulling Docker image from repository. 2023-06-19T22:23:09.747Z ACTOR: Creating Docker container. 2023-06-19T22:23:10.026Z ACTOR: Starting Docker container. 2023-06-19T22:23:11.254Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1280x720x16 -nolisten tcp 2023-06-19T22:23:11.256Z Executing main command 2023-06-19T22:23:12... [trimmed]

trudax avatar

You need to provide a value greater than zero for maxItems. maxPostCount and maxComments.

BR

bravura

2 years ago

I tried this (making the values non-zero), and enabled the trial, but get this log:

2023-06-20T07:44:16.248Z ACTOR: Pulling Docker image from repository. 2023-06-20T07:44:16.378Z ACTOR: Creating Docker container. 2023-06-20T07:44:16.456Z ACTOR: Starting Docker container. 2023-06-20T07:44:18.367Z INFO System info {"apifyVersion":"3.0.2","apifyClientVersion":"2.7.1","osType":"Linux","nodeVersion":"v16.20.0"} 2023-06-20T07:44:18.513Z ERROR Metamorphing to an Actor that is paid per dataset item is not yet possible. 2023-06-20T07:44:18.516Z ApifyApiError: Metamorphing to an Actor that is paid per dataset item is not yet possible.(details: type=cannot-metamorph-to-paid-actor) 2023-06-20T07:44:18.518Z clientMethod: RunClient.metamorph 2023-06-20T07:44:18.520Z statusCode: 403 2023-06-20T07:44:18.521Z type: cannot-metamorph-to-paid-actor 2023-06-20T07:44:18.523Z attempt: 1 2023-06-20T07:44:18.525Z httpMethod: post 2023-06-20T07:44:18.527Z path: /v2/actor-runs/FDnf679nLWzszzDzm/metamorph 2023-06-20T07:44:18.529Z stack: 2023-06-20T07:44:18.531Z at makeRequest (/usr/src/app/node_modules/apify-client/dist/http_client.js:184:30) 2023-06-20T07:44:18.533Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2023-06-20T07:44:18.535Z at async RunClient.metamorph (/usr/src/app/node_modules/apify-client/dist/resource_clients/run.js:76:26) 2023-06-20T07:44:18.537Z at async Actor.metamorph (/usr/src/app/node_modu... [trimmed]

trudax avatar

This error started today and should be fixed now.

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

1 day

Price

$45.00