Twitter Tweets and Profiles Scraper avatar

Twitter Tweets and Profiles Scraper

Try for free

6 hours trial then $30.00/month - No credit card required now

Go to Store
Twitter Tweets and Profiles Scraper

Twitter Tweets and Profiles Scraper

web.harvester/twitter-scraper
Try for free

6 hours trial then $30.00/month - No credit card required now

Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.

WC

Not getting replies

Closed

wes_cape_supersonic opened this issue
6 months ago

I just rented this actor, still in my trial phase, I decided to give it a little test run, and got the tweets etc. but after setting the replies depth to 1, I'm still not getting the reply text, only the reply count.

web.harvester avatar

Hey,

Could you please provide an example run or run input, thanks.

WC

wes_cape_supersonic

6 months ago

here's the run id: p6QAFtc5wHGPEFGJS

run input: { "handles": [ "Samuel_real1" ], "includeUserInfo": true, "profilesDesired": 10, "proxyConfig": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] }, "repliesDepth": 1, "tweetsDesired": 5, "withReplies": true, "startUrls": [] }

web.harvester avatar

Replies are tweets that are added to the queue after scraping each "main" tweet. You have set the "Maximum number of tweets" (tweetsDesired) to 5, so only 5 tweets were scraped, and they didn't include the replies in the queue.

WC

wes_cape_supersonic

6 months ago

so "maximum number of tweets" points to a combination of "main tweets" and replies? and how do I make sure replies are added to the queue, in the case of pulling 5 tweets and their comments

web.harvester avatar

Right now the only way is to provide the Actor with the tweet URL(s), for example:

{ "repliesDepth": 1, "startUrls": [ { "url": "https://x.com/ElonMuskAOC/status/1802808437660885275" } ] }

WC

wes_cape_supersonic

6 months ago

okay, I'll do some tests and give a feedback

Developer
Maintained by Community

Actor Metrics

  • 249 monthly users

  • 27 stars

  • >99% runs succeeded

  • 8.5 days response time

  • Created in Jul 2023

  • Modified 18 days ago