Can I fetch 50k tweeks along retweets/quoted (probably all tweets) from a specific profile?

Hello,

Please refer to the documentation, we have a very detailed explanation on how you can fetch the tweets of a profile https://apify.com/apidojo/tweet-scraper#fetching-the-tweets-of-a-profile

You need to use twitter queries in order to do that and we have several examples (and some links) that can support your learning.

Cheers

Just don't close it please, I will close it myself when it solved my issue.

I know you have a detailed Readme, but I also attached my use case very specifically so just answer me is that possible or not?

if possible then please straightforward answer me to these:

• How can I attach my inputs exactly? let's assume the profile is (https://x.com/NASA).
• What is the estimated amount for 50k tweets along (retweets/quoted)?
• Estimated time?

Hello,

We have a very detailed example and explanation in the actor's readme about fetching the tweets of a profile, can you please check it? The example itself is even using the NASA account.

11- You can read the documentation to build your query for the input.
2
32/3- The speed of the actor is also explained in the readme but this is just an estimation and can vary a lot depending lots of factors. The best way would be to try and see.

You can reach out to us via Discord as well.

Cheers

Again is that possible to fetch every tweet from any twitter account using this actor?

Yes or No

Hello,

Yes it is but you need to come up with a query strategy depending the account and we cannot help you with that. It is different for every account depending on their tweet per timeframe count. Please read https://apify.com/apidojo/tweet-scraper#fetching-the-tweets-of-a-profile, it has all the information you need.

Cheers

I am running with this query however it only returns tweets from Nov 2024 - Dec 2024, but my query has a date filter since and until

{ "author": "DrTalebJawad", "customMapFunction": "(object) => { return {...object} }", "end": "2021-06-26", "includeSearchTerms": false, "maxItems": 500, "minimumReplies": 100, "minimumRetweets": 100, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "searchTerms": [ "from:abc" ], "sort": "Latest", "start": "2016-06-26", "startUrls": [ "https://x.com/abc" ], "tweetLanguage": "en" }

Hello,

This input won't work with user profiles since startUrls and start/end dates don't work together. You have to use Twitter queries, please refer to https://apify.com/apidojo/tweet-scraper#fetching-the-tweets-of-a-profile there is a very specific example that you can check.

You also need to remove other filters from your INPUT like minimumRetweets, author etc.

Cheers

https://apify.com/apidojo/tweet-scraper#fetching-the-tweets-of-a-profile

Ok even that query doestn't work:

{ "includeSearchTerms": false, "maxItems": 500, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "searchTerms": [ "from:abc since:2016-03-06 until:2024-12-25" ], "sort": "Latest", "tweetLanguage": "en" }

Hello,

Can you send us a run ID so we can check?

Cheers

Here it is https://console.apify.com/actors/61RPP7dywgiy0JPD0/runs/ksu7vknGEAl8f6u1k#input

Hello,

Seems like your query doesn't return anything from Twitter. You can try your queries over Twitter web UI before running them on the actor.

Cheers

I am using your api not twitter api, but the thing is that the account I am using has 1.2k posts, your api's query is not working. when I go to that profile on twitter there are lots of tweets since 2016.

Your API just returning Nov 2024 - DEC 2024, however I need tweets from 2016.

Hello,

This is not a Twitter API, it is a scraper. It goes to Twitter for you and execute your query so if your query is not working on Twitter, you shouldn't expect it to work here.

You have to test your queries on Twitter web UI. If you cannot get a response from there by yourself, how do you expect a scraper to get a response? Twitter is not responding itself, that account might have a restriction or a shadow ban. Please make sure your queries run successfully on Twitter before executing them on the actor.

And, please read the documentation.

Cheers

two moe questions:

• if I want to fetch all the data but I don't know when the account registered, in that case what will be since date? any date like (1999)

• If I want to fetch data since 2016 to until 2025, which one I need to follow?

1 - "searchTerms": [ "from:NASA since:2016-01-01 until:2025-01-01", ]

OR

2- "searchTerms": [ "from:NASA since:2016-01-01 until:2016-01-01", "from:NASA since:2016-02-01 until:2016-03-01", "from:NASA since:2016-03-01 until:2016-04-01", "from:NASA since:2016-04-01 until:2016-05-01", . . . . "from:NASA since:2025-01-01 until:2025-01-01" ]

I will close the issue by myself, kindly answer to above question please.

Hello,

1- You can start by this date and go backwards, it depends on your strategy.

2- Both of these questions depend on the target account. If that account has more than 800 tweets for a given timeframe, you need to have multiple queries. It all again depends on the account and your query strategy.

I think you are not reading the documentation, this is explained very well and shortly. There is no single query that will work for all the accounts.

Cheers

Is it possible to fetch videos, images, retweets, quoted of each tweet? keeping the above search?

currently, the profile has 35k posts but the above API is returning 21k only?

here is the run: https://console.apify.com/view/runs/7K8mlQv6yebU8joKL

Hello,

They should be inside the tweet objects.

However there is an issue with your run, you are violating the terms right now and will get rate-limited if you keep doing it. You shouldn't batch more than 5 queries to a single run. PLEASE read the documentation as there is a special field explaining the terms

https://apify.com/apidojo/tweet-scraper#important-note

Cheers

Then how can I fetch tweets since 2016 until 2025? you said batching is not allowed and we need to run with max 5 queries at a time and there should be couple of minutes between each run.

strange then indirectly you are not allowing me to fetch whole data for an account at a time.

Maybe you have a solution for me?

my usecase I don't know how much tweets are there in which dates, there might be 0 tweets for whole month and and there maybe 500+ tweets a week.

I created queries from 2010 - 2025 with the gap of 7 days.

Please give me some solution.

Hello,

You need to come up with your own strategy depending on the target account, that's what everyone is doing. You can batch 5 of them to a run and then 5 more to the next run and you will fetch all eventually if your strategy is good.

You can develop something smart which will first check years, if there are more than 800, it can build queries for months, same goes, etc. The possibilities are endless but as I said, you need to come up with a solution yourself.

Our job is to provide you a documentation on how to use the actor and make the actor available, besides it is your responsibility. Unfortunately we don't provide this level of support.

Cheers

I understand, but honestly, the readme file is not developer-friendly.

can you tell me the number of minutes I need to keep the gap between runs?

like I am running 10 runs in a loop then how many minutes I need to wait it before goes to next run?