Hello,

Unfortunately twitter is not very predictable so we suggest you to create several runs for that purpose. Please keep in mind that we have some ground rules for this actor mentioned at https://apify.com/apidojo/tweet-scraper#important-note. If you think your runs can violate these, please consider using Twitter Scraper Unlimited (https://apify.com/apidojo/twitter-scraper-lite)

Cheers

Hi. I understand, I think I will be splitting in quarters (4 months per run). My question is, is there a limit of how many tweets i can get in this 4 month per search? I read somewhere in the documentation that a query only returns 800 tweets, does it apply to my case where i use search terms (not on a specific profile)? For example, for one term, is there a limit in how many tweets i can scrape if i use since and until for a 4 months interval?

Hello,

We don't have any limitations but Twitter has them and it is very hard to know when and how many they do. Previously they were applying 800 tweet limitation per query but recently we saw that you can fetch more than 10s of thousands tweet with some queries.

We are passing this query directly to Twitter and return you whatever it returns to us, that's why we don't have certain answers to your question. However it's always a good idea to try to split your queries.

Cheers

Another question:

Is there a difference in using "since" and "until" in this way (with the search terms);

"searchTerms": [
    "from:NASA since:2023-01-01 until:2023-03-01",
    "from:NASA since:2023-03-01 until:2023-05-01",
    "from:NASA since:2023-05-01 until:2023-07-01",
    "from:NASA since:2023-07-01 until:2023-09-01",
    "from:NASA since:2023-09-01 until:2023-12-01"
],

or using start date and end date from query wizard?

Hello,

It depends. For instance start/end date filters don't work with startUrls or twitterHandles.

If you are using searchTerms with Twitter queries, don't use any other filters as you don't need them. Those are only helpers to build the queries for you. The best and most advanced way is to use only searchTerms

Cheers

Hello,

It depends. For instance start/end date filters don't work with startUrls or twitterHandles.

If you are using searchTerms with Twitter queries, don't use any other filters as you don't need them. Those are only helpers to build the queries for you. The best and most advanced way is to use only searchTerms

Cheers

So you mean that i should use only searchterms and put since and until in there like this:

{ "includeSearchTerms": true, "maxItems": 3000, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "searchTerms": [ "covid OR vaccine OR anxiety OR depression OR autism since:2020-01-01 until:2020-04-30", "arthritis OR antibiotics OR flu jab OR dementia OR bronchitis since:2020-01-01 until:2020-04-30", "chronic obstructive pulmonary disease OR heart failure OR coronavirus OR diabetes OR bacterial meningitis since:2020-01-01 until:2020-04-30", "chlamydia OR back pain OR hemorrhage OR bowel cancer OR stroke syndrome since:2020-01-01 until:2020-04-30", "infertility OR nutritional deficiencies OR pneumonia OR herpes OR vitamin d since:2020-01-01 until:2020-04-30" ], "tweetLanguage": "en" }

????

This is what im doing but for some reasons 90% of the tweets are on one day (29th April), how can I solve this problem? I need to cover the whole time window

Hello,

Seems like there are lots of tweets with these queries and you need to increase the maxItems. Also please consider using parentheses with OR queries.

Cheers

Hi, what is exactly maxItems? You mean how many results i want from the run? Also, why parenteses with OR queries? where should the parenteses be?

cheers