Hello,

startUrls/twitterHandles and start/end dates don't work together. If you want to fetch a profile, you need to use Twitter queries. You can check them here https://github.com/igorbrigadir/twitter-advanced-search, we support all of them :) For your case, you can do something like this:

{  
  "sort": "Latest",  
  "searchTerms": [
    "from:JMilei since:2017-01-01 until:2017-02-01",
    "from:JMilei since:2017-02-01 until:2017-03-01",
    "from:JMilei since:2017-03-01 until:2017-04-01",
    "from:JMilei since:2017-04-01 until:2017-05-01",
    "from:JMilei since:2017-05-01 until:2017-06-01"
  ]
}

Every query in this searchTerms can return ~800 tweets becaue of Twitter's limits so if you think that account tweets more than 800 a month, you need to divide your queries into more time frames.

I hope this helps!

Cheers!

Thanks a lot. That makes sense but I wished it was specified in the search details.

How do I find the one you suggest in Apify?

Hello,

You are welcome! What do you mean when you say "How do I find the one you suggest in Apify?" ? You can use a similar input as I suggested in the previous message. You just need to tweak it to get the most tweets from that account.

Best!

Thanks. I wasn't sure if I could use the same 'actor' as you had directed me to github.

If I want all the posts from that account, should I use the twitter handler only, rather than also the URL?

Hello,

That github link was just to give you more information about the Twitter queries you can use in searchTerms. In my example, I am using from, since and until but there are lots more!

You need to use the searchTerms as I sent to you (like from:JMilei since:2017-01-01 until:2017-02-01) if you want to fetch all of the posts.

Does that make sense?

Cheers

Hi again. Sorry for asking so many questions, I find your answers very helpful. I did as you suggested with time frames of six months and I got 8700 results, but none from 2024, not sure why. I am going to try with shorter time frames. Also, I am trying to select columns for storage but only some are listed, and it doesn't include some crucial ones such as date. Any idea as to why? Finally, if using 'from' as you suggested, would this include also retweets done from that account? Thanks.

Hello,

Can you please send us your run ID so we can check?

For your other questions: if you are trying to export as csv or excel, I think there is a limit for the columns. If that's the case, you either need to export as json or you can use customMapFunction to map the fields you need. For the query, you can refer to https://github.com/igorbrigadir/twitter-advanced-search, I think there is a query called include:nativeretweets which you can use.

Thanks

Thanks so much. Here is the latest gAa5hAXIN2fg13lCf (one year divided in 1 month periods). It returned 3038 but only original posts including quotes but no retweets. Looking at those functions, it seems that one can only get native retweets for the last 7/10 days, while I need to go back in time so it doesn't work for me.
As for the columns, I would like to just get the ones included in the query table (as I download them) but I don't see that option in the downloading tab. As for the function, customMapFunction, sorry for the ignorance but at which step do I include it?

Hello,

The reason is that you are both including the dates in searchTerms and also in other filters under Query Wizard. You need to remove everything including Filters and Query Wizard items and only use searchTerms in your input. Here is your current input:

{
  "customMapFunction": "(object) => { return {...object} }",
  "end": "2023-12-31",
  "includeSearchTerms": false,
  "maxItems": 10000,
  "minimumFavorites": 0,
  "minimumReplies": 0,
  "minimumRetweets": 0,
  "onlyImage": false,
  "onlyQuote": false,
  "onlyTwitterBlue": false,
  "onlyVerifiedUsers": false,
  "onlyVideo": false,
  "searchTerms": [
    "\"from:JMilei since:2022-01-01 until:2022-01-31\",",
    "\"from:JMilei since:2022-02-01 until:2022-2-28\",",
    "\"from:JMilei since:2022-03-01 until:2022-03-31\",",
    "\"from:JMilei since:2022-04-01 until:2022-4-31\",",
    "\"from:JMilei since:2022-01-05 until:2022-05-31\",",
    "\"from:JMilei since:2022-06-01 until:2022-6-30\",",
    "\"from:JMilei since:2022-07-01 until:2022-07-31\",",
    "\"from:JMilei since:2022-08-01 until:2022-8-31\",",
    "\"from:JMilei since:2022-09-01 until:2022-09-31\",",
    "\"from:JMilei since:2022-10-01 until:2022-10-31\",",
    "\"from:JMilei since:2022-11-01 until:2022-11-30\",",
    "\"from:JMilei since:2022-12-01 until:2022-12-31\","
  ],
  "sort": "Latest",
  "start": "2017-07-01"
}

As you see, you have until: in your searchTerms and also you set the end and tart parameters. Please remove the... [trimmed]

Hey!

Did you have any time to check my previous response?

Thanks

Hey hey,

Closing this task to due stalling. Please feel free to contact us again in case you have any questions.

Chers!