🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Pricing
$0.40 / 1,000 tweets
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!
3.0 (66)
Pricing
$0.40 / 1,000 tweets
682
Total users
16K
Monthly users
1.8K
Runs succeeded
>99%
Issues response
5 hours
Last modified
13 hours ago
Retweets not showing up on search
Closed
We've been trying to get lists of tweets from specific users within specific time periods. Getting original and quoted posts seems to work fine, but retweets do not, even when they show up in the X/Twitter search interface.
Here's an example json without the retweets. It has 20 posts; the time period should actually have 24 if you include retweets (run xftqFUedTZZNOjEfk):
{ "includeSearchTerms": false, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "searchTerms": [ "from:kaitlancollins since:2024-06-27 until:2024-06-30" ] }
Per the search parameter site and some other responses to issues here, we tried adding:
- include:nativeretweets (0ybuyvMQPoKli2hDT)
- filter:-retweets (DXwEna4tyyghg2Jcp)
- filter: retweets (cVjSDTLRXB51szwl6)
All returned 0 results.
The nativeretweets parameter does work when you put it in the x.com web interface though, e.g. https://twitter.com/search?q=from%3Akaitlancollins%20since%3A2024-06-27%20until%3A2024-06-30%20include%3Anativeretweets&src=typed_query&f=top
We also tested the profile scrape, which does get everything but will be problematic if we go back in time, I think (given the ~800 tweet limit).
Any ideas here? I'm sure I'm doing something wrong that's fairly simple. Thanks!
Hey hey,
I have forwarded this to my engineering team and will get back to you as soon as I get a reply from them.
Cheers!
inquisitive_soil
Thanks!
Hey hey,
Twitter changes their filters a lot. previously retweets were included by default but now you need to add the filter yourself. include:nativeretweets is a correct usage.
When you tried running, our actor temporarily had an issue but it got resolved very quickly. Sometimes this can happen, is it possible for you to try again?
Also here is an example run for you to investigate: https://console.apify.com/view/runs/HF5uQwQq9151tdLUC
Cheers!
