🏯 Tweet Scraper V2 ($0.4 / 1K tweets) - X / Twitter Scraper avatar
🏯 Tweet Scraper V2 ($0.4 / 1K tweets) - X / Twitter Scraper

Pricing

from $0.40 / 1,000 tweets

Go to Store
🏯 Tweet Scraper V2 ($0.4 / 1K tweets) - X / Twitter Scraper

🏯 Tweet Scraper V2 ($0.4 / 1K tweets) - X / Twitter Scraper

Developed by

API Dojo

API Dojo

Maintained by Community

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

2.3 (76)

Pricing

from $0.40 / 1,000 tweets

737

Total users

18K

Monthly users

2.3K

Runs succeeded

>99%

Issues response

5.2 hours

Last modified

a day ago

WM

Update: Results not reflecting input

Closed

wisteria_mat opened this issue
a year ago

Hi there,

Yes, I understand. What I am saying is that I have used the code you provided and tried including them together, but am still not getting any results in the output.

This is what I am trying to do: Scrape the latest 10,000 tweets from Apple until Feb 13, 2024. However, I do not get any results even when I don’t specify a date range. If I just specify "from:apple", I get 0 results. If I specify "from:Nike" I only get 20 when I’ve specified 10,000. So, I am not sure what I’m missing when 2 months ago I was able to use these specifications and get my desired output with no issues.

Here is what I have populated manually (and also screenshots attached):

Start URLs: Left empty Search Terms:

  • Have tried "from:apple until:2024-02-13" in one box
  • Have tried "from:apple" and "until:2024-02-13" in separate boxes, which has worked in the past but no longer works. Twitter handles: Left empty Conversation IDs: Left empty Maximum number of items on output: 10000 Max tweets per query: 10000 Sort By: Latest Filter Tweets: English, Only Verified Users Query Wizard: All fields empty Advanced Options: Empty Run options:
  • Build: latest
  • Timeout: empty
  • Memory: 512 MB
  • Maximum charged results: No maximum limit

Here is what I have tried in the JSON code:

{ "includeSearchTerms": false, "maxItems": 10000, "maxTweetsPerQuery": 10000, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVid... [trimmed]

apidojo avatar

Hello again,

https://twitter.com/apple account doesn't seem to have any tweets, it has 0 tweets. Are you sure that is the account you are looking for?

Best

WM

wisteria_mat

a year ago

Ah, yes, you're right. I tried again with https://twitter.com/microsoft, which has 30.5k tweets, and I am still seeing 0 results.

apidojo avatar

Hello,

Can you share your run ID please?

Best

WM

wisteria_mat

a year ago

Sure, this is my latest one with Nike which only got 80 results. When I ran this with Nike a couple of months ago, I was able to get 10k.

https://console.apify.com/actors/61RPP7dywgiy0JPD0/runs/JtyzecE0sQsNiUuuK#output

Thanks again.

apidojo avatar

Hey again,

This is purely related to Twitter. Twitter is very unstable when doing big queries and they are changing this day by day. What we suggest to everyone is to divide your queries into multiple chunks so you get the most out of Twitter. You can try something like the following (divide it into months):

{
"searchTerms": [
"from:Nike since:2023-10-01 until:2023-11-01",
"from:Nike since:2023-11-01 until:2023-12-01",
"from:Nike since:2023-12-01 until:2024-01-01",
"from:Nike since:2024-01-01 until:2024-02-01",
"from:Nike since:2024-02-01 until:2024-03-01",
"from:Nike since:2024-03-01 until:2024-04-01",
"from:Nike since:2024-04-01 until:2024-05-01"
],
"sort": "Latest",
"tweetLanguage": "en"
}

This it the best way to get the most out of Twitter!

Cheers!