🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper avatar
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Try for free

Pay $0.30 for 1,000 tweets

View all Actors
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper
Try for free

Pay $0.30 for 1,000 tweets

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

WM

Update: Results not reflecting input

Closed

wisteria_mat opened this issue
2 months ago

Hi there,

Yes, I understand. What I am saying is that I have used the code you provided and tried including them together, but am still not getting any results in the output.

This is what I am trying to do: Scrape the latest 10,000 tweets from Apple until Feb 13, 2024. However, I do not get any results even when I don’t specify a date range. If I just specify "from:apple", I get 0 results. If I specify "from:Nike" I only get 20 when I’ve specified 10,000. So, I am not sure what I’m missing when 2 months ago I was able to use these specifications and get my desired output with no issues.

Here is what I have populated manually (and also screenshots attached):

Start URLs: Left empty Search Terms:

  • Have tried "from:apple until:2024-02-13" in one box
  • Have tried "from:apple" and "until:2024-02-13" in separate boxes, which has worked in the past but no longer works. Twitter handles: Left empty Conversation IDs: Left empty Maximum number of items on output: 10000 Max tweets per query: 10000 Sort By: Latest Filter Tweets: English, Only Verified Users Query Wizard: All fields empty Advanced Options: Empty Run options:
  • Build: latest
  • Timeout: empty
  • Memory: 512 MB
  • Maximum charged results: No maximum limit

Here is what I have tried in the JSON code:

{ "includeSearchTerms": false, "maxItems": 10000, "maxTweetsPerQuery": 10000, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "searchTerms": [ "from:apple until:2024-02-13" ], "sort": "Latest", "tweetLanguage": "en" }

Am I misspecifying the maximum number of tweets?

Thanks again.

apidojo avatar

API Dojo (apidojo)

2 months ago

Hello again,

https://twitter.com/apple account doesn't seem to have any tweets, it has 0 tweets. Are you sure that is the account you are looking for?

Best

WM

wisteria_mat

2 months ago

Ah, yes, you're right. I tried again with https://twitter.com/microsoft, which has 30.5k tweets, and I am still seeing 0 results.

apidojo avatar

API Dojo (apidojo)

2 months ago

Hello,

Can you share your run ID please?

Best

WM

wisteria_mat

2 months ago

Sure, this is my latest one with Nike which only got 80 results. When I ran this with Nike a couple of months ago, I was able to get 10k.

https://console.apify.com/actors/61RPP7dywgiy0JPD0/runs/JtyzecE0sQsNiUuuK#output

Thanks again.

apidojo avatar

API Dojo (apidojo)

2 months ago

Hey again,

This is purely related to Twitter. Twitter is very unstable when doing big queries and they are changing this day by day. What we suggest to everyone is to divide your queries into multiple chunks so you get the most out of Twitter. You can try something like the following (divide it into months):

1{  
2  "searchTerms": [
3    "from:Nike since:2023-10-01 until:2023-11-01",
4    "from:Nike since:2023-11-01 until:2023-12-01",
5    "from:Nike since:2023-12-01 until:2024-01-01",
6    "from:Nike since:2024-01-01 until:2024-02-01",
7    "from:Nike since:2024-02-01 until:2024-03-01",
8    "from:Nike since:2024-03-01 until:2024-04-01",
9    "from:Nike since:2024-04-01 until:2024-05-01"
10  ],
11  "sort": "Latest",
12  "tweetLanguage": "en"
13}

This it the best way to get the most out of Twitter!

Cheers!

Developer
Maintained by Community
Actor metrics
  • 1.4k monthly users
  • 167 stars
  • 98.5% runs succeeded
  • 6.5 hours response time
  • Created in Nov 2023
  • Modified about 22 hours ago