🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper avatar
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Try for free

Pay $0.30 for 1,000 tweets

View all Actors
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper
Try for free

Pay $0.30 for 1,000 tweets

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

CO

Limited Results

Closed

ComplexMinded opened this issue
3 months ago

Seems like I am only about to get about 200 records after running this scrape when the search on twitter would return more when using identical parameters. I am a paying member so I should be getting more results correct? Here are some RunIDs

ePogOqMq4IqEuUOa2 A3v8NGPCjfQnENzBa

apidojo avatar

API Dojo (apidojo)

3 months ago

Hey hey!

Thank you very much for reaching out. Let me explain the problems you had one by one:

  • A3v8NGPCjfQnENzBa => This one was on the Demo Mode. We prioritize our subscribed users due to the high spam/abusive traffic. To achieve this, we integrated the Demo Mode. In the Demo Mode, the users who are not subscribed can only retrieve a maximum of 100 tweets. Also, they are not able to use our actor via API. To achieve these functionalities, users have to subscribe.

  • ePogOqMq4IqEuUOa2 => This problem is happening because of Twitter itself. Twitter has a soft limitation no matter what account type you use. For each of the paginated lists, Twitter creates a stream. Every stream has its maximum limitation. The limitation is simply that Twitter does not give more results after an uncertain amount of pagination. No matter where you are checking that stream, or which account you use. For example, if you start pagination by using your account, after some time, the UI will not return more data. This limitation is not because of the account type but Twitter's global restrictions.

Specifically for the second run, the list you would like to get is quite big. Therefore, I suggest you to use the same technique you made on A3v8NGPCjfQnENzBa which is making your time windows smaller as much as possible with since and until.

Cheers!!

Developer
Maintained by Community
Actor metrics
  • 1.3k monthly users
  • 78 stars
  • 97.9% runs succeeded
  • 5.6 hours response time
  • Created in Nov 2023
  • Modified about 22 hours ago