🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper avatar
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

Pricing

$0.40 / 1,000 tweets

Go to Store
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

Developed by

API Dojo

API Dojo

Maintained by Community

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

3.2 (70)

Pricing

$0.40 / 1,000 tweets

670

Total users

15.4k

Monthly users

1.7k

Runs succeeded

>99%

Issues response

5 hours

Last modified

19 hours ago

CO

Limited Results

Closed

ComplexMinded opened this issue
a year ago

Seems like I am only about to get about 200 records after running this scrape when the search on twitter would return more when using identical parameters. I am a paying member so I should be getting more results correct? Here are some RunIDs

ePogOqMq4IqEuUOa2 A3v8NGPCjfQnENzBa

apidojo avatar

Hey hey!

Thank you very much for reaching out. Let me explain the problems you had one by one:

  • A3v8NGPCjfQnENzBa => This one was on the Demo Mode. We prioritize our subscribed users due to the high spam/abusive traffic. To achieve this, we integrated the Demo Mode. In the Demo Mode, the users who are not subscribed can only retrieve a maximum of 100 tweets. Also, they are not able to use our actor via API. To achieve these functionalities, users have to subscribe.

  • ePogOqMq4IqEuUOa2 => This problem is happening because of Twitter itself. Twitter has a soft limitation no matter what account type you use. For each of the paginated lists, Twitter creates a stream. Every stream has its maximum limitation. The limitation is simply that Twitter does not give more results after an uncertain amount of pagination. No matter where you are checking that stream, or which account you use. For example, if you start pagination by using your account, after some time, the UI will not return more data. This limitation is not because of the account type but Twitter's global restrictions.

Specifically for the second run, the list you would like to get is quite big. Therefore, I suggest you to use the same technique you made on A3v8NGPCjfQnENzBa which is making your time windows smaller as much as possible with since and until.

Cheers!!