🏯 Twitter (X) User Scraper (Pay Per Result) avatar
🏯 Twitter (X) User Scraper (Pay Per Result)
Try for free

Pay $0.30 for 1,000 users

View all Actors
🏯 Twitter (X) User Scraper (Pay Per Result)

🏯 Twitter (X) User Scraper (Pay Per Result)

apidojo/twitter-user-scraper
Try for free

Pay $0.30 for 1,000 users

Introducing Twitter (X) User Scraper, the ultimate solution for direct user extraction from Twitter (X). It offers blazing speed and comprehensiveness, delivering lightning-fast user extraction features.

AR

Incomplete results

Closed

assertive_ripple opened this issue
5 months ago

Hey there! Unfortunately I've come across an issue.

I've run the actor twice now for the same username and have always come short of the total amount of followings:

ID 1: AqU4qvPibVSrxQN7e (12K results of 116K) ID 2: BjTtK6G1yDjRfK3sy (26K results of 116K)

I've left the limits blank and also set a very high upper limit and still no luck.

Watching the logs we get 49, 48, 50 results then it falls to 0 and stops the run.

Any insight would be much appreciated! Thanks!

apidojo avatar

API Dojo (apidojo)

5 months ago

Hey hey!

Thanks for reaching out. One important thing to mention on this one. Twitter has a soft limitation no matter what account type you use. The limitation is simply that Twitter does not give more results after an uncertain amount of pagination. For example, if you start pagination by using your account, after some time, the UI will not return more data. This limitation is not because of your account type but Twitter's global restrictions. This restriction also applies to their official API.

That's why you are not retrieving all the data. In this situation, we always suggest our users split the search into multiple chunks if possible since the pagination limitation only applies per search. In your case, that might not be doable since you are trying to get the followers and followings of the user. Twitter's Advanced Search does not have the capability of searching one account's followers or followings.

The best (and the most unoptimized) way of fetching more data is letting the actor fetch the followers or followings multiple times. As mentioned, Twitter restricts the limitation at a very uncertain time. You can get more by running the actor multiple times, but probably you cannot fetch them all.

I hope this helps. Cheers

Developer
Maintained by Community
Actor metrics
  • 146 monthly users
  • 12 stars
  • 98.4% runs succeeded
  • 4.4 hours response time
  • Created in Nov 2023
  • Modified about 10 hours ago