Twitter List Scraper
Deprecated
Pricing
Pay per usage
Twitter List Scraper
Deprecated
Scrape posts from any public list of Twitter accounts. Get user info, username, location, follower/following count, profile URL/image/banner, date of creation. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.
0.0 (0)
Pricing
Pay per usage
5
Total users
55
Monthly users
1
Runs succeeded
0%
Last modified
a year ago
is_root_thread and is_thread is not coming with correct data
Closed
is_root_thread was working correctly for the last days but now it seems that is_thread and is_root_thread logic is broken. for all records it shows the value false even if it is a thread or first tweet of a thread. can you please check and fix it?
Hello,
You are using the wrong outdated build. You need to use . Sorry, taking this back, we need to analyzeversion-1
toffee
Hello Lukas,
Thanks for your reply. It would be amazing if you can fix it. This way unfortunately the data is a little bit too dirty to work with.
Hi E K,
Unfortunately, Twitter put everything behind a login, you can now only scrape single tweets without a login.
If you want to scrape everything, you can use this https://apify.com/quacker/twitter-scraper, and you need to provide cookies to it, here is how:
https://www.youtube.com/watch?v=JloR3uAqxRQ&ab_channel=Apify
toffee
Hey, will this ever be solved?
Hey E K,
This issue is fixed and it will be released soon.
toffee
Unfortunately it doesnt seem to be working properly will you check and fix it if possible?
As data without login is available once again for Twitter, will you maintain this actor?
Hey E K,
Data without login is limited to profiles and tweets, profiles are limited to 100 tweets (some less) and some profiles are behind login, and this is out of our hands at the moment:
This one redirects to the login page: https://twitter.com/kravtrade This one doesn’t: https://twitter.com/layerium
toffee
Oh ok, you are right havent noticed that. Thanks for the info
Coming to my question the is_root_thread logic still seems to be not working properly, is it possible to check that? Some records that has is_root_thread='yes' are not really threads at all. It would be amazing if you can check it.
Can you please send me a run so I can check (id or link)
toffee
Sure, i can also provide some examples:
For the run id :o3F3lyKAQ6x4vUhk7
Wrong samples:
Thread logged as is_root_thread='no' https://twitter.com/BackTheBunny/status/1637079197402251264
Not a Thread logged as is_root_thread='yes' https://twitter.com/wacy_time1/status/1691444307570626561
Hey E K,
Unfortunately, the information is being received in its current form directly from the Twitter response, and we lack any means of validating it through alternative methods.
