Twitter List Scraper avatar

Twitter List Scraper

Deprecated
View all Actors
This Actor is deprecated

This Actor is unavailable because the developer has decided to deprecate it. Would you like to try a similar Actor instead?

See alternative Actors
Twitter List Scraper

Twitter List Scraper

quacker/twitter-list-scraper

Scrape posts from any public list of Twitter accounts. Get user info, username, location, follower/following count, profile URL/image/banner, date of creation. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Do you want to learn more about this Actor?

Get a demo
TO

is_root_thread and is_thread is not coming with correct data

Closed

toffee opened this issue
a year ago

is_root_thread was working correctly for the last days but now it seems that is_thread and is_root_thread logic is broken. for all records it shows the value false even if it is a thread or first tweet of a thread. can you please check and fix it?

lukaskrivka avatar

Hello,

You are using the wrong outdated build. You need to use version-1. Sorry, taking this back, we need to analyze

TO

toffee

a year ago

Hello Lukas,

Thanks for your reply. It would be amazing if you can fix it. This way unfortunately the data is a little bit too dirty to work with.

hamza.alwan avatar

Hi E K,

Unfortunately, Twitter put everything behind a login, you can now only scrape single tweets without a login.

If you want to scrape everything, you can use this https://apify.com/quacker/twitter-scraper, and you need to provide cookies to it, here is how:

https://www.youtube.com/watch?v=JloR3uAqxRQ&ab_channel=Apify

TO

toffee

a year ago

Hey, will this ever be solved?

hamza.alwan avatar

Hey E K,

This issue is fixed and it will be released soon.

TO

toffee

a year ago

Unfortunately it doesnt seem to be working properly will you check and fix it if possible?

As data without login is available once again for Twitter, will you maintain this actor?

hamza.alwan avatar

Hey E K,

Data without login is limited to profiles and tweets, profiles are limited to 100 tweets (some less) and some profiles are behind login, and this is out of our hands at the moment:

This one redirects to the login page: https://twitter.com/kravtrade This one doesn’t: https://twitter.com/layerium

TO

toffee

a year ago

Oh ok, you are right havent noticed that. Thanks for the info

Coming to my question the is_root_thread logic still seems to be not working properly, is it possible to check that? Some records that has is_root_thread='yes' are not really threads at all. It would be amazing if you can check it.

hamza.alwan avatar

Can you please send me a run so I can check (id or link)

TO

toffee

a year ago

Sure, i can also provide some examples:

For the run id :o3F3lyKAQ6x4vUhk7

Wrong samples:

Thread logged as is_root_thread='no' https://twitter.com/BackTheBunny/status/1637079197402251264

Not a Thread logged as is_root_thread='yes' https://twitter.com/wacy_time1/status/1691444307570626561

hamza.alwan avatar

Hey E K,

Unfortunately, the information is being received in its current form directly from the Twitter response, and we lack any means of validating it through alternative methods.

Developer
Maintained by Apify