Twitter Scraper avatar
Twitter Scraper
Try for free

Pay $3.50 for 1,000 posts

View all Actors
Twitter Scraper

Twitter Scraper

quacker/twitter-scraper
Try for free

Pay $3.50 for 1,000 posts

Scrape tweets from any Twitter user profile. Top Twitter API alternative to scrape Twitter hashtags, threads, replies, followers, images, videos, statistics, and Twitter history. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

User avatar

replying_to_tweet and is_root_thread columns are missing

Open

toffee opened this issue
4 months ago

Hi all, replying_to_tweet and is_root_thread columns are sometimes in the dataset some other times i don't see these columns for the same task. Why do you think this inconsistency might be happening? I will provide both run ids for you to analyse. Kindly check this topic please.

Columns are missing: FisihTqkLTwgbVUbb

Columns are present: rDPPjktIEdrdcMw16

User avatar

toffee

4 months ago

The column that is being returned is not consistent sometimes it doesnt bring is_root_thread column some other time it doesnt bring replying_to_tweet column. Why is this happening? At each run the dataset should bring the same columns providing a consistent solution. Kindly check this please!

User avatar

Hi, thanks for reaching out, we will look into it and let you know!

User avatar

Hi again, thanks for you patience, do you think you could please share your runs with us again so we can investigate? Unfortunately they've already run out. Thanks!

User avatar

Hi!

Follow up:

replying_to_tweet works stable, unable to reproduce case when its missing, see sample run https://console.apify.com/view/runs/6dMieh11hNlZu2NqT

is_root_thread looks deprecated by Twitter, value no longer presented in Twitter data, therefore actor do not provide any output for it

Developer
Maintained by Apify
Actor metrics
  • 1.2k monthly users
  • 33.8% runs succeeded
  • 7.1 days response time
  • Created in Jun 2019
  • Modified 8 days ago