Twitter Scraper avatar
Twitter Scraper
Try for free

Pay $1.50 for 1,000 tweets

View all Actors
Twitter Scraper

Twitter Scraper

microworlds/twitter-scraper
Try for free

Pay $1.50 for 1,000 tweets

Twitter Scraper searches and extracts data from Twitter (with historic data from 2006) - parses and converts the data to structured formats: HTML table, JSON, CSV, Excel and XML.

GF

Scraper returns a lot of irrelevant results

Closed

groovy_fiddle opened this issue
4 months ago

Hey! The scraper sometimes returns a lot of results that obviously have nothing to do with the query instead of returning and empty result. It seems be posts from accounts from some kind of shows like this one: https://twitter.com/NightlightsShow/status/1768382588194857381

or this one: https://twitter.com/Reloadedd94/status/1766867830669038003

Could you please check, why this happens from time to time? It leads to a lot of useless data.

Thank you!

microworlds avatar

Hi groovy_fiddle,

Sorry about that. That looks weird indeed. 🤔 I am not able to reproduce the issue after trying three times. How often do you experience the issue?

GF

groovy_fiddle

4 months ago

It's pretty random and seems to be happening with a higher probability, the more runs we run in parallel and only seems to happen for queries that wouldn't return any results at all. From the last 200 runs it happened 7 times (leading to 700 extra posts).

microworlds avatar

Alright, I'll take a closer look at it this weekend. Keep you posted 👍

microworlds avatar

HO, just checking if you're still experiencing the issue?

GF

groovy_fiddle

4 months ago
microworlds avatar

Hmm, that is really weird, the thing is I can't seem to easily reproduce it in dev mode. Sorry about that - I will give it an extra pair of eyes! 👍

Developer
Maintained by Community
Actor metrics
  • 795 monthly users
  • 39 stars
  • 99.1% runs succeeded
  • 1.4 days response time
  • Created in Jul 2023
  • Modified 2 days ago
Categories