Twitter Scraper avatar

Twitter Scraper

Deprecated
Go to Store
This Actor is deprecated

This Actor is unavailable because the developer has decided to deprecate it. Would you like to try a similar Actor instead?

See alternative Actors
Twitter Scraper

Twitter Scraper

microworlds/twitter-scraper

Twitter Scraper searches and extracts data from Twitter (with historic data from 2006) - parses and converts the data to structured formats: HTML table, JSON, CSV, Excel and XML.

WM

empty query is marked as an failed

Closed

watch_my_competitor opened this issue
6 months ago

Hey, i asked on Discord about that feature, but I don't see it. We would like to have a flag, that will allow us to mark the page as succeeded, even if the query is empty after retry.

microworlds avatar

Hi watch_my_competitor, sorry for the late reply. The issue has to do with timeouts. We are receiving a very high traffic at the moment, hence taking too long to complete a request. We are currently working on a fix for this. In the meantime, I'd suggest you increase the request timeout to say 540 seconds so it has enough headroom to accommodate the request. Note that this is just a temporary fix and a permanent fix for this issue is coming before the week runs out. Thanks for your understanding.

Cheers!

WM

watch_my_competitor

6 months ago

i mean more about Finished! Total 1 requests: 0 succeeded, 1 failed. when the queries are empty: 2024-07-02T11:05:17.876Z INFO BasicCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: No results found for the query - https://x.com/search?mx=2&q=(from%3Axyz)%20since%3A2024-06-18&src=typed_query, Retring... (file:///usr/src/app/src/index.js:140:15)"]} 2024-07-02T11:05:17.878Z INFO BasicCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true} 2024-07-02T11:05:17.919Z INFO Finished successfully ✅

In our case, that's a successful run.

microworlds avatar

Resolved ✅

Developer
Maintained by Community
Categories