Twitter Scraper
Deprecated
Pricing
$1.50 / 1,000 tweets
Twitter Scraper
Deprecated
Twitter Scraper searches and extracts data from Twitter (with historic data from 2006) - parses and converts the data to structured formats: HTML table, JSON, CSV, Excel and XML.
5.0 (1)
Pricing
$1.50 / 1,000 tweets
61
Total users
13.2k
Monthly users
35
Runs succeeded
>99%
Last modified
8 months ago
empty query is marked as an failed
Closed
Hey, i asked on Discord about that feature, but I don't see it. We would like to have a flag, that will allow us to mark the page as succeeded, even if the query is empty after retry.
Hi watch_my_competitor, sorry for the late reply. The issue has to do with timeouts. We are receiving a very high traffic at the moment, hence taking too long to complete a request. We are currently working on a fix for this. In the meantime, I'd suggest you increase the request timeout to say 540 seconds so it has enough headroom to accommodate the request. Note that this is just a temporary fix and a permanent fix for this issue is coming before the week runs out. Thanks for your understanding.
Cheers!
watch_my_competitor
i mean more about Finished! Total 1 requests: 0 succeeded, 1 failed. when the queries are empty: 2024-07-02T11:05:17.876Z INFO BasicCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: No results found for the query - https://x.com/search?mx=2&q=(from%3Axyz)%20since%3A2024-06-18&src=typed_query, Retring... (file:///usr/src/app/src/index.js:140:15)"]} 2024-07-02T11:05:17.878Z INFO BasicCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true} 2024-07-02T11:05:17.919Z INFO Finished successfully ✅
In our case, that's a successful run.
Resolved ✅
