Pay $1.50 for 1,000 tweets
Twitter Scraper
Pay $1.50 for 1,000 tweets
Twitter Scraper searches and extracts data from Twitter (with historic data from 2006) - parses and converts the data to structured formats: HTML table, JSON, CSV, Excel and XML.
empty query is marked as an failed
Closed
Hey, i asked on Discord about that feature, but I don't see it. We would like to have a flag, that will allow us to mark the page as succeeded, even if the query is empty after retry.
Hi watch_my_competitor, sorry for the late reply. The issue has to do with timeouts. We are receiving a very high traffic at the moment, hence taking too long to complete a request. We are currently working on a fix for this. In the meantime, I'd suggest you increase the request timeout to say 540 seconds so it has enough headroom to accommodate the request. Note that this is just a temporary fix and a permanent fix for this issue is coming before the week runs out. Thanks for your understanding.
Cheers!
watch_my_competitor
i mean more about Finished! Total 1 requests: 0 succeeded, 1 failed. when the queries are empty: 2024-07-02T11:05:17.876Z INFO BasicCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: No results found for the query - https://x.com/search?mx=2&q=(from%3Axyz)%20since%3A2024-06-18&src=typed_query, Retring... (file:///usr/src/app/src/index.js:140:15)"]} 2024-07-02T11:05:17.878Z INFO BasicCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true} 2024-07-02T11:05:17.919Z INFO Finished successfully ✅
In our case, that's a successful run.
Resolved ✅
Caleb David- 708 monthly users
- 57 stars
- 99.4% runs succeeded
- 3.9 days response time
- Created in Jul 2023
- Modified 18 days ago
