6 hours trial then $30.00/month - No credit card required now
Twitter Tweets and Profiles Scraper
6 hours trial then $30.00/month - No credit card required now
Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.
Crawler seems to be proceeding to scrape after completion
Closed
I'm trying to scrape a list of users (inputted based on txt file with URLs). If you check the logs, it looks like it reached the date limit after ~5 minutes, but the scraper continued for another 30 minutes. Not sure if this is user error or not.
The goal is just to get all the tweets and replies to the tweets from the list of profiles over X time period, in this run, the last day.
Please let me know if you need any additional information. I'm trying to set this up so that it can run regularly and the significant runtime addition causes a huge increate in the cost/run.
Hi Brian,
It appears that there is an issue with the Actor feature. The issue arises when you set the "Replies depth" option along with the "Tweets newer than" option. We will investigate it. We will keep you updated on the progress, but please note that it may take some time to resolve.
brian_keith
Gotcha, thank you. So would my only option in the short term be to disable this feature? This feature was one of the primary things I wanted since I want both the tweets from a user and the replies thread.
Hi Brian,
Thank you for your patience. The issue has been resolved. Please let us know if you face any further issues.
Web Harvester- 312 monthly users
- 13 stars
- 99.9% runs succeeded
- 3.8 days response time
- Created in Jul 2023
- Modified 2 months ago
