🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Pay $0.40 for 1,000 tweets
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Pay $0.40 for 1,000 tweets
⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!
Can't get all data
I want to get some data by apidojo/tweet-scraper, I set the starttime and endtime ,but finnally, I just get 733 items from this tool , and the container is ended,I wanna konw what happened on that,and how can I get total data by this tool ,my run id is OJ1Zp3kdHD9I3NX4S
Hello,
Your query returned 733 tweets from Twitter and Twitter doesn't return any more for it. If you think there are more tweets, you need to optimize your query.
Cheers
pumpnews
No, that's not right, I set searching date from 2025-01-18 to 2025-01-20, the result only get items on 2025-01-19, you can review my setting, I try to search date from 2025-01-18 to 2025-01-19, it still have items on 2025-01-18, it display my run id OJ1Zp3kdHD9I3NX4S not get all data, you can see the picture of it , it only search to Sun Jan 19 23:53:00 when is ended task.
pumpnews
You can see run id :Iz2lI8eTeP1CX51WK, it use the same key words, but it can get data created by 2025-01-18, the result is display on picture
Hello,
Our actor works with Twitter queries and your input generates this query as you can see in the Log tab.
6p6xgHyF7AeE6TZkSmFsko444wqoP15icUSqi2jfGiPN OR $TRUMP since:2025-01-18 until:2025-01-20
When you provide this query to Twitter web UI, it only returned 733 tweets. If you read the documentation of the actor, you can see that there is an explanation like this:
"Since Twitter returns ~800 tweets for each search, you need to divide your run into several search queries using since and until".
So, as I mentioned you need to optimize your query and also read the doc :)
Cheers
Hello again,
I also realized that that in the second screenshot, you only fetched 10 objects which violates the terms. You need to fetch min 50 tweets per query. Please read the terms at https://apify.com/apidojo/tweet-scraper#important-note and follow the rules, otherwise you might get rate-limited.
Cheers
pumpnews
So I need adjust my since time and until time, but the time unit is 'Day', could I use hour and mintues?such as my params are since:2025-01-18 15:00:00 until:2025-01-20 18:00:00?
pumpnews
What's more, do you have any automated tasks for this process that I can set up? It's too troublesome to handle manually every time
Hello,
You can use Apify's API https://docs.apify.com/api/v2 to automate the process or you can use the built in Scheduler in Apify. To be able to use the time, please refer to the documentation, it is very well explained there with external links.
Cheers
API DojoActor Metrics
2.3k monthly users
-
559 bookmarks
87% runs succeeded
3.7 hours response time
Created in Nov 2023
Modified 19 hours ago
