Pay $0.30 for 1,000 tweets
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Pay $0.30 for 1,000 tweets
⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!
Getting avg of 840-850 tweets per run.
Closed
Hello, i am subscribed to starter package and only able to retrieve 850 tweets per run. how to fix this, Here is the run id A4LF8q8ZmANXwHH9a. i want to extract all the tweets from a profile. here is my code:
from apify_client import ApifyClient
Initialize the ApifyClient with your API token
client = ApifyClient("API KEY")
Prepare the Actor input
run_input = {
1"twitterHandles": [ 2"elonmusk" 3], 4 5"maxItems": 50000, 6"sort": "Latest", 7 8 9"customMapFunction": "(object) => { return {...object} }",
}
Run the Actor and wait for it to finish
run = client.actor("61RPP7dywgiy0JPD0").call(run_input=run_input)
Fetch and print Actor results from the run's dataset (if there are any)
for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item)
Hey hey!
Thanks for reaching out. This problem is happening because of Twitter itself. Twitter has a soft limitation no matter what account type you use. For each of the paginated lists, Twitter creates a stream. Every stream has its maximum limitation. The limitation is simply that Twitter does not give more results after an uncertain amount of pagination. No matter where you are checking that stream, or which account you use. For example, if you start pagination by using your account, after some time, the UI will not return more data. This limitation is not because of the account type but Twitter's global restrictions.
The best option that you can use would be splitting your request into multiple chunks and trying to create multiple streams. For example, in your case, you would like to retrieve the tweets of a user. For such a search, you can try to search for from:elonmusk since:2024-01-01 and from:elonmusk until:2024-01-01 to generate two streams. In that way, you can reach more tweets.
Cheers
API Dojo- 1k monthly users
- 95.9% runs succeeded
- 0.29 days response time
- Created in Nov 2023
- Modified about 10 hours ago
