🏯 Tweet Scraper V2 ($0.4 / 1K tweets) - X / Twitter Scraper
Pricing
from $0.40 / 1,000 tweets
🏯 Tweet Scraper V2 ($0.4 / 1K tweets) - X / Twitter Scraper
⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!
2.3 (76)
Pricing
from $0.40 / 1,000 tweets
737
Total users
18K
Monthly users
2.3K
Runs succeeded
>99%
Issues response
5.2 hours
Last modified
a day ago
StartUrl with Search Link Not Working?
Closed
Using starturls with profile and with_replies page work but when attempting to use a search link it appears to fail.
{ "author": "apify", "customMapFunction": "(object) => { return {...object} }", "end": "2021-07-02", "geocode": "37.7764685,-122.4172004,10km", "geotaggedNear": "Los Angeles", "inReplyTo": "webexpo", "includeSearchTerms": false, "maxItems": 1000, "mentioning": "elonmusk", "minimumFavorites": 0, "minimumReplies": 0, "minimumRetweets": 0, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "placeObjectId": "96683cc9126741d1", "sort": "Latest", "start": "2021-07-01", "startUrls": [ "https://x.com/search?q=BREAKING&src=typed_query" ], "tweetLanguage": "en", "withinRadius": "15km" }
I'm looking to extract tweets from a search link ideally with additional parameters later on like minimum retweets etc. but seems like a basic test for a simple search with the term "BREAKING" fails.
Not sure if I'm attempt to do this correctly as it seems to work when with profile links as startUrl
demonstrative_nomad
https://console.apify.com/actors/tasks/F3Nk0uhhMNMguCcsN/runs/PZnU0bIeezMNIArak#input
{ "author": "apify", "customMapFunction": "(object) => { return {...object} }", "end": "2021-07-02", "geocode": "37.7764685,-122.4172004,10km", "geotaggedNear": "Los Angeles", "inReplyTo": "webexpo", "includeSearchTerms": false, "maxItems": 1000, "mentioning": "elonmusk", "minimumFavorites": 5, "minimumReplies": 5, "minimumRetweets": 5, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "placeObjectId": "96683cc9126741d1", "searchTerms": [ "breaking" ], "sort": "Latest", "start": "2021-07-01", "tweetLanguage": "en", "withinRadius": "15km" }
no outputs when trying to use searchterms instead and searching for "breaking"
Hello,
Seems like you are applying lots of filters. Currently these runs are searching for lang:en from:apify to:webexpo @elonmusk -from:elonmusk near:"Los Angeles" within:15km geocode:37.7764685,-122.4172004,10km place:96683cc9126741d1 since:2021-07-01 until:2021-07-02, and it doesn't return any tweets.
What are you trying to achieve? Are you using the default filters of the actor? You need to clear the initial filters and use only the required ones.
Cheers
demonstrative_nomad
I'm attempting to use the search url to get relevant news that mentions "breaking". Removing filters does not seem to work or directly using search terms.
StartUrl Search Link Run: https://console.apify.com/actors/61RPP7dywgiy0JPD0/runs/vgxYxVCeHLhSlmHNK#input
SearchTerms Run: https://console.apify.com/actors/61RPP7dywgiy0JPD0/runs/lIsDMH41axDI1UtZQ#output
{ "customMapFunction": "(object) => { return {...object} }", "includeSearchTerms": false, "maxItems": 1000, "minimumFavorites": -1, "minimumReplies": -1, "minimumRetweets": -1, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "sort": "Latest", "startUrls": [ "https://x.com/search?q=breaking&src=typed_query&f=live" ], "tweetLanguage": "en" }
{ "customMapFunction": "(object) => { return {...object} }", "includeSearchTerms": false, "maxItems": 1000, "minimumFavorites": -1, "minimumReplies": -1, "minimumRetweets": -1, "onlyImage": false, "onlyQuote": false, "onlyTwitterBlue": false, "onlyVerifiedUsers": false, "onlyVideo": false, "searchTerms": [ "breaking" ], "sort": "Latest", "tweetLanguage": "en" }
Hey hey,
Can you please remove all your filters and just try with searchTerms? You are still applying -1 filters. Here is an example for your case:
Cheers!
