![Twitter Scraper avatar](https://images.apifyusercontent.com/thSdIYEaPYbSW8Hb66-ZMlEFk9UFEQusUxDPW9uifao/rs:fill:250:250/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMudXMtZWFzdC0xLmFtYXpvbmF3cy5jb20vaGVMTDZmVW9mZFBnUlhaaWUvNElYdG1jaWQ4MmY5b2dKVUctdHdpdHRlci5wbmc.webp)
Pay $1.50 for 1,000 tweets
![Twitter Scraper](https://images.apifyusercontent.com/thSdIYEaPYbSW8Hb66-ZMlEFk9UFEQusUxDPW9uifao/rs:fill:250:250/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMudXMtZWFzdC0xLmFtYXpvbmF3cy5jb20vaGVMTDZmVW9mZFBnUlhaaWUvNElYdG1jaWQ4MmY5b2dKVUctdHdpdHRlci5wbmc.webp)
Twitter Scraper
Pay $1.50 for 1,000 tweets
Twitter Scraper searches and extracts data from Twitter (with historic data from 2006) - parses and converts the data to structured formats: HTML table, JSON, CSV, Excel and XML.
return few tweets than expected within data range
Open
I got only one-week data even though I have provided the date range from 2021 Jan
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
Hi, the issue is currently investigated. Thanks!
optimistic_elixir
range is over ten months, it gives only 5 tweets!
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
Hi earthy_myrtle,
To pull more results, you can split the search URL based on close time ranges. Please take a look at this section of the documentation. I'd advise setting the date ranges based on weeks, not months (and not 10 months, as in your case). https://apify.com/microworlds/twitter-scraper#limitation-and-solution. Please let me know if this helps.
Thanks! 😊
optimistic_elixir
Thank you, I still get only 5 results. I removed date range and kept it open.
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
No, removing date ranges could significantly lower the number of results. Please provide me with the search URL so I can generate a suitable set of input URLs for you.
optimistic_elixir
I search by terms and keywords not URL.
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
Okay, can you share a sample run id - I can generate the relevant URLs that can pull more results
optimistic_elixir
Here it is: XbeyOdmtq1kAtNT40
earthy_myrtle
Hi Caleb, Any updates on the issue why its giving only one-week data even though I have provided the date range from 2021 Jan?
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
@earthy_myrtle: Sorry for the mix-up. The response above is for you (I'll paste it below this): "To pull more results, you can split the search URL based on close time ranges. Please take a look at this section of the documentation. I'd advise setting the date ranges based on weeks, not months (and not 10 months, as in your case). https://apify.com/microworlds/twitter-scraper#limitation-and-solution."
@optimistic_elixir:
You see to be on Apify free plan - in which the actor limits the possibility of extracting results beyond 5
. Please consider upgrading your plan on Apify here - https://apify.com/pricing or contact support@apify.com. Hope that helps
earthy_myrtle
Hi caleb I want to crawl hastags, hastag crawl didn't require url right? and one more thing I want data from "Jan 2021 to today" not from 10 months. so I dont think setting date range based on week will be feasible for us. could you please suggest alternate way?
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
Hi earthy_myrtle, I have generated the relevant search URLs for your query. So instead of the input below:
1{ 2 "addUserInfo": false, 3 "maxRequestRetries": 6, 4 "maxTweets": 20000, 5 "maxTweetsPerQuery": 2000, 6 "scrapeTweetReplies": false, 7 "searchMode": "live", 8 "searchTerms": [ 9 "AlinmaBankSA" 10 ], 11 "sinceDate": "2021-01-01", 12 "untilDate": "2024-07-22" 13}
Now you can add these URLs to the actor in the "URLs" section https://shots.screenshotpal.com/twitter_actor_urls.txt
That will extract all the tweets AlinmaBankSA until:2024-07-22 since:2021-01-01
So here's how to inject it (see image):
Hope this helps
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
Running this will take some some time, so I recommend setting the timeout to 0
.
Regarding hashtag crawls, they work 100% like searches - you can use keywords or URLs. If you provide the hashtags, I can generate the queries for you as well.
Hope that helps 😊
earthy_myrtle
Hi Caleb, thank you for the reply this are the hashtags i want to crawl could you please generate the queries for this, from the date range since : 2021-01-01 to 2024-07-31 (today): AlinmaBankSA, snbalahli, SAIBLIVE, RiyadBank, alrajhibank, anb_bank, alawwalsab, BankAlbilad
nurturing_knight
I am getting 5 results for every search while i put 50 results desired
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
@earthy_myrtle: Sure, I'm on it.
@nurturing_knight: You see to be on Apify free plan - in which the actor limits the possibility of extracting results beyond 5. Please consider upgrading your plan on Apify here - https://apify.com/pricing or contact support@apify.com. Hope that helps
![microworlds avatar](https://apify-image-uploads-prod.s3.us-east-1.amazonaws.com/zfto2hEmnXPyH8KJy/iBELlQ4pf2F1A7aM0-20240405_165603.jpg)
Hi @earthy_myrtle, sorry for the delayed response. Here are the generated hashtags from 2021-01-01 to 2024-08-06 (today):
- https://shots.screenshotpal.com/hashtags/AlinmaBankSA.txt
- https://shots.screenshotpal.com/hashtags/snbalahli.txt
- https://shots.screenshotpal.com/hashtags/SAIBLIVE.txt
- https://shots.screenshotpal.com/hashtags/RiyadBank.txt
- https://shots.screenshotpal.com/hashtags/alrajhibank.txt
- https://shots.screenshotpal.com/hashtags/anb_bank.txt
- https://shots.screenshotpal.com/hashtags/alawwalsab.txt
- https://shots.screenshotpal.com/hashtags/BankAlbilad.txt
Cheers!
Providence
Hi Caleb: I'm also getting the problem that the actor only returns 5 tweets, I want to scrape twitter for tweets #USElection2024 and especially from July to August, and I use Make to run it but it doesn't seem to work
mustard_poppy
I am getting the same issue. No matter which settings do I introduce, the number of returned tweets never exceeds 5.
- 708 monthly users
- 57 stars
- 99.4% runs succeeded
- 3.9 days response time
- Created in Jul 2023
- Modified 18 days ago