🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper avatar
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper
Try for free

Pay $0.30 for 1,000 tweets

View all Actors
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper
Try for free

Pay $0.30 for 1,000 tweets

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

User avatar

parameters 'maxItems' and 'maxTweetsPerQuery' not working

Closed

humorous_ghost opened this issue
19 days ago

hi! I am accessing the actor through API client to scrape a few tweets as a test before my project. It's a 4 companies * 3 days loop. Yet the 'maxItems' and 'maxTweetsPerQuery' in the input are not working, I set them as 1 for small test and it gave me 7 outputs. I need to control the number of tweets analyzed(exactly 200 or 300 each company) in my research project. Please help me look into this issue, thank you!

User avatar

Hey hey,

If you define maxItems, the actor signals itself to stop at that number. In your case, the actor is trying to stop itself at the total number of results at maxItems number. However, the actor is extremely fast. Therefore, this field does not guarantee the limitation. If you want to get more, you can remove this field. If you want to get less, I'd strongly suggest you to use the limitation on Dataset.

Luckily, Apify provides a limit functionality in the Dataset. This means that you can restrict the total number of output items that you retrieve from the Dataset. I saw that you are using the Python SDK. There should be a limit attribute in the iterate_items that you can use. Reference: https://docs.apify.com/sdk/python/reference/class/Dataset#iterate_items

For further discussion, we can connect via Discord.

Cheers

Developer
Maintained by Community
Actor metrics
  • 1k monthly users
  • 95.9% runs succeeded
  • 0.29 days response time
  • Created in Nov 2023
  • Modified about 8 hours ago