🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper avatar

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

Try for free

Pay $0.40 for 1,000 tweets

Go to Store
🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper
Try for free

Pay $0.40 for 1,000 tweets

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

PK

The maxItems limit is applied to the entire job

Closed

pksd opened this issue
5 months ago

I need to fetch tweets/retweets/replies/quotes from multiple users using the startUrls and need to apply a limit individually to each profile (while sorting by recency, ideally giving a start date but i guess that isn't possible). But seems there is no way to do this

PK

pksd

5 months ago

I understand this isn't a issue. But didn't find anything regarding this in the docs

Tried this https://apify.com/apidojo/tweet-scraper#fetching-the-tweets-of-a-profile But it only fetches tweets and not the retweets/quotes/replies

apidojo avatar

API Dojo (apidojo)

5 months ago

Hey there,

The limit is applied to the entire run. If you want to have separate limits, you need to initiate separate runs.

Cheers!

apidojo avatar

API Dojo (apidojo)

5 months ago

Also for your other question, have you checked the documentation we shard on the readme https://github.com/igorbrigadir/twitter-advanced-search ? You can apply several filters including include:nativeretweet to improve your search

PK

pksd

5 months ago

Hey I did check it out. But this wouldn't return quotes and replies right?

Also is there any way to combine startUrls and filtering based on start-end dates (instead of using maxItems)

PK

pksd

5 months ago

Hey I did check it out. But this wouldn't return quotes and replies right?

Also is there any way to combine startUrls and filtering based on start-end dates (instead of using maxItems)

PK

pksd

5 months ago

My bad by using include:nativeretweets, we get everything

NI

nihir

4 months ago

Any chance you'd be able to support limits per profile? Not sure how your scraper works on the backend, but would have thought that reducing the number of requests the client makes would reduce overhead from spinning up new instances

apidojo avatar

API Dojo (apidojo)

4 months ago

Hello,

Unfortunately we don't support that. The workaround is to create a run for each of the profile if you want to use mxItems feature.

Cheers!

Developer
Maintained by Community

Actor Metrics

  • 1.7k monthly users

  • 431 stars

  • 88% runs succeeded

  • 3.4 hours response time

  • Created in Nov 2023

  • Modified 2 hours ago