Twitter Scraper avatar

Twitter Scraper

Deprecated
Go to Store
This Actor is deprecated

This Actor is unavailable because the developer has decided to deprecate it. Would you like to try a similar Actor instead?

See alternative Actors
Twitter Scraper

Twitter Scraper

microworlds/twitter-scraper

Twitter Scraper searches and extracts data from Twitter (with historic data from 2006) - parses and converts the data to structured formats: HTML table, JSON, CSV, Excel and XML.

What search terms do you want to scrape?

searchTermsarrayOptional

If you add search terms, the scraper will find and extract tweets that mention those terms. Alternatively, see further down to scrape by Twitter URL.

Do you want to filter by content?

searchModeEnumOptional

This setting will change how the data is received by the scraper. Setting it to latest yields more results.

Value options:

"top": string"live": string

Default value of this property is "live"

Maximum number of tweets

maxTweetsintegerOptional

This value lets you set the maximum number of tweets to retrieve. Twitter has a default limit of around 800 tweets per query. Check the README for workarounds.

Default value of this property is 1000

Maximum number of tweets per query

maxTweetsPerQueryintegerOptional

This value lets you set the maximum number of tweets to retrieve per query.

Default value of this property is 1000

Number of request retries

maxRequestRetriesintegerOptional

Number of times to retry when the run fails.

Default value of this property is 6

Add user information

addUserInfobooleanOptional

Appends an object to each tweet containing the user information. You can decrease the size of your dataset by turning this off.

Default value of this property is true

Scrape tweet replies

scrapeTweetRepliesbooleanOptional

Enable if you want to extract both tweet details and the replies. Disabling it will return only the tweet details, no replies.

Default value of this property is true

Tweets from this date

sinceDatestringOptional

Scrape tweets starting from this date

Tweets until this date

untilDatestringOptional

Scrape tweets until this date

Do you want to scrape by Twitter handle?

handlearrayOptional

You can add the twitter handles of specific profiles you want to scrape. This is a shortcut so that you don't have to add full username URLs like https://twitter.com/apify.

Do you want to scrape by Twitter URL?

urlsarrayOptional

This lets you tell the scraper where to start. You can enter Twitter URLs one by one. You can also link to or upload a text file with a list of URLs

Developer
Maintained by Community
Categories