Best Twitter Scraper
No credit card required
Best Twitter Scraper
No credit card required
Twitter scraper that scrapes the latest Twitter content of any user. Since you need to be logged in to Twitter to crawl, you need to provide a Twitter account. Twitter 抓取器，可以抓取任意用户最新的Twitter内容。 因为需要先登录 Twitter 才能抓取，所以需要提供一个 Twitter 的账号。
Specific Twitter Profiles
namesarrayOptional
Provide a list of Twitter profiles to scrape. The profiles should be written as 'username'.Scrape from https://twitter.com/{username}
Specific Tweet URLs
tweet_urlsarrayOptional
List the twitter search URLs you want to scape such as 'https://twitter.com/elonmusk/status/1656898688739057665' if your url contains more such as a cursor like 'https://twitter.com/elonmusk/status/1656898688739057665?s=20' only the tweets on the current screen will be loaded.
Twitter Search URLs
search_urlsarrayOptional
List the full links to tweets you want to scape such as 'https://twitter.com/search?q=((MadMaxFuryRoad%20OR%20MadMax%20OR%20%22FuryRoad%22%20OR%20%22GeorgeMiller%22%20OR%20GeorgeMiller%20OR%20TomHardy%20OR%20%22CharlizeTheron%22%20OR%20CharlizeTheron)%20AND%20(Film%20OR%20Movie%20OR%20Review))&src=typed_query&f=top' if your url contains more such as a cursor only the tweets on the current screen will be loaded.
Maximum number of tweets (per profile)
max_tweetsintegerOptional
Set the maximum number of tweets get from per request. Default:10
Default value of this property is 10
Max PageDown Event
max_pagedownintegerOptional
Set the maximum number of a keyboard 'PageDown' event sent to the page. Default:100.
Default value of this property is 20
Concurrent Requests
concurrent_requestsintegerOptional
Configure maximum concurrent requests performed by Scrapy (default: 2)
Default value of this property is 2
Locale
localestringOptional
Specify user locale, for example en-GB, de-DE, etc. Locale will affect navigator.language value, Accept-Language request header value as well as number and date formatting rules. Default:en-US.
Default value of this property is "en-US"
Timezone
timezone_idstringOptional
Changes the timezone of the context. See ICU's metaZones.txt for a list of supported timezone IDs.
zhang zhenhu- 22 monthly users
- 1 star
- 84.5% runs succeeded
- Created in Aug 2023
- Modified about 1 year ago
