Best Twitter Scraper

No credit card required

Best Twitter Scraper

Best Twitter Scraper

zhangzhenhu/best-twitter-scraper

No credit card required

Twitter scraper that scrapes the latest Twitter content of any user. Since you need to be logged in to Twitter to crawl, you need to provide a Twitter account. Twitter 抓取器,可以抓取任意用户最新的Twitter内容。 因为需要先登录 Twitter 才能抓取,所以需要提供一个 Twitter 的账号。

email

login_email
string
Optional

The Email for logged in accounts

user name

login_user
string
Required

The user name for logged in accounts

password

login_password
string
Required

The password for logged in accounts

Specific Twitter Profiles

names
array
Optional

Provide a list of Twitter profiles to scrape. The profiles should be written as 'username'.Scrape from https://twitter.com/{username}

Specific Tweet URLs

tweet_urls
array
Optional

List the twitter search URLs you want to scape such as 'https://twitter.com/elonmusk/status/1656898688739057665' if your url contains more such as a cursor like 'https://twitter.com/elonmusk/status/1656898688739057665?s=20' only the tweets on the current screen will be loaded.

Twitter Search URLs

search_urls
array
Optional

Maximum number of tweets (per profile)

max_tweets
integer
Optional

Set the maximum number of tweets get from per request. Default:10

Default value of this property is

10

Max PageDown Event

max_pagedown
integer
Optional

Set the maximum number of a keyboard 'PageDown' event sent to the page. Default:100.

Default value of this property is

20

Concurrent Requests

concurrent_requests
integer
Optional

Configure maximum concurrent requests performed by Scrapy (default: 2)

Default value of this property is

2

Locale

locale
string
Optional

Specify user locale, for example en-GB, de-DE, etc. Locale will affect navigator.language value, Accept-Language request header value as well as number and date formatting rules. Default:en-US.

Default value of this property is

"en-US"

Timezone

timezone_id
string
Optional

Changes the timezone of the context. See ICU's metaZones.txt for a list of supported timezone IDs.

timeout

timeout
integer
Optional

Default value of this property is

4000
Developer
Maintained by Community
Actor stats
  • 213 users
  • 543 runs
  • Modified 3 months ago
Categories

You might also like these Actors