Top Twitch User Scrape
No credit card required
Top Twitch User Scrape
No credit card required
Get top subscribed twitch user list from twitchtracker
Twitch User Scraper
This project is an Apify actor that scrapes user data from Twitch Tracker's channel rankings. It uses the Apify SDK and Crawlee to efficiently crawl and extract information from multiple pages of Twitch channel rankings.
Features
- Scrapes Twitch channel rankings from TwitchTracker.com
- Supports pagination to scrape multiple pages
- Configurable start and end page numbers
- Option to filter by language
- Uses Apify Proxy for IP rotation
- Stores results in Apify Dataset
How it works
- The actor reads input parameters (start page, end page, language).
- It constructs URLs for each page to be scraped.
- Using CheerioCrawler, it visits each page and extracts channel data.
- The extracted data is pushed to an Apify Dataset.
Input
The actor accepts the following input parameters:
startPage
: The page number to start scraping from (default: 1)endPage
: The page number to end scraping at (default: 150)language
: The language of channels to scrape (default: "english", leave empty for all languages)proxyConfiguration
: Proxy settings for the scraper
Output
The actor outputs a dataset with the following structure for each channel:
rank
: Channel rankname
: Channel namechannellink
: Link to the channelavgViewers
: Average number of viewershoursStreamed
: Hours streamedpeakViewers
: Peak number of viewershoursWatched
: Total hours watchedactiveRank
: Active rankfollowersGained
: Number of followers gainedfollowers
: Total number of followersviewsGained
: Number of views gained
Usage
- Clone this repository
- Install dependencies with
npm install
- Run the actor locally with
apify run
To deploy to the Apify platform:
- Log in to Apify:
apify login
- Deploy the actor:
apify push
Customization
You can modify the src/main.js
file to change the scraping logic or add new features. The input schema can be adjusted in the .actor/input_schema.json
file.
Resources
License
This project is licensed under the ISC License.
Actor Metrics
1 monthly user
-
1 star
>99% runs succeeded
Created in Jul 2024
Modified 5 months ago