Top Twitch User Scrape avatar

Top Twitch User Scrape

Try for free

No credit card required

Go to Store
Top Twitch User Scrape

Top Twitch User Scrape

lime_incline/twitch-user-scrape
Try for free

No credit card required

Get top subscribed twitch user list from twitchtracker

Twitch User Scraper

This project is an Apify actor that scrapes user data from Twitch Tracker's channel rankings. It uses the Apify SDK and Crawlee to efficiently crawl and extract information from multiple pages of Twitch channel rankings.

Features

  • Scrapes Twitch channel rankings from TwitchTracker.com
  • Supports pagination to scrape multiple pages
  • Configurable start and end page numbers
  • Option to filter by language
  • Uses Apify Proxy for IP rotation
  • Stores results in Apify Dataset

How it works

  1. The actor reads input parameters (start page, end page, language).
  2. It constructs URLs for each page to be scraped.
  3. Using CheerioCrawler, it visits each page and extracts channel data.
  4. The extracted data is pushed to an Apify Dataset.

Input

The actor accepts the following input parameters:

  • startPage: The page number to start scraping from (default: 1)
  • endPage: The page number to end scraping at (default: 150)
  • language: The language of channels to scrape (default: "english", leave empty for all languages)
  • proxyConfiguration: Proxy settings for the scraper

Output

The actor outputs a dataset with the following structure for each channel:

  • rank: Channel rank
  • name: Channel name
  • channellink: Link to the channel
  • avgViewers: Average number of viewers
  • hoursStreamed: Hours streamed
  • peakViewers: Peak number of viewers
  • hoursWatched: Total hours watched
  • activeRank: Active rank
  • followersGained: Number of followers gained
  • followers: Total number of followers
  • viewsGained: Number of views gained

Usage

  1. Clone this repository
  2. Install dependencies with npm install
  3. Run the actor locally with apify run

To deploy to the Apify platform:

  1. Log in to Apify: apify login
  2. Deploy the actor: apify push

Customization

You can modify the src/main.js file to change the scraping logic or add new features. The input schema can be adjusted in the .actor/input_schema.json file.

Resources

License

This project is licensed under the ISC License.

Developer
Maintained by Community

Actor Metrics

  • 1 monthly user

  • 1 star

  • >99% runs succeeded

  • Created in Jul 2024

  • Modified 5 months ago

Categories