No credit card required

Top Twitch User Scrape

lime_incline/twitch-user-scrape

No credit card required

Get top subscribed twitch user list from twitchtracker

Twitch User Scraper

This project is an Apify actor that scrapes user data from Twitch Tracker's channel rankings. It uses the Apify SDK and Crawlee to efficiently crawl and extract information from multiple pages of Twitch channel rankings.

Features

Scrapes Twitch channel rankings from TwitchTracker.com
Supports pagination to scrape multiple pages
Configurable start and end page numbers
Option to filter by language
Uses Apify Proxy for IP rotation
Stores results in Apify Dataset

How it works

The actor reads input parameters (start page, end page, language).
It constructs URLs for each page to be scraped.
Using CheerioCrawler, it visits each page and extracts channel data.
The extracted data is pushed to an Apify Dataset.

Input

The actor accepts the following input parameters:

startPage: The page number to start scraping from (default: 1)
endPage: The page number to end scraping at (default: 150)
language: The language of channels to scrape (default: "english", leave empty for all languages)
proxyConfiguration: Proxy settings for the scraper

Output

The actor outputs a dataset with the following structure for each channel:

rank: Channel rank
name: Channel name
channellink: Link to the channel
avgViewers: Average number of viewers
hoursStreamed: Hours streamed
peakViewers: Peak number of viewers
hoursWatched: Total hours watched
activeRank: Active rank
followersGained: Number of followers gained
followers: Total number of followers
viewsGained: Number of views gained

Usage

Clone this repository
Install dependencies with npm install
Run the actor locally with apify run

To deploy to the Apify platform:

Log in to Apify: apify login
Deploy the actor: apify push

Customization

You can modify the src/main.js file to change the scraping logic or add new features. The input schema can be adjusted in the .actor/input_schema.json file.

Resources

License

This project is licensed under the ISC License.

Developer

Zee

Actor Metrics

1 monthly user
1 star
>99% runs succeeded
Created in Jul 2024
Modified 5 months ago

Categories

Social media

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

62.3k

604

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15.8k

207

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

18k

243

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

10.4k

249

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.4k

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

7.2k

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

21.7k

172

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

9.1k

365

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

16.5k

117