No credit card required

Top Twitch User Scrape

lime_incline/twitch-user-scrape

No credit card required

Get top subscribed twitch user list from twitchtracker

Twitch User Scraper

This project is an Apify actor that scrapes user data from Twitch Tracker's channel rankings. It uses the Apify SDK and Crawlee to efficiently crawl and extract information from multiple pages of Twitch channel rankings.

Features

Scrapes Twitch channel rankings from TwitchTracker.com
Supports pagination to scrape multiple pages
Configurable start and end page numbers
Option to filter by language
Uses Apify Proxy for IP rotation
Stores results in Apify Dataset

How it works

The actor reads input parameters (start page, end page, language).
It constructs URLs for each page to be scraped.
Using CheerioCrawler, it visits each page and extracts channel data.
The extracted data is pushed to an Apify Dataset.

Input

The actor accepts the following input parameters:

startPage: The page number to start scraping from (default: 1)
endPage: The page number to end scraping at (default: 150)
language: The language of channels to scrape (default: "english", leave empty for all languages)
proxyConfiguration: Proxy settings for the scraper

Output

The actor outputs a dataset with the following structure for each channel:

rank: Channel rank
name: Channel name
channellink: Link to the channel
avgViewers: Average number of viewers
hoursStreamed: Hours streamed
peakViewers: Peak number of viewers
hoursWatched: Total hours watched
activeRank: Active rank
followersGained: Number of followers gained
followers: Total number of followers
viewsGained: Number of views gained

Usage

Clone this repository
Install dependencies with npm install
Run the actor locally with apify run

To deploy to the Apify platform:

Log in to Apify: apify login
Deploy the actor: apify push

Customization

You can modify the src/main.js file to change the scraping logic or add new features. The input schema can be adjusted in the .actor/input_schema.json file.

Resources

License

This project is licensed under the ISC License.

Developer

Zee

Actor metrics

2 monthly users
1 star
100.0% runs succeeded
Created in Jul 2024
Modified 2 months ago

Categories

Social media

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

14.5k

118

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

12.2k

118

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

50.9k

299

Tiktok Profile Scraper

clockworks/tiktok-profile-scraper

Extract data from TikTok profiles and videos they post. Get TikTok profile data, URLs, numbers of shares, followers, comments, hearts, video and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

3.9k

203

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

190

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

17.9k

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape data from Instagram reels. Just add one or more Instagram usernames and get your data in seconds including hashtags, mentions, comments, images, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

3.7k

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add one or more Instagram usernames and extract number of followers&follows, URLs, bio, posts, likes, counts, related profiles, captions, highlight reels. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

34.4k

141

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

6.1k

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

5.6k

Where next?

Build new tools

Are you a developer? Build your own Actors and run them on Apify.

Learn more

Get a custom solution

Get a custom web scraping or RPA solution.

Book a demo