📺 YouTube Shorts Scraper

YouTube Shorts Scraper is an Apify Actor that scrapes video data and comments from a YouTube channel. It extracts key details such as video title, URL, view count, streaming time (in days), hashtags, description, comments count, and individual comments with user IDs.

🚀 Features

• ✅ Scrapes video details: title, URL, views (converted to a number), streaming time (in days), hashtags, and description.
• ✅ Extracts comments: Retrieves the total number of comments and individual comments (with user IDs and comment text) from the channel.
• ✅ Configurable scrolling: Loads additional videos using infinite scrolling with a maximum number of scroll attempts.
• ✅ Limits processing: Limits the number of videos processed per channel using configurable parameters.
• ✅ Uses Puppeteer Stealth and Proxy: Supports proxy configurations for bypassing bot detection if needed.
• ✅ Stores data in Apify Dataset: Outputs structured JSON data for easy export and further processing.

📥 Input Parameters

The Actor accepts the following input parameters:

Parameter	Type	Description	Default Value
channel	string	A YouTube channel URL.	"https://www.youtube.com/@Dior"
max_videos	integer	The maximum number of videos to process from the channel.	40
max_pages	integer	The maximum number of scroll attempts to load additional videos on the channel page.	4

Example Input

1{
2  "channel": "https://www.youtube.com/@Dior",
3  "max_videos": 40,
4  "max_pages": 4
5}

📤 Output

The Actor outputs a JSON dataset containing video details for each processed video. A sample output object is shown below:

1{
2  "id": "lQnhM3rW4GU",
3  "title": "Dior Spring-Summer 2025 Haute Couture Show",
4  "url": "https://www.youtube.com/watch?v=lQnhM3rW4GU",
5  "views": 1600000,
6  "time_text": 21,
7  "hashtags": "",
8  "description": "Spring-Summer 2025 Haute Couture by Maria Grazia Chiuri is an exploration of imaginative escapism, emanating a youthful energy influenced by Yves Saint Laurent’s debut 'Trapèze' collection for the House in 1958. The A-line silhouette liberates the body as sweeping and ruffled fabrics represent metamorphosis...",
9  "comments_count": 1376,
10  "comments": [
11    {
12      "user_id": "AA-ke5cu",
13      "user_href": "https://www.youtube.com/@AA-ke5cu",
14      "text": "My hats off to the floor engineer; this is not easy to do..."
15    },
16    {
17      "user_id": "anotherUser",
18      "user_href": "https://www.youtube.com/@anotherUser",
19      "text": "Amazing work by DIOR!"
20    }
21  ]
22}

⚙️ How It Works

Channel Page Processing:

The Actor navigates to the provided YouTube channel URL (appending /videos if necessary) and scrolls down to load more videos, based on the max_pages parameter.

Video Processing:

It extracts unique video URLs and processes up to max_videos videos. For each video, it opens a new page, waits for the metadata and comments to load, and then scrapes the required details.

Data Transformation:

The Actor converts view counts (e.g., "1.6M views") into a numeric value and converts time descriptions (e.g., "Streamed 3 weeks ago") into an approximate number of days.

Result Storage:

All scraped data is pushed to an Apify Dataset for easy access and export.

---

⚠️ Legal Disclaimer

This project is intended for educational and research purposes only. The use of this Actor must comply with YouTube's Terms of Service and robots.txt policies.

You are responsible for ensuring your use case does not violate YouTube website terms. YouTube's content and trademarks are the property of YouTube, Inc. Avoid aggressive scraping that could negatively impact YouTube’s infrastructure. If you intend to use this Actor for commercial purposes, consider reaching out to the YouTube API team for official data access.