Youtube Channel Scrapper avatar

Youtube Channel Scrapper

Try for free

Pay $2.50 for 1,000 videos

Go to Store
Youtube Channel Scrapper

Youtube Channel Scrapper

deeper/youtube-channel-scrapper
Try for free

Pay $2.50 for 1,000 videos

Scrape YouTube Channel pages from page URL. There is not much configuration as it uses initial data available on page load. You'll get video Id, title, descriptions, #likes, #comments, #views and similar information for channels. Feel free to try it out with our default settings by hitting ▷ Start.

CL

This only scraped 30 results!!

Closed

cardinal_lobster opened this issue
a year ago

i input this https://www.youtube.com/@crashcourse/videos and i run and run repeatedly but stayed the same 30 results!! pls fix pls!! your scraper is the only one scraping well here but only scraper 30 and not all videos!! also pls add date posted in the scraped data!!

deeper avatar

Hi @cardinal_lobster,

If you have a look at the FAQ for this scrapper, you would see than we only scrap the 30 most recent videos of a channel. That's a technical limitation coming from "how" we scrap youtube using pure html code. The advantage of the technique is that it's fast and reliable. There are other youtube scrapper available if you need to collect ALL videos.

This scrapper is more dedicated in scrapping NEW videos on a daily/weekly basis on many channels. What I would suggest you is to scrap only new videos by settings a dateFilter in order to retrieve only videos that you have not scrapped yet Here is an example: { "dateFilter": "2023-09-01", "details": true, "start_urls": [ { "url": "https://www.youtube.com/@crashcourse/videos" } ] }

I don't understand your request regarding the "data posted". The published date of the video is already part of the results returned by the scrapper. See field name "date" in the results: Note that sometimes the date must be estimated from the "X days ago" statement on youtube, so it can happen that the date is not super precise, but it's better than nothing. Here is an example of results for your channel of interest: { "id": "4joZpdXeS4A", "date": "2023-10-03", "title": "Why do we have different skin colors? (Population Genetics): Crash Course Biology #14", "text": "In this episode of Crash Course Biology, we’ll learn about the ways population genetics reveals how groups of ... [trimmed]

Developer
Maintained by Community

Actor Metrics

  • 33 monthly users

  • 7 stars

  • >99% runs succeeded

  • 11 days response time

  • Created in Sep 2023

  • Modified 9 months ago