1 day trial then $15.00/month - No credit card required now

YouTube Full Channel Transcripts Extractor

karamelo/youtube-full-channel-transcripts-extractor

1 day trial then $15.00/month - No credit card required now

With only the channel link You can extract 1 to 1000s of all the transcripts of a channel, be it videos or shorts or streams/lives or even podcasts and playlists, you name it. Get all the transcripts/captions organized with video ID and title in a nice table or JSON or CSV to download.

Back to issues Create new issue

120 limit on youtube channels

Open

ultramarine_lute opened this issue

No matter what yt channel I use your api on it always limits me to 120 videos - is there a way to go beyong this?

karamelo (karamelo)

Please share the actor run. I will take a look

ultramarine_lute

https://console.apify.com/view/runs/rZeA24mJQGi5bmExH Also, I'm pretty sure it's not pulling the full transcripts either, they look truncated.

karamelo (karamelo)

I think the number of total videos found is the Real total. In the actor run it is logged "120 videos found". The number given by YouTube in the Channel page is misleading.

karamelo (karamelo)

You Can increase the scrap'n'scroll retries in the input page to confirm that

ultramarine_lute

So I tried a different youtube page and it again showed 120 which is practically impossible no?

karamelo (karamelo)

Yes that's strange 🤔. Give me more Time i will run sommes tests on différent Channels. May take some time

karamelo (karamelo)

The issue was in the waiting Time for scrap'n'scroll. I increased the waiting Time to 5 seconds. It seems that the youtube page loading Time takes longer. I will make it customisable tomorrow. Sorry for the inconvenience. Increase the retries to 10.

karamelo (karamelo)

Hi ultramarine_lute, the problem is solved. Thanks for bringing to my attention this flaw, now the code scrolls adequately until the end of the page and grabs all the available video links. The timeout for waiting is no longer needed as the code handles all the necessary logic. If you have any issue please feel free to contact me

ultramarine_lute

Awesome, tyvm. Btw do you have a similar scraper for websites using their sitemap or RSS feed?

karamelo (karamelo)

sitemap or RSS feed? no, but I will add this to my todo list and code it asap :)

ultramarine_lute

Ok, lmk once ready. It's the same idea for LLM integration that a YouTube channel caught my interest and many will want this too.

Add comment

Developer

karamelo

Actor Metrics

21 monthly users
7 stars
96% runs succeeded
9.4 hours response time
Created in Jul 2024
Modified 6 days ago

Categories

Social media

Videos

Developer tools

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

26.7k

658

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

59.1k

504

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15k

190

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

17k

198

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.6k

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

9.5k

198

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

71.5k

224

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.2k

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

6.8k

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

20.5k

150