1 day trial then $15.00/month - No credit card required now

YouTube Full Channel Transcripts Extractor

karamelo/youtube-full-channel-transcripts-extractor

1 day trial then $15.00/month - No credit card required now

With only the channel link You can extract 1 to 1000s of all the transcripts of a channel, be it videos or shorts or streams/lives or even podcasts and playlists, you name it. Get all the transcripts/captions organized with video ID and title in a nice table or JSON or CSV to download.

Back to issues Create new issue

120 limit on youtube channels

Closed

ultramarine_lute opened this issue

No matter what yt channel I use your api on it always limits me to 120 videos - is there a way to go beyong this?

karamelo (karamelo)

Please share the actor run. I will take a look

ultramarine_lute

https://console.apify.com/view/runs/rZeA24mJQGi5bmExH Also, I'm pretty sure it's not pulling the full transcripts either, they look truncated.

karamelo (karamelo)

I think the number of total videos found is the Real total. In the actor run it is logged "120 videos found". The number given by YouTube in the Channel page is misleading.

karamelo (karamelo)

You Can increase the scrap'n'scroll retries in the input page to confirm that

ultramarine_lute

So I tried a different youtube page and it again showed 120 which is practically impossible no?

karamelo (karamelo)

Yes that's strange 🤔. Give me more Time i will run sommes tests on différent Channels. May take some time

karamelo (karamelo)

The issue was in the waiting Time for scrap'n'scroll. I increased the waiting Time to 5 seconds. It seems that the youtube page loading Time takes longer. I will make it customisable tomorrow. Sorry for the inconvenience. Increase the retries to 10.

karamelo (karamelo)

Hi ultramarine_lute, the problem is solved. Thanks for bringing to my attention this flaw, now the code scrolls adequately until the end of the page and grabs all the available video links. The timeout for waiting is no longer needed as the code handles all the necessary logic. If you have any issue please feel free to contact me

ultramarine_lute

Awesome, tyvm. Btw do you have a similar scraper for websites using their sitemap or RSS feed?

karamelo (karamelo)

sitemap or RSS feed? no, but I will add this to my todo list and code it asap :)

ultramarine_lute

Ok, lmk once ready. It's the same idea for LLM integration that a YouTube channel caught my interest and many will want this too.

Add comment

Developer

karamelo

Actor Metrics

103 monthly users
16 bookmarks
98% runs succeeded
0.71 hours response time
Created in Jul 2024
Modified 11 days ago

Categories

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

36.7k

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

74.4k

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

21.3k

377

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

18.3k

285

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.4k

121

Export Instagram Comments and Posts

apify/export-instagram-comments-posts

This unique tool allows you to scrape Instagram posts and its comments in one run. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

602

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

26k

269

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

76.2k

459

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add one or more Instagram usernames and extract number of followers&follows, URLs, bio, posts, likes, counts, related profiles, captions, highlight reels. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

43.1k

330

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

8.4k