Yooo thanks for the heads up. So if you are scraping a channel, then the channel info will be null, because I assume you know what channel you're on because you provided the channel, but yeah I need to improve that somehow by either not showing the channel info or getting it somehow

It's also missing chapter data. I ran a few scrapes today and it's missed the chapter data on all of my bigger runs. I've tried channel I'd or just pasting all the links as well.

Happy to help out my man but I'm gonna need some more info to help debug

For example, the 1291 qty run had no option to export chapters, and the Input was 3 channels. The only runs I've made so far today are of those 3 channels. Some have chapters, some don't. It's just not always grabbing all of the metadata. I was missing publish date on some too but I lost where those specific links were

The 1290 was every video I've tried to scrape today, the rest of the runs are grabbing the videos in different batches or amounts. Some of the runs have chapters, which should mean the run of 1290 also should have had metadata. Sorry if this is complicated, I just ran and tried stuff too much to remember exactly what and when

Hmm, would it be possible to paste your inputs here? Or email me adrian@thewebscrapingguy.com Not sure if I can look back at your past runs on apify. But will try to

The run of 1290 was 3 channel links https://www.youtube.com/@DanBacon_/videos https://www.youtube.com/@askvinh/videos https://www.youtube.com/@AndreiJikh/videos

The other runs were individual video links of those 3. All the other runs were either me trying those 3 links, or doing a run of the videos of either of those 3, but only one links from one channel per run

[https://yt3.googleusercontent.com/ytc/AIdro_ldXUfcuEwHnjU5vc9I6i-aTCPS0AuLBajd_RoNKhhHGnY=s900-c-k-c0x00ffffff-no-rj]https://www.youtube.com/@AndreiJikh/videos Andrei Jikh - YouTubehttps://www.youtube.com/@AndreiJikh/videos I will NEVER contact you for business or promotions (even if it comes from my legit email). I will not use IG, Telegram, or whatsapp to reach out - please ig... www.youtube.com

Awesome thank you! Will take a look tonight

Oh ok I think I see the issue. The responses are purposefully different when you provide just the video links vs the channel and then get the videos (hence the reason you see chapters in some and and no meta data in others)

But yeah I realize thats not the greatest experience. I'll make them consistent. Might take me a bit of time since it requires a little bit of refactoring, but will try to have it done tonight.

Thanks a lot, I appreciate whatever you can do. What do I need to do to get the clearest data? Since I don't know how to get speaker data to separate some of the transcript, the chapters are the only other way I can break it up. I know some videos just don't have them to begin with though. Anyway it's cool and thanks for whatever you can do

No worries! Try it now, I think I have it to what you want, but let me know 🤙

Hey man, this working ok? Will close the issue if its working well

Ive been at work all day sorry, won't get to try till later tonight

It's working well, thanks a lot man. Does it matter if I use @channel links or @channel/video ?

Do you think it would be hard to add a date function? Like grab all videos between xxxx-xxxx? Ideally I'd like to be able to run this occasionally to update all the channels im grabbing. If it wouldn't be too bad then I could use this scraper for forever. I wouldn't mind paying you for the addition. Just wondering, thanks for everything

I don't think so! I think you could use either and be good.

Like using youtube search? Or just grabbing the videos from a specific channel in a date range?

Nope not yt search. I mean I have 20-30 channels I'd like to keep my transcripts updated with. If there were some kind of date range I could use, I could add all channels to the channel list and just run it once a month or two with a date range, Instead of having to grab all the links manually. After I do this initial sweep it's gonna take a lot more time to do this without getting a bunch of duplicates

I can look into it! See how hard it would be. Should get back to you by Monday night

I appreciate that, ty

Yo yeah if you could pay me something, that would be cool 😅 I'm just not sure if others would want it or not, and it will be a decent lift because I'd have to come up with something custom

Shoot me a number