This only scraped 30 results!!

Hi @cardinal_lobster,

If you have a look at the FAQ for this scrapper, you would see than we only scrap the 30 most recent videos of a channel. That's a technical limitation coming from "how" we scrap youtube using pure html code. The advantage of the technique is that it's fast and reliable. There are other youtube scrapper available if you need to collect ALL videos.

This scrapper is more dedicated in scrapping NEW videos on a daily/weekly basis on many channels. What I would suggest you is to scrap only new videos by settings a dateFilter in order to retrieve only videos that you have not scrapped yet Here is an example: { "dateFilter": "2023-09-01", "details": true, "start_urls": [ { "url": "https://www.youtube.com/@crashcourse/videos" } ] }

I don't understand your request regarding the "data posted". The published date of the video is already part of the results returned by the scrapper. See field name "date" in the results: Note that sometimes the date must be estimated from the "X days ago" statement on youtube, so it can happen that the date is not super precise, but it's better than nothing. Here is an example of results for your channel of interest: { "id": "4joZpdXeS4A", "date": "2023-10-03", "title": "Why do we have different skin colors? (Population Genetics): Crash Course Biology #14", "text": "In this episode of Crash Course Biology, we’ll learn about the ways population genetics reveals how groups of living things evolve—by comparing genetic similarities and differences. We’ll discover the most genetically diverse species of all (hint: it’s not us), find out why “race” isn’t the biologically valid category we’ve made it out to be, and learn there’s much more in our DNA that we share than that sets us apart.\n\nChapters:\nPopulation Genetics 00:00\nGenetic Diversity 2:34\nLevels of Genetic Diversity 3:56\nMelanin Variation 5:57\nClines & Ancestry 8:13\nRace & Society 8:51\nReview & Credits 11:32\n\nThis series was produced in collaboration with HHMI BioInteractive, committed to empowering educators and inspiring students with engaging, accessible, and quality classroom resources. Visit https://BioInteractive.org/CrashCourse for more information.\n\nCheck out our Biology playlist here: • Biology \n\nWatch this series in Spanish on our Crash Course en Español channel here: • Crash Course Biología \n\nSources: https://docs.google.com/document/d/1G... \n\n\n***\nCrash Course is on Patreon! You can support us directly by signing up at http://www.patreon.com/crashcourse\n\nThanks to the following patrons for their generous monthly contributions that help keep Crash Course free for everyone forever:\nTawny Whaley, Sean Saunders, DL Singfield, Ken Davidian, Stephen Akuffo, Toni Miles, Steve Segreto, Kyle & Katherine Callahan, Laurel Stevens, Burt Humburg, Aziz Y, Perry Joyce, Scott Harrison, Mark & Susan Billian, Alan Bridgeman, Breanna Bosso, Matt Curls, Jennifer Killen, Starstuff42, Jon Allen, Sarah & Nathan Catchings, team dorsey, Bernardo Garza, Trevin Beattie, Eric Koslow, Indija-ka Siriwardena, Jason Rostoker, Siobhán, Ken Penttinen, Nathan Taylor, Les Aker, William McGraw, ClareG, Rizwan Kassim, Constance Urist, Alex Hackman, Pineapples of Solidarity, Katie Dean, Stephen McCandless, Wai Jack Sin, Ian Dundore, Caleb Weeks. \n__\n\nWant to find Crash Course elsewhere on the internet?\nInstagram - https://www.instagram.com/thecrashcou...\nFacebook - http://www.facebook.com/YouTubeCrashC...\nTwitter - http://www.twitter.com/TheCrashCourse\n\nCC Kids: / crashcoursekids ", "duration": "12:56", "viewCount": 50420, "commentsCount": 95, "likes": 1947, "url": "https://www.youtube.com/watch?v=4joZpdXeS4A", "channelId": "UCX6b17PVsYBQ0ip5gyeme-Q", "channelShortName": "crashcourse", "channelName": "CrashCourse", "channelTotalVideos": 1400, "channelTotalViews": 1865219262, "channelUrl": "https://www.youtube.com/channel/UCX6b17PVsYBQ0ip5gyeme-Q" },