Y-Combinator_companies_and_jobs_scraper

Hi i am hanuman web scraper from india and passinate to build scrapers. which helps user or any organisation today i built y-combinator scraper roughly there are 4700 companies and which produce 1000 daily jobs feel free to test it out i have added features to extract all data companonents present in y-combinator website

new feature

hey guys new cool feature is out for y combinator_scraper we can query scrap companies based on region, industries, company batch, ishiring,topcompanies,womenfounded,blackfounded all that features available in real website that can be performed by my scrapper feel free to test it and please consider buying subscribe version and feel free to email me for future updates if it is using too much time or platform cost raise issue i will send you my email for collab

details

1] What does y-combinator_scraper do?

it extract various companies founders of companies news from companies and latest jobs from the companies

what data you can extract

Company data fields

🔍 data fields
📰 companyTitle
🌐 companyDescriptionUrl
🔗 logoUrl
🌍 companyAddress
📝 company Description
📊 founders name
📅 founders description
🏢 founders linkedin
📊 news title
🚪 news url
🎓 jobs title in company
🏫 jobs req experience
👩‍🎓 jobs address
🗂 jobs description

input

see this pic or image json format for which i have tested you can choose any batch any region any input you want feel free to test it

[https://drive.google.com/file/d/1jGNfyWZDOfgS-kVf_-STpiPaTCnelo-b/view?usp=sharing]

here example in json format

1{
2    "batch": [
3        "S24",
4        "W24"
5    ],
6    "company_Limit": 10,
7    "highlight_black": false,
8    "highlight_latinx": false,
9    "highlight_women": false,
10    "industry": [
11        "Engineering, Product and Design"
12    ],
13    "isHiring": true,
14    "nonprofit": false,
15    "regions": [
16        "United States of America"
17    ],
18    "startUrls": [
19        {
20            "url": "https://www.ycombinator.com/companies"
21        }
22    ],
23    "top_company": false
24}

company_Limit

it is total number companies you want to extract without any duplicates

output-example

1{
2  "companyTitle": "Instacart",
3  "companyDescriptionUrl": "https://www.ycombinator.com/companies/instacart",
4  "logoUrl": "https://bookface-images.s3.amazonaws.com/small_logos/9750fca21baaee75e035f1baaf58df8e2f5dcc67.png",
5  "companyAddress": "San Francisco, CA, USA",
6  "companyDescription": "Instacart is the North American leader in online grocery and one of the fastest-growing companies in e-commerce. Instacart’s same-day delivery and pickup services bring fresh groceries and everyday essentials to busy people and families across the U.S. and Canada in as fast as an hour. Since its founding in 2012, Instacart has become an essential service for millions of families, while also serving as an immediate, flexible earnings opportunity for hundreds of thousands of shoppers across North America. The company partners with more than 350 retailers and delivers from more than 25,000 stores across more than 5,500 cities in North America. Today, Instacart is accessible to more than 85% of households in the U.S. and more than 70% of households in Canada.",
7  "founders": [
8    {
9      "name": "Apoorva Mehta",
10      "description": "Apoorva Mehta is an Indian-born American entrepreneur. He is the Founder and Chairman of the San Francisco-based on-demand online grocery shop 'Instacart.' Apoorva co-founded this venture along with Max Mullen and Brandon Leonardo in 2012. An engineering graduate from the 'University of Waterloo,' Apoorva worked for companies such as 'Blackberry,' ‘Qualcomm,’ and 'Amazon,' before he became an entrepreneur.",
11      "linkedInUrl": "https://www.linkedin.com/in/apoorvamehta/"
12    },
13    {
14      "name": "Brandon Leonardo",
15      "description": "Brandon is currently Grocery Hacker and a Co-Founder of Instacart, the same-day grocery delivery service. Brandon built the early versions of the Instacart app, and now leads the Engineering team that works on Growth. Prior to joining Instacart, Brandon held senior engineering roles at a number of other startups including AngelList, Webs and StartupBus. He holds a BS in Computer Science from SJSU and currently lives in Redwood City.",
16      "linkedInUrl": "https://www.linkedin.com/in/leonardo/"
17    },
18    {
19      "name": "Max Mullen",
20      "description": "Max is the Co-Founder of Instacart. He started the company with two co-founders in 2012. Previously, he's worked for several startups including Schematic, an award-winning interactive agency which was acquired by WPP. Max is originally from Los Angeles where he graduated from the University of Southern California, studying entrepreneurship and cinematic arts.",
21      "linkedInUrl": "https://www.linkedin.com/in/maxmullen/"
22    }
23  ],
24  "news": [
25    {
26      "title": "For Founder Apoorva Mehta, Instacart’s $9.9 Billion IPO Is The End Of The Road",
27      "url": "https://www.forbes.com/sites/richardnieva/2023/09/19/apoorva-mehta-instacart-ipo-exclusive/?sh=1c15acc65a04"
28    },
29    {
30      "title": "Instacart Prices I.P.O. at $30 a Share, Raising $660 Million - The New York Times",
31      "url": "https://www.nytimes.com/2023/09/18/technology/instacart-ipo-share-price.html"
32    },
33    {
34      "title": "Instacart files for its IPO",
35      "url": "https://www.axios.com/2023/08/25/instacart-nasdaq-ipo-date-2023"
36    },
37    {
38      "title": "Instacart launches new in-app AI search tool powered by ChatGPT | TechCrunch",
39      "url": "https://techcrunch.com/2023/05/31/instacart-in-app-ai-search-tool-powered-by-chatgpt/"
40    },
41    {
42      "title": "Instacart Is Ready for the ‘Groceryssance’ | Progressive Grocer",
43      "url": "https://progressivegrocer.com/instacart-ready-groceryssance"
44    }
45  ],
46  "jobs": [
47    {
48      "jobTitle": "Senior Software Engineer, Customers, Front End",
49      "jobDescriptionUrl": "https://www.ycombinator.com/companies/instacart/jobs/4wuq2cXZq-senior-software-engineer-customers-front-end",
50      "location": "San francisco, CA",
51      "jobExpReq": "3+ years"
52    },
53    {
54      "jobTitle": "Senior Software Engineer, Customers Back End",
55      "jobDescriptionUrl": "https://www.ycombinator.com/companies/instacart/jobs/Vc34PRHze-senior-software-engineer-customers-back-end",
56      "location": "San francisco, CA",
57      "jobExpReq": "3+ years"
58    },
59    {
60      "jobTitle": "Senior Software Engineer",
61      "jobDescriptionUrl": "https://www.ycombinator.com/companies/instacart/jobs/0XJjxk4lw-senior-software-engineer",
62      "location": "San francisco, CA / Remote",
63      "jobExpReq": "1+ years"
64    },
65    {
66      "jobTitle": "Android Engineer",
67      "jobDescriptionUrl": "https://www.ycombinator.com/companies/instacart/jobs/ZBDBmG17B-android-engineer",
68      "location": "San francisco, CA",
69      "jobExpReq": "3+ years"
70    },
71    {
72      "jobTitle": "Senior iOS Engineer",
73      "jobDescriptionUrl": "https://www.ycombinator.com/companies/instacart/jobs/4uSrVZoa1-senior-ios-engineer",
74      "location": "San francisco, CA",
75      "jobExpReq": "3+ years"
76    }
77  ]
78}