Y Combinator Companies Scraper
Pricing
from $1.40 / 1,000 results
Y Combinator Companies Scraper
Scrapes the Y Combinator startup directory by industry. Each row carries company name, description, YC batch, location, logo and social links, with optional founders, team size, tags and open job postings.
Pricing
from $1.40 / 1,000 results
Rating
0.0
(0)
Developer
Ibnu Adzim
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Share
Scrapes the Y Combinator startup directory by industry. YC is the most prominent startup accelerator in the world — its company directory is startup/business intelligence data that has not existed anywhere in this portfolio before.
What each row contains
- Name, one-liner and long description
- YC batch (e.g. W24, S23) and year founded
- Location — city and country
- Logo and social links (website, LinkedIn, Twitter/X, GitHub, Crunchbase)
- With
includeCompanyDetails: founders (names, roles, LinkedIn), team size, tags, and open job postings
Record types
recordType | One per | Purpose |
|---|---|---|
SEARCH_SUMMARY | industry | upstream's own page count, requests spent |
COMPANY | company | the company itself, upstream shape preserved |
ERROR | failed input | so every input maps to at least one row |
Industry is the only filter offered, and it's a real, current list
industry is validated against Y Combinator's own sitemap, fetched once
per run — not a hardcoded list that could go stale as YC adds categories. An
unrecognised value is refused before any crawl, with the real list included
in the error.
A location filter also exists on the site, but is deliberately not
offered here: an unresolvable location silently substitutes an unrelated
result set rather than erroring, and — unlike industry — there is no
authoritative list of valid location slugs to validate against. Rather than
offer a filter that can quietly return the wrong data, it's left out
entirely; every company's own city/country/location fields are still
in the output for filtering downstream.
Input
| Field | Notes |
|---|---|
industry | One YC industry slug, e.g. developer-tools, fintech, generative-ai |
industries | Optional array to run several industries in one call |
includeCompanyDetails | One extra request per company, for founders/team/tags/jobs |
maxItems | Per industry |
Example
Known limits
- No location filter (see above).
- Free-text search (
?query=) was tested and found completely inert on this surface — not offered. - A company can appear under more than one industry if YC tags it that way;
running several industries in one call may produce the same company more
than once across different
SEARCH_SUMMARYgroups (each is scoped to its own industry, by design — the same way a multi-location real-estate crawl in this portfolio can return the same listing from an overlapping area).
Anti-bot
None. Seven TLS fingerprints tested on both list and detail pages returned
clean data every time. The Actor still rotates fingerprints on transient
failure and defaults to residential proxy, since cloud egress can be
fingerprinted differently from a local test — an earlier actor in this
portfolio (eFinancialCareers) found exactly that gap on its first cloud run.
robots.txt's /companies?* (query-string) path is never used by this
Actor — it works entirely through the unrestricted
/companies/industry/{slug} and /companies/{slug} path segments.
