Pricing

from $7.20 / 1,000 companies

Go to Apify Store

YCombinator Scraper

Try for free

Developed by

Code Maggot

Pull YC data such as companies details, active founders, summaries, latest news, socials, websites, and latest jobs─ all from an integrated, centralized API.

0.0 (0)

Pricing

from $7.20 / 1,000 companies

Last modified

14 minutes ago

Lead generation

Developer tools

Automation

.gitignore

storage
node_modules
.venv

Dockerfile

# Apify Python actor
FROM apify/actor-python:3.11

# Copy actor code
COPY . /app
WORKDIR /app

# Install dependencies
RUN pip install --no-cache-dir -r requirements.txt

# Set default entrypoint
CMD ["python", "-m", "src"]

requirements.txt

1apify < 3.0

.actor/actor.json

{
  "actorSpecification": 1,
  "name": "ycombinator-scraper",
  "title": "YC Combinator Scraper",
  "description": "Apify actor for the YC Combinator scraper API.",
  "version": "1.0",
  "buildTag": "latest",
  "meta": {
    "template": "python"
  },
  "environmentVariables": {
    "APIFY_YC_BASE_URL": "@APIFY_YC_BASE_URL",
    "APIFY_YC_KEY_ID": "@APIFY_YC_KEY_ID",
    "APIFY_YC_KEY_SECRET": "@APIFY_YC_KEY_SECRET"
  },
  "readme": "../README.md",
  "dockerfile": "../Dockerfile",
  "input": "./input_schema.json",
  "storages": {
    "dataset": "./dataset_schema.json"
  }
}

.actor/dataset_schema.json

{
  "actorSpecification": 1,
  "fields": {
    "$schema": "http://json-schema.org/draft-07/schema#",
    "type": "object",
    "properties": {
      "job_id": {
        "type": "string",
        "description": "Unique identifier for the job"
      },
      "status": {
        "type": "string",
        "description": "Status of the job processing"
      },
      "message": {
        "type": "string",
        "description": "Status message describing the result"
      },
      "result": {
        "type": "object",
        "properties": {
          "companies": {
            "type": "array",
            "items": {
              "type": "object",
              "properties": {
                "company_url": {
                  "type": "string",
                  "description": "URL to the company profile"
                },
                "slug": {
                  "type": "string",
                  "description": "Company slug identifier"
                },
                "name": {
                  "type": "string",
                  "description": "Company name"
                },
                "small_logo_thumb_url": {
                  "type": "string",
                  "description": "URL to company logo thumbnail"
                },
                "website": {
                  "type": "string",
                  "description": "Company website URL"
                },
                "all_locations": {
                  "type": "string",
                  "description": "All company locations"
                },
                "long_description": {
                  "type": "string",
                  "description": "Detailed company description"
                },
                "one_liner": {
                  "type": "string",
                  "description": "Brief company pitch"
                },
                "team_size": {
                  "type": "integer",
                  "description": "Number of team members"
                },
                "industry": {
                  "type": "string",
                  "description": "Primary industry"
                },
                "subindustry": {
                  "type": "string",
                  "description": "Industry subcategory"
                },
                "launched_at": {
                  "type": "string",
                  "description": "Company launch date"
                },
                "tags": {
                  "type": "array",
                  "items": {
                    "type": "string"
                  },
                  "description": "Company tags"
                },
                "tags_highlighted": {
                  "type": "array",
                  "items": {
                    "type": "string"
                  },
                  "description": "Highlighted company tags"
                },
                "is_hiring": {
                  "type": "boolean",
                  "description": "Whether company is currently hiring"
                },
                "non_profit": {
                  "type": "boolean",
                  "description": "Whether company is non-profit"
                },
                "batch": {
                  "type": "string",
                  "description": "Company batch or cohort"
                },
                "status": {
                  "type": "string",
                  "description": "Company status"
                },
                "industries": {
                  "type": "array",
                  "items": {
                    "type": "string"
                  },
                  "description": "List of industries"
                },
                "regions": {
                  "type": "array",
                  "items": {
                    "type": "string"
                  },
                  "description": "Operating regions"
                },
                "stage": {
                  "type": "string",
                  "description": "Company stage"
                },
                "active_founders": {
                  "type": "array",
                  "items": {
                    "type": "object",
                    "properties": {
                      "name": {
                        "type": "string",
                        "description": "Founder name"
                      },
                      "title": {
                        "type": "string",
                        "description": "Founder title"
                      },
                      "bio": {
                        "type": "string",
                        "description": "Founder biography"
                      },
                      "avatar_url": {
                        "type": "string",
                        "description": "Founder avatar URL"
                      },
                      "social_links": {
                        "type": "object",
                        "properties": {
                          "linkedin": {
                            "type": "string",
                            "description": "LinkedIn profile URL"
                          }
                        }
                      }
                    }
                  },
                  "description": "List of active founders"
                },
                "company_socials": {
                  "type": "array",
                  "items": {
                    "type": "object",
                    "properties": {
                      "platform": {
                        "type": "string",
                        "description": "Social media platform"
                      },
                      "url": {
                        "type": "string",
                        "description": "Social media URL"
                      }
                    }
                  },
                  "description": "Company social media links"
                },
                "latest_news": {
                  "type": "array",
                  "items": {
                    "type": "object"
                  },
                  "description": "Latest company news"
                },
                "jobs": {
                  "type": "array",
                  "items": {
                    "type": "object"
                  },
                  "description": "Available job positions"
                }
              }
            }
          }
        }
      },
      "created_at": {
        "type": "string",
        "description": "Timestamp when record was created"
      },
      "updated_at": {
        "type": "string",
        "description": "Timestamp when record was last updated"
      }
    }
  },
  "views": {}
}

.actor/input_schema.json

{
  "title": "YC Combinator Scraper",
  "type": "object",
  "schemaVersion": 1,
  "properties": {
    "url": {
      "title": "Search URL",
      "type": "string",
      "description": "This URL should contain the address for a list of companies you're looking to scrape. It'll have as many companies as shown in the Y combinator search index.",
      "editor": "textfield",
      "prefill": "https://www.ycombinator.com/companies?query=AI",
      "pattern": "^https?:\\/\\/.+",
      "example": "https://www.ycombinator.com/companies?..."
    }
  },
  "required": ["url"]
}

src/init.py

1# Package marker for Apify actor src

src/main.py

1import asyncio
2from .main import main
3
4if __name__ == '__main__':
5    asyncio.run(main())

src/main.py

1import json
2import os
3import time
4import urllib.request
5import urllib.parse
6from typing import Optional
7
8from apify import Actor
9
10# HMAC helpers mirrored from app/security/hmac_auth.py
11import hmac
12import hashlib
13import asyncio
14
15def compute_signature(secret: str, ts: int, method: str, path: str) -> str:
16    message = f"{ts}:{method}:{path}".encode()
17    return hmac.new(secret.encode(), message, hashlib.sha256).hexdigest()
18
19
20def build_auth_header(key_id: str, secret: str, method: str, path: str, ts: Optional[int] = None) -> str:
21    if ts is None:
22        ts = int(time.time())
23    sig = compute_signature(secret, ts, method, path)
24    return f"HMAC keyId={key_id},ts={ts},sig={sig}"
25
26
27def _split_base_url(raw: str) -> tuple[str, str]:
28    """Split APIFY_YC_BASE_URL into (origin, path_prefix).
29    origin = scheme://host[:port]
30    path_prefix = normalized leading path, e.g. '' or '/api' or '/custom/yc'
31    """
32    parsed = urllib.parse.urlparse(raw)
33    if not parsed.scheme or not parsed.netloc:
34        raise RuntimeError(f"Invalid APIFY_YC_BASE_URL: {raw}")
35    origin = f"{parsed.scheme}://{parsed.netloc}"
36    # Normalize prefix: ensure leading slash, no trailing slash (except root '')
37    prefix = parsed.path or ''
38    if prefix and not prefix.startswith('/'):
39        prefix = '/' + prefix
40    if prefix.endswith('/') and len(prefix) > 1:
41        prefix = prefix[:-1]
42    return origin, prefix
43
44
45def http_request(base_url: str, method: str, path: str, headers: dict, data: Optional[dict] = None):
46    url = urllib.parse.urljoin(base_url.rstrip('/') + '/', path.lstrip('/'))
47    body_bytes = None
48    if data is not None:
49        body_bytes = json.dumps(data).encode('utf-8')
50        headers.setdefault('Content-Type', 'application/json')
51    req = urllib.request.Request(url=url, data=body_bytes, headers=headers, method=method)
52    with urllib.request.urlopen(req, timeout=60) as resp:
53        resp_body = resp.read().decode('utf-8')
54        status = resp.getcode()
55        return status, json.loads(resp_body) if resp_body else None
56
57
58async def main() -> None:
59    async with Actor:
60        # Inputs and ENV
61        input_ = await Actor.get_input() or {}
62        search_url: str = input_.get('url')
63        if not search_url:
64            raise RuntimeError('Input must contain "url"')
65
66        APIFY_YC_BASE_URL = os.getenv('APIFY_YC_BASE_URL')
67        APIFY_YC_KEY_ID = os.getenv('APIFY_YC_KEY_ID')
68        APIFY_YC_KEY_SECRET = os.getenv('APIFY_YC_KEY_SECRET')
69
70        if not APIFY_YC_BASE_URL or not APIFY_YC_KEY_ID or not APIFY_YC_KEY_SECRET:
71            raise RuntimeError('Missing APIFY_YC_BASE_URL, APIFY_YC_KEY_ID or APIFY_YC_KEY_SECRET environment variables')
72
73        # Split base URL into origin and path prefix; include prefix in signature paths
74        try:
75            base_origin, path_prefix = _split_base_url(APIFY_YC_BASE_URL)
76        except Exception as e:
77            raise RuntimeError(str(e))
78
79        Actor.log.info('Triggering YC search job...')
80        # Trigger job: POST /yc/search
81        raw_path_search = '/yc/search'
82        effective_path_search = (path_prefix + raw_path_search) or raw_path_search
83        auth_header = build_auth_header(APIFY_YC_KEY_ID, APIFY_YC_KEY_SECRET, 'POST', effective_path_search)
84        Actor.log.debug(f"POST path={effective_path_search}")
85        status, payload = http_request(
86            base_origin, 'POST', effective_path_search,
87            headers={'Authorization': auth_header},
88            data={'url': search_url},
89        )
90        if status != 200 or not payload or 'job_id' not in payload:
91            raise RuntimeError(f'Failed to trigger search job: status={status}, payload={payload}')
92
93        job_id = payload['job_id']
94        Actor.log.info(f'Job queued: {job_id}')
95
96        # Poll job status every 30s up to 10 minutes
97        deadline = time.time() + 10 * 60
98        interval = 30
99        last_status = None
100        while time.time() < deadline:
101            raw_path_status = f'/yc/async/job/{job_id}'
102            effective_path_status = (path_prefix + raw_path_status) or raw_path_status
103            auth_header = build_auth_header(APIFY_YC_KEY_ID, APIFY_YC_KEY_SECRET, 'GET', effective_path_status)
104            try:
105                Actor.log.debug(f"GET path={effective_path_status}")
106                status_code, job_payload = http_request(
107                    base_origin, 'GET', effective_path_status,
108                    headers={'Authorization': auth_header},
109                )
110            except Exception as e:
111                Actor.log.warning(f'Error polling job status: {e}')
112                await asyncio.sleep(interval)
113                continue
114
115            if status_code != 200 or not job_payload:
116                Actor.log.warning(f'Unexpected job status response: {status_code} {job_payload}')
117                await asyncio.sleep(interval)
118                continue
119
120            last_status = job_payload.get('status')
121            Actor.log.info(f'Job status: {last_status}')
122            if last_status in ('completed', 'failed'):
123                await Actor.set_value('RESULT', job_payload)
124                if last_status == 'failed':
125                    Actor.log.error('Job failed.')
126                else:
127                    await Actor.push_data(job_payload)
128                    Actor.log.info('Job completed successfully.')
129                return
130
131            await asyncio.sleep(interval)
132
133        # Timeout
134        Actor.log.error('Job did not complete within timeout. Returning last known status.')
135        await Actor.set_value('RESULT', {
136            'job_id': job_id,
137            'status': last_status or 'unknown',
138            'message': 'timeout',
139        })

src/py.typed

# Marker file for typing completeness

Y Combinator Scraper

michael.g/y-combinator-scraper

Scrape data on Y Combinator companies and their founders from the YC startup directory.

Michael G

421

5.0

Y Combinator Extractor

jupri/ycombinator

💫 All-In-One YCombinator.com Scraper

cat

127

5.0

Y Combinator Scraper

scraped/y-combinator-scraper

Scrape companies from Y Combinator

scraped

5.0

🔥 Y Combinator Scraper [API] 2025 | Super Cheap & Fast

clearpath/ycombinator-api-scraper

Extract complete Y Combinator ecosystem data - 5000+ companies, 8000+ founders, 3500+ jobs. Perfect for VCs, recruiters, and researchers. Get startup intelligence, funding trends, team data, and job listings. Reliable Python scraper with proxy support. Start at $3.50.

ClearPath

✨ Y Combinator Scraper Apify

damilo/y-combinator-scraper-apify

⚡ Scrape Y Combinator’s startup directory with rich data: company info, founders, job postings, batch, team size, social links, and more. Filter by industry, region, or hiring status. Ideal for lead gen, VC scouting, and recruiting. Clean JSON output ready for Airtable, Notion, or Excel.

Imad

5.0

🚀 Y Combinator Scraper - Rental ($10/month) 🚀

deltaspider/y-combinator-scraper

A high-performance web scraper for extracting comprehensive company data from Y Combinator - the world's leading startup accelerator. Whether you're an investor, founder, researcher, or developer, this tool helps you gather detailed data on 5000+ YC-backed companies.

delta spider

[Aug25] Y Combinator Scraper - fast & low cost

scrapegoats/ycombinator-scraper

Efficiently extract structured data from the official Y Combinator startup directory.

ScrapeGoats

5.0

Y Combinator Company Scraper 🧠💼 - Cheap & Fast

scrapestorm/y-combinator-company-scraper---cheap-fast

Unlock the power of Y Combinator with automated company data scraping 🧠💼📊 Effortlessly collect detailed information on startups and portfolio companies from the YC platform. Customize your search queries by industry, hiring status, or region for highly targeted insights 🌍No proxy needed ⚡

Storm_Scraper

5.0

Y Combinator Directory Scraper | Fast & Reliable | $4.5 / 1K

fatihtahta/y-combinator-directory-scraper

Most affordable, enterprise-grade Y Combinator company scraper. Extracts complete startup profiles, including batch, founders, funding status, team size, social links and more for any filtered listing. Cost-effective pay-as-you-go pricing at $4 per 1 000 companies. Updated weekly.