# Wellfound (AngelList) Jobs Scraper (`crawlerbros/wellfound-scraper`) Actor Scrape public job listings from Wellfound.com. Extracts job ID, title, compensation, remote status, location, company name, company logo. HTTP-only, no login. - **URL**: https://apify.com/crawlerbros/wellfound-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Jobs, Other, Developer tools - **Stats:** 1 total users, 0 monthly users, 100.0% runs succeeded, 5 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $1.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Wellfound Jobs Scraper Scrape public job listings from [Wellfound](https://wellfound.com) (formerly AngelList Talent). HTTP-only, no login. ### What this actor extracts Per job: - `type`, `jobId`, `title`, `slug`, `jobUrl` - `compensation`, `remote`, `locations` - `companyId`, `companyName`, `companySlug`, `companyUrl`, `companyLogo` - `postedAt` (when available) - `scrapedAt` ### Input | Field | Type | Description | |---|---|---| | `startUrls` | string[] | Wellfound URLs. Default is `https://wellfound.com/jobs`. Supports `?remote=true`, `/location/`, and custom query filters. | | `remoteOnly` | boolean | Filter to remote-only jobs. Also appends `?remote=true` to default URLs. | | `maxItems` | integer | Maximum jobs to return. Default 50, cap 500. | ### How it works Wellfound's `/jobs` landing feed is a Next.js app that ships an Apollo Client cache in the page's `__NEXT_DATA__` script block. Each page returns up to ~47 `JobListing` entries along with their linked `Startup` entries. The actor fetches the HTML with `curl_cffi` (Chrome TLS fingerprint) and walks the cache to extract every job. Deep-filter URLs (`/role/l//`) are DataDome-protected — the actor escalates those to Apify RESIDENTIAL US proxy automatically. ### Limitations - The `/jobs` feed serves a single page (~47 jobs) without client-side pagination. Use multiple `startUrls` or filtered URLs for more. - Deep job details (descriptions, skills, benefits) require hitting individual `/jobs/-` pages — these are DataDome-protected and may fall back to the proxy pool. ### FAQ **Do I need cookies or login?** No. **Do I need to configure a proxy?** No — residential proxy is hardcoded for URLs that need it; everything else goes direct. # Actor input Schema ## `startUrls` (type: `array`): Wellfound URLs. Default is https://wellfound.com/jobs. Supports ?remote=true and other query params. /role/l/ deep-filter URLs require residential proxy (escalated automatically). ## `jobTitle` (type: `string`): Client-side filter: only jobs whose title contains this phrase (case-insensitive). ## `keyword` (type: `string`): Client-side keyword filter across title + company + location (case-insensitive). ## `location` (type: `string`): Client-side location filter (case-insensitive match on any location name). ## `remoteOnly` (type: `boolean`): Return only jobs flagged as remote. ## `jobType` (type: `string`): Filter by employment type (matches on job metadata/description). ## `experience` (type: `string`): Filter by experience level (matches on job title/description keywords). ## `minSalary` (type: `integer`): Minimum annual compensation parsed from job compensation field. ## `maxSalary` (type: `integer`): Maximum annual compensation. 0 = unlimited. ## `includeNoSalary` (type: `boolean`): When false, jobs with no compensation field are filtered out. ## `companyCategories` (type: `array`): Filter companies by category (e.g. 'saas', 'fintech'). Case-insensitive substring match on startup name/slug. ## `includeCompanies` (type: `array`): Allow-list of company names/slugs (case-insensitive). ## `excludeCompanies` (type: `array`): Block-list of company names/slugs (case-insensitive). ## `sort` (type: `string`): Sort by posted date (when available). ## `maxItems` (type: `integer`): Maximum jobs returned after filtering. ## Actor input object example ```json { "startUrls": [ "https://wellfound.com/jobs" ], "remoteOnly": false, "jobType": "any", "experience": "any", "minSalary": 0, "maxSalary": 0, "includeNoSalary": true, "sort": "none", "maxItems": 5 } ```` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ "https://wellfound.com/jobs" ], "maxItems": 5 }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/wellfound-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": ["https://wellfound.com/jobs"], "maxItems": 5, } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/wellfound-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ "https://wellfound.com/jobs" ], "maxItems": 5 }' | apify call crawlerbros/wellfound-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/wellfound-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Wellfound (AngelList) Jobs Scraper", "description": "Scrape public job listings from Wellfound.com. Extracts job ID, title, compensation, remote status, location, company name, company logo. HTTP-only, no login.", "version": "1.0", "x-build-id": "qEcuPaIqMugGH7QJf" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~wellfound-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-wellfound-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~wellfound-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-wellfound-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~wellfound-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-wellfound-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "Wellfound URLs. Default is https://wellfound.com/jobs. Supports ?remote=true and other query params. /role/l/ deep-filter URLs require residential proxy (escalated automatically).", "items": { "type": "string" } }, "jobTitle": { "title": "Job Title Filter", "type": "string", "description": "Client-side filter: only jobs whose title contains this phrase (case-insensitive)." }, "keyword": { "title": "Keyword", "type": "string", "description": "Client-side keyword filter across title + company + location (case-insensitive)." }, "location": { "title": "Location Filter", "type": "string", "description": "Client-side location filter (case-insensitive match on any location name)." }, "remoteOnly": { "title": "Remote Only", "type": "boolean", "description": "Return only jobs flagged as remote.", "default": false }, "jobType": { "title": "Job Type", "enum": [ "any", "full-time", "part-time", "contract", "internship" ], "type": "string", "description": "Filter by employment type (matches on job metadata/description).", "default": "any" }, "experience": { "title": "Experience Level", "enum": [ "any", "junior", "mid", "senior", "executive" ], "type": "string", "description": "Filter by experience level (matches on job title/description keywords).", "default": "any" }, "minSalary": { "title": "Minimum Salary (USD/year)", "minimum": 0, "maximum": 1000000, "type": "integer", "description": "Minimum annual compensation parsed from job compensation field.", "default": 0 }, "maxSalary": { "title": "Maximum Salary (USD/year)", "minimum": 0, "maximum": 1000000, "type": "integer", "description": "Maximum annual compensation. 0 = unlimited.", "default": 0 }, "includeNoSalary": { "title": "Include Jobs Without Salary Data", "type": "boolean", "description": "When false, jobs with no compensation field are filtered out.", "default": true }, "companyCategories": { "title": "Company Category Filter", "type": "array", "description": "Filter companies by category (e.g. 'saas', 'fintech'). Case-insensitive substring match on startup name/slug.", "items": { "type": "string" } }, "includeCompanies": { "title": "Include Companies", "type": "array", "description": "Allow-list of company names/slugs (case-insensitive).", "items": { "type": "string" } }, "excludeCompanies": { "title": "Exclude Companies", "type": "array", "description": "Block-list of company names/slugs (case-insensitive).", "items": { "type": "string" } }, "sort": { "title": "Sort Order", "enum": [ "newest", "oldest", "none" ], "type": "string", "description": "Sort by posted date (when available).", "default": "none" }, "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum jobs returned after filtering.", "default": 50 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```