# Craigslist Scraper (`crawlerbros/craigslist-scraper`) Actor Scrape Craigslist search results and individual posts across any city subdomain (sfbay, newyork, chicago, etc.). Extracts titles, prices, descriptions, attributes, coordinates, images, and posted/updated timestamps. HTTP-only, no login, no proxy required. - **URL**: https://apify.com/crawlerbros/craigslist-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Jobs, Developer tools, Automation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 16 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $1.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Craigslist Scraper Scrape [Craigslist](https://craigslist.org) search results and individual posts across any city subdomain — `sfbay`, `newyork`, `chicago`, `losangeles`, `london`, and hundreds more. Returns titles, prices, descriptions, attributes, coordinates, images, and posted/updated timestamps. HTTP-only; no login, no cookies, no proxy required for normal volume. ### Output (per post) - `type` = `craigslist_listing` - `url`, `id` (numeric post id parsed from `.html`) - `title`, `category`, `subcategory`, `location`, `region` - `postingType` — category slug from the URL path (`cto`, `apa`, `lab`, `fud`, ...) - `price`, `priceQualifier` — e.g. `/ 2br - 1083ft²`, `OBO`, `/ month` - `postedAt`, `updatedAt` - `description` — plain-text `#postingbody` - `images` — large image URLs (`_600x450.jpg`) from the gallery - `latitude`, `longitude` — from the embedded map - `mapAddress` — street address displayed next to the map - `attributes` — raw dict parsed from `.attrgroup` (full key → value set) - `phoneNumbers`, `notices`, `replyUrl` - Jobs: `compensation`, `employmentType`, `jobTitle` - For-sale (generic): `condition`, `size` - Autos: `yearManufactured`, `makeManufacturer`, `modelName`, `odometer`, `transmission`, `fuelType`, `titleStatus`, `cylinders`, `paintColor`, `drive`, `vehicleType`, `vin` - Housing: `bedroomCount`, `bathroomCount`, `sqft`, `availableDate`, `housingType`, `laundry`, `parking`, `rentPeriod`, `listedBy`, `applicationFee`, `brokerFee`, `openHouseDates`, `catsOk`, `dogsOk`, `furnished`, `smoking` - `scrapedAt` Fields that are absent on the source page are simply omitted (no nulls). If zero posts are scrapeable, a single `craigslist_blocked` sentinel is emitted so the run exits with data. ### Input | Field | Type | Description | |---|---|---| | `startUrls` | object[] | Craigslist search URLs or direct post URLs. Prefill: `https://sfbay.craigslist.org/search/jjj`. | | `searchTerm` | string | Optional keyword. Appended to each search URL as `?query=`. Ignored for direct post URLs. | | `maxItems` | integer | Maximum posts per run. Default 3. Max 1000. | | `scrapeDetails` | boolean | Fetch each post's page for full description + attributes. Default `true`. | | `minPrice` | integer | Minimum price filter (USD). | | `maxPrice` | integer | Maximum price filter (USD). | | `hasImage` | boolean | When true, only include posts with at least one image. | | `proxyConfiguration` | object | Apify proxy config. Default off — Craigslist accepts datacenter IPs. | ### How it works 1. For each `startUrls` entry, the scraper classifies the URL as either a **search page** (`/search/`) or a **direct post** (`.../.html`). 2. Search pages are paginated by incrementing the `s=N` query offset; post URLs are extracted from `
  • ` cards. 3. For each post URL (deduplicated by numeric id), the detail page is fetched and parsed: - Title from `#titletextonly` - Price from `.price` - Description from `#postingbody` - Attributes from `.attrgroup` (label → value pairs) - Coordinates from `.mapbox[data-latitude]` - Images from `#thumbs a[data-imgid]` (large `_600x450` URLs) - Posted / updated timestamps from `.postinginfos time[datetime]` 4. Phone numbers and warning notices are extracted via regex / DOM. ### FAQ **Do I need a proxy?** No. Craigslist responds fine from Apify's datacenter IPs. If you hit a 403 wall, toggle on Apify proxy. **Does this bypass login walls?** Craigslist has no login wall for public listings — this actor works out of the box. **Can I scrape just one specific post?** Yes. Put the direct post URL (ending in `.html`) into `startUrls` and set `maxItems: 1`. **What cities are supported?** Every Craigslist subdomain — the scraper detects the region automatically from the URL. # Actor input Schema ## `startUrls` (type: `array`): Craigslist search URLs or direct post URLs. Examples: https://sfbay.craigslist.org/search/jjj, https://newyork.craigslist.org/search/hhh, or a full post URL like https://sfbay.craigslist.org/eby/grd/d/hayward-item/7918207144.html ## `searchTerm` (type: `string`): Optional keyword; appended to each search URL as ?query=. Ignored for direct post URLs. ## `maxItems` (type: `integer`): Maximum posts to return across all start URLs. ## `scrapeDetails` (type: `boolean`): Fetch each post's page for full description, attributes, coordinates and images. Off = listing-card data only (title, url, price, location). ## `minPrice` (type: `integer`): Optional minimum price filter (USD). Applied to the numeric portion of the listing price when present. ## `maxPrice` (type: `integer`): Optional maximum price filter (USD). Applied to the numeric portion of the listing price when present. ## `hasImage` (type: `boolean`): When true, only include posts whose `images` array is non-empty. ## `proxyConfiguration` (type: `object`): Apify proxy. Craigslist typically works from datacenter IPs with no proxy — leave off for lowest cost. ## Actor input object example ```json { "startUrls": [ { "url": "https://sfbay.craigslist.org/search/jjj" } ], "maxItems": 3, "scrapeDetails": true, "hasImage": false, "proxyConfiguration": { "useApifyProxy": false } } ```` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://sfbay.craigslist.org/search/jjj" } ], "maxItems": 3, "proxyConfiguration": { "useApifyProxy": false } }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/craigslist-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://sfbay.craigslist.org/search/jjj" }], "maxItems": 3, "proxyConfiguration": { "useApifyProxy": False }, } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/craigslist-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://sfbay.craigslist.org/search/jjj" } ], "maxItems": 3, "proxyConfiguration": { "useApifyProxy": false } }' | apify call crawlerbros/craigslist-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/craigslist-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Craigslist Scraper", "description": "Scrape Craigslist search results and individual posts across any city subdomain (sfbay, newyork, chicago, etc.). Extracts titles, prices, descriptions, attributes, coordinates, images, and posted/updated timestamps. HTTP-only, no login, no proxy required.", "version": "1.0", "x-build-id": "cuM1vye0LP3Ihf2Xy" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~craigslist-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-craigslist-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~craigslist-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-craigslist-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~craigslist-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-craigslist-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "Craigslist search URLs or direct post URLs. Examples: https://sfbay.craigslist.org/search/jjj, https://newyork.craigslist.org/search/hhh, or a full post URL like https://sfbay.craigslist.org/eby/grd/d/hayward-item/7918207144.html", "default": [ { "url": "https://sfbay.craigslist.org/search/jjj" } ], "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "searchTerm": { "title": "Search Term", "type": "string", "description": "Optional keyword; appended to each search URL as ?query=. Ignored for direct post URLs." }, "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum posts to return across all start URLs.", "default": 3 }, "scrapeDetails": { "title": "Scrape Post Details", "type": "boolean", "description": "Fetch each post's page for full description, attributes, coordinates and images. Off = listing-card data only (title, url, price, location).", "default": true }, "minPrice": { "title": "Minimum Price", "minimum": 0, "type": "integer", "description": "Optional minimum price filter (USD). Applied to the numeric portion of the listing price when present." }, "maxPrice": { "title": "Maximum Price", "minimum": 0, "type": "integer", "description": "Optional maximum price filter (USD). Applied to the numeric portion of the listing price when present." }, "hasImage": { "title": "Has Image", "type": "boolean", "description": "When true, only include posts whose `images` array is non-empty.", "default": false }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Apify proxy. Craigslist typically works from datacenter IPs with no proxy — leave off for lowest cost.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```