Craiglist Scraper using Puppeteer

Others Job Scrapers ⚙️

Glassdoor Job Scraper. RemoteOk Premium Job Scraper.

Overview

This Apify actor uses Puppeteer to scrape Craiglist posts based on a specified category and city. The output of the actor includes details on each post scraped.

Input

The actor takes in the following input:

• category (required) - The category of Craiglist you want to scrape.
• city (required) - The city in which you want to scrape posts from.
• searchKeyword(optional) - The keyword you want to search for.
• numberOfResults (optional) - The number of posts you want to scrape.

Output

The actor outputs an array of objects, where each object represents a single Craiglist post. The object includes the following details for each post:

• title - The title of the post.
• priceInfo - Information about the price of the item/service.
• postedDate - The date when the post was made.
• updatedDate - The date when the post was last updated.
• postLink - The URL to the Craiglist post.
• imageSrc - The URL of the image associated with the post.
• description - The description of the post.
• location - Location information for the post.
• id - Unique identifier for the post.
• postAdress - Address associated with the post.
• attribute - Additional attributes associated with the post.
• companyName - If relevant, the name of the company associated with the post.
• salary - Salary information if it's a job-related post.
• housingSize - Housing size if it's a property-related post.

Usage

To use this actor, you can set up a task on Apify and configure the input parameters as per your needs. Once the task is started, the actor will scrape the specified number of posts from the specified category and city, outputting the details in the format described above.

Example Input

1{
2  "category": "for sale",
3  "city": "New York",
4  "searchKeyword":"mac",
5  "numberOfResults": 10
6}

Example Output

1[
2  {
3    "title": "Apartment for Rent",
4    "priceInfo": "$1200/month",
5    "postedDate": "2023-10-15",
6    "updatedDate": "2023-10-16",
7    "postLink": "https://craiglist.org/example-post-1",
8    "imageSrc": "https://example.com/image-1.jpg",
9    "description": "2 bedroom apartment in downtown New York.",
10    "location": "Downtown, NY",
11    "id": "123456",
12    "postAdress": "123 Elm Street, NY",
13    "attribute": "2BHK, Furnished",
14    "companyName": null,
15    "salary": null,
16    "housingSize": "1200 sq ft"
17  }
18]

Disclaimer

Please note that the use of this actor and any data obtained through its use is at your own risk. The developer of this actor is not responsible for any consequences resulting from the use of this actor and the data it generates. It is your responsibility to ensure that you comply with all applicable laws and regulations governing the use of such data.