Craigslist Scraper

Scrape data from Craigslist easily with Craigslist Scraper.

About

Craigslist is an American classified advertisements website with sections devoted to jobs, housing, for sale, items wanted, services, community service, gigs, résumés, and discussion forums.

Craig Newmark began the service in 1995 as an email distribution list to friends, featuring local events in the San Francisco Bay Area. It became a web-based service in 1996 and expanded into other classified categories. It started expanding to other U.S. and Canadian cities in 2000, and now covers 70 countries.

How to use

In order to use Craigslist Scraper you need to provide URL that you want to scrape.

Currently we are supporting all categories for scraping:

• gigs
• jobs
• housing
• events
• communities
• resumes
• services
• for sale

Only english translation of site is currently supported.

Example of valid search pages:

• https://newyork.craigslist.org/search/ggg - this is search page that will be scraped
• https://newyork.craigslist.org/search/jjj#search=1~list~0~0 - search page for jobs that should be scraped
• https://newyork.craigslist.org/search/hhh#search=1~list~0~0 - search page for housing that should be scraped
• https://newyork.craigslist.org/search/sss#search=1~list~0~0 - search page for sale that should be scraped
• https://newyork.craigslist.org/mnh/dmg/7524843421.html - this is post that should be scraped

paginationEnabled can be set to false if you just want to get posts from page that is sent, scraper will not conitinue to scrape other pages on search.

If you are doing often parsing it is advised to configure useApifyProxy to true.

1{
2  "debugLog": false,
3  "maxConcurrency": 1,
4  "paginationEnabled": true,
5  "proxyConfiguration": {
6    "useApifyProxy": true
7  },
8  "urls": [
9    {
10      "url": "https://newyork.craigslist.org/search/ggg"
11    }
12  ]
13}

Example

If you want to scrape all gigs from New Yourk request would look like this.

1{
2  "debugLog": false,
3  "maxConcurrency": 1,
4  "paginationEnabled": true,
5  "proxyConfiguration": {
6    "useApifyProxy": true
7  },
8  "urls": [
9    {
10      "url": "https://newyork.craigslist.org/search/ggg"
11    }
12  ]
13}

Data Output Example - gigs

1[
2  {
3    "id": "7536953147",
4    "url": "https://newyork.craigslist.org/que/lbg/7536953147.html",
5    "title": "Deli grill men",
6    "datetime": "2022-09-22T11:13:56-0400",
7    "location": "Astoria",
8    "category": "gigs",
9    "label": "post",
10    "price": "$15",
11    "longitude": "-73.937645",
12    "latitude": "40.759908",
13    "mapAccuracy": "5",
14    "post": "QR Code Link to This Post\n            \n        \nDeli experience require, Time must be flexible know how to Prepare sandwiches,breakfast, salads.  Must know how to operating slicer and how to sanitize equipment, clean and Organize and Honesty responsible.  A good attitude and desire to learn, must speaking Spanish and fluent in English. Must work in Sunday. stops in person \naround 8am to 2 pm or text me  6467446519 Thank you. 40 hours a week",
15    "notices": ["do NOT contact me with unsolicited services or offers"],
16    "phoneNumbers": ["909-9909-3322"]
17  }
18]

Data Output Example - jobs

1[
2  {
3    "id": "7537414885",
4    "url": "https://newyork.craigslist.org/mnh/fbh/7537414885.html",
5    "title": "**Hiring Floor Managers ($75-90k) at La Pecora Bianca!**",
6    "datetime": "2022-09-23T12:42:59-0400",
7    "location": "Upper East Side",
8    "category": "jobs",
9    "label": "post",
10    "longitude": "-73.954092",
11    "latitude": "40.774656",
12    "mapAccuracy": "10",
13    "post": "QR Code Link to This Post\n            \n        \nWe are seeking talented Floor Managers to join our opening team!\n\nUNPARALLELED COMPENSATION & BENEFITS:\n-Quality of life: Consistent schedules with consecutive days off\n-$75-90K including base salary and quarterly bonus\n-Bonuses paid every quarter\n-Gold insurance plan with 75% company contribution for all tier plans, including family plans\n-Paid time off\n-Paid parental leave\n-401k with company match up to 6%\n-Complimentary gym membership\n-Quarterly dining stipends\n-Commuter benefits, flexible spending and dependent care accounts\n\nFAST PROMOTION TRACK:\n\nLa Pecora Bianca is the fastest growing Italian restaurant group in NYC, with multiple locations opening in the next 6-12 months. We support long-term tenure through consistent feedback and mentoring, and unlimited opportunities for growth and advancement. High performing managers will have fast track opportunities for AGM roles.\n\nHIGH LEVEL OF RESPONSIBILITY:\n\nThis position will be responsible for tasks including scheduling, beverage purchasing & inventory, daily financial reporting & management, hiring and training of all line level positions, managing and driving service standards at high volume, and developing guest relations.\n\nHAVE YOUR VOICE HEARD:\n\n​​We believe the best ideas can come from within and empower our entire team to shape our company’s direction.\n\nLa Pecora Bianca is a proud Equal Opportunity Employer.",
14    "notices": [
15      "Principals only. Recruiters, please don't contact this job poster.",
16      "do NOT contact us with unsolicited services or offers"
17    ],
18    "compensation": "$75-$90k salary and bonus, health insurance, paid time off, paid sick time, 401k with company match, quarterly bonus, etc",
19    "employmentType": "full-time",
20    "jobTitle": "Floor Managers",
21    "phoneNumbers": ["909-9909-3322"]
22  }
23]

Data Output Example - housing

1[
2  {
3    "label": "post",
4    "id": "7538275333",
5    "title": "Private room/bath for rent",
6    "location": "Queens",
7    "price": "$750",
8    "longitude": "-73.897471",
9    "latitude": "40.702576",
10    "mapAccuracy": "5",
11    "post": "QR Code Link to This Post\n            \n        \nIf you are looking for a safe, quiet, and peaceful place to live this is for you. The room is fully furnished with new TV and Direct TV with movie channels. Tenants have use of the whole house that includes a fully furnished kitchen and living room with leather couches. This is a very beautiful property with large shade trees, pic-nic tables, camp fire pit, a nature trail, privacy fence, and security cameras. Excellent location. Perfect for business professionals or mature college student.\n\nWell-trained pets are preferred.Street parking is also available.\nAll utilities included to the rent.\nIf you really interested. feel free to contact with me. Thanks",
12    "notices": ["it's ok to contact this poster with services or other commercial interests"],
13    "datetime": "2022-09-25T17:00:54-0400",
14    "url": "https://newyork.craigslist.org/que/roo/7538275333.html",
15    "category": "housing",
16    "pics": [
17      "https://images.craigslist.org/00H0H_irQhVngzks3z_04Q04Q_600x450.jpg",
18      "https://images.craigslist.org/00e0e_j7aM6nxffhqz_05r07g_600x450.jpg"
19    ],
20    "amenities": [
21      "air conditioning",
22      "cats are OK - purrr",
23      "dogs are OK - wooof",
24      "furnished",
25      "apartment",
26      "w/d in unit",
27      "off-street parking",
28      "private bath",
29      "private room",
30      "rent period: monthly"
31    ],
32    "availableFrom": "2022-09-27",
33    "phoneNumbers": ["909-9909-3322"]
34  }
35]

Data Output Example - for sale

1[
2  {
3    "id": "7528462760",
4    "url": "https://newyork.craigslist.org/lgi/bik/7528462760.html",
5    "title": "21 Speed CANNONDALE QUICK 6 Road Bicycle 18 inch frame",
6    "datetime": "2022-09-26T16:07:53-0400",
7    "location": "Commack/Western Suffolk",
8    "category": "for sale",
9    "price": "$300",
10    "label": "post",
11    "longitude": "-73.279900",
12    "latitude": "40.843000",
13    "mapAccuracy": "22",
14    "post": "QR Code Link to This Post\n            \n        \n*****************************************************************************\n21 Speed CANNONDALE QUICK 6 Road Bicycle. 700 x 38C tires, 18 inch frame, Trigger Shifters, water bottle holder\n*******************************************************************************\nInclude your PHONE NUMBER WITH AREA CODE. PHONE NUMBER MUST BE INCLUDED IN YOUR E-MAIL IF YOU WANT A RESPONSE. Responses that do not have a phone # are immediately deleted\n\nBicycles are clean, tuned up and ready to ride\n\nCash only.\n\nI have many other bicycles available. To locate them, in the top search box enter \"COMMACK\" and search.\n\nTo Manhattan/Queens/Brooklyn/Bronx residents..... I will also meet NYC LIRR Train riders at the Long Island Huntington train station with bicycle or bicycles that you are interested in.",
15    "notices": ["do NOT contact me with unsolicited services or offers"],
16    "pics": [
17      "https://images.craigslist.org/00K0K_lArdvZdjVWHz_0w00o0_600x450.jpg",
18      "https://images.craigslist.org/00606_cnhxK9PzTwrz_0w00o0_600x450.jpg",
19      "https://images.craigslist.org/01616_7sIDUPncJgWz_0w00o0_600x450.jpg"
20    ],
21    "manufacturer": "",
22    "condition": "",
23    "attirbutes": [
24      "bicycle frame material: other/unknown",
25      "bicycle type: other",
26      "frame size: other",
27      "wheel size: other/unknown"
28    ],
29    "model": "",
30    "phoneNumbers": ["909-9909-3322"]
31  }
32]

Data Output Example - community

1[
2  {
3    "id": "7538938958",
4    "url": "https://newyork.craigslist.org/que/mis/7538938958.html",
5    "title": "Walking your poodle last night on 30th avenue in Astoria",
6    "datetime": "2022-09-27T11:57:01-0400",
7    "location": "Astoria",
8    "category": "community",
9    "label": "post",
10    "longitude": "-73.909391",
11    "latitude": "40.761264",
12    "mapAccuracy": "15",
13    "post": "White blouse, tan pants, brown poodle (I think), walking east on 30th avenue. I was the military-looking guy walking west and passed you outside Dillingers pub just before midnight. Just looking to say hi.",
14    "notices": ["do NOT contact me with unsolicited services or offers"],
15    "pics": [],
16    "attirbutes": [],
17    "phoneNumbers": ["909-9909-3322"]
18  }
19]

Data Output Example - resumes

1[
2  {
3    "id": "7533132582",
4    "url": "https://newyork.craigslist.org/que/res/7533132582.html",
5    "title": "DRIVER AVAILABLE CLEAN LICENSE LOCAL OR LONG DISTANCE I WILL DRIVE",
6    "datetime": "2022-09-27T11:14:27-0400",
7    "location": "Queens Brooklyn and Long Island",
8    "category": "resumes",
9    "label": "post",
10    "post": "HI , I PRESENTLY DRIVE FOR UBEREATS BUT IT'S NOT CUTTING IT FOR ME WITH THE BILLS , SO I AM LOOKING TO SEE WHATS OUT THERE . I HAVE A CLEAN DRIVING RECORD AND AVAILABLE ANYTIME TO DO SO FLEXIBLE FOR ONE TIME GIG FULL TIME OR PART TIME OPPORTUNITIES , THANK YOU",
11    "notices": [
12      "it's ok to contact this poster if you are a potential employer or other principal.\n                Principals only. Recruiters, please don't contact this job poster.",
13      "do NOT contact me with unsolicited services or offers"
14    ],
15    "attirbutes": [
16      "available afternoons",
17      "available evenings",
18      "available mornings",
19      "available overnight",
20      "available weekdays",
21      "available weekends"
22    ],
23    "education": "some college",
24    "phoneNumbers": ["909-9909-3322"]
25  }
26]

Data Output Example - services

1[
2  {
3    "id": "7538942850",
4    "url": "https://newyork.craigslist.org/que/lbs/7538942850.html",
5    "title": "GARBAGE REMOVAL /JUNK/TREE CUTTING /YARD CLEANING (516-688-4452)",
6    "datetime": "2022-09-27T12:04:20-0400",
7    "location": "QUEENS/ BROOKLYN/LONGISLAND/ MANHATTAN /NJ/S.I",
8    "category": "services",
9    "label": "post",
10    "longitude": "-73.787700",
11    "latitude": "40.696900",
12    "mapAccuracy": "22",
13    "post": "HI EVERYONE WE R OFFER SERVICES HAS FOLLOWS GARBAGE  \\YARD CLEANING /TREE CUTTING\\OFFICE CLEANOUT\\  CONTRUCTION DEBRI /DIRT ROCKS/WAREHOUSE\\GARAGE,STOREFRONT  CLEAN OUT /PROPERTY CLEAR OUT RESDENTIAL & COMMERCIAL /NO JOBS 2 BIG OR 2 SMALL WE DO THEN ALL THANKS FOR READING THIS AD WE LOOKING FORWARD DOING BUSINESS WITH U SOON CONTACT INFO (516-688-4452)",
14    "notices": ["do NOT contact me with unsolicited services or offers"],
15    "pics": [
16      "https://images.craigslist.org/00d0d_gHYworwd0Qbz_0CI0s9_600x450.jpg",
17      "https://images.craigslist.org/00d0d_iT4IRyEVs8Y_600x450.jpg",
18      "https://images.craigslist.org/00c0c_cGOR3ltegwU_600x450.jpg",
19      "https://images.craigslist.org/00d0d_4jjcYbymtrm_600x450.jpg",
20      "https://images.craigslist.org/00b0b_35TZdi70rOvz_0lM0t2_600x450.jpg",
21      "https://images.craigslist.org/00N0N_fiJ32nA5P9cz_0lM0t2_600x450.jpg",
22      "https://images.craigslist.org/00V0V_URIYpD9YmAz_0lM0t2_600x450.jpg",
23      "https://images.craigslist.org/00x0x_gO2j6p4crVrz_0lM0t2_600x450.jpg",
24      "https://images.craigslist.org/00x0x_gO2j6p4crVrz_0lM0t2_600x450.jpg",
25      "https://images.craigslist.org/00O0O_kSordbCDdQhz_0wg0oc_600x450.jpg",
26      "https://images.craigslist.org/00Q0Q_6JgftAVmHUsz_0co0gw_600x450.jpg",
27      "https://images.craigslist.org/00e0e_lhcCdQfaERz_0lM0t2_600x450.jpg"
28    ],
29    "attirbutes": [],
30    "phoneNumbers": ["909-9909-3322"]
31  }
32]

Data Output Example - events

1[
2  {
3    "id": "7538891154",
4    "url": "https://newyork.craigslist.org/mnh/eve/7538891154.html",
5    "title": "Monday Afternoon bash with Lindsay",
6    "dates": "10/3",
7    "location": "West Babylon",
8    "category": "events",
9    "label": "post",
10    "longitude": "-73.380220",
11    "latitude": "40.737545",
12    "mapAccuracy": "10",
13    "post": "Check out my event flyer for a great time. I am Lindsay and I am hosting an event every Monday at World 2.  It's from noon till 4pm and will be a blast. I am a transgender female dominatrix but am hosting an event every Monday at World 2 at 92 dean st in west Babylon.  come check it out.",
14    "notices": ["do NOT contact me with unsolicited services or offers"],
15    "datetime": "2022-09-27T10:14:38-0400",
16    "pics": [
17      "https://images.craigslist.org/00505_edqtQISi2s9z_0da0h2_600x450.jpg",
18      "https://images.craigslist.org/00404_liRbL5qFKBgz_0da0h2_600x450.jpg",
19      "https://images.craigslist.org/00w0w_2PWqgTHxvvDz_0c60lw_600x450.jpg",
20      "https://images.craigslist.org/00b0b_8pCEx7ouFkFz_0c60lw_600x450.jpg",
21      "https://images.craigslist.org/01111_bO43SMmCuJsz_0t20CI_600x450.jpg",
22      "https://images.craigslist.org/00s0s_bM1qiF4qLJcz_0t20CI_600x450.jpg",
23      "https://images.craigslist.org/00f0f_6KAWptAU1kbz_05N0bU_600x450.jpg"
24    ],
25    "attirbutes": ["singles"],
26    "phoneNumbers": ["909-9909-3322"]
27  }
28]

Craigslist Scraper data output

The output from Craigslist Scraper is stored in the dataset. After the run is finished, you can download the dataset in various data formats (JSON, CSV, XML, RSS, HTML Table).

Support

For more custom/simplify outputs or Bug report please contact the developer (ivan.vasiljevic (at) hotmail.com) or report an issue.