Craigslist Scraper avatar
Craigslist Scraper

Pricing

$25.00/month + usage

Go to Store
Craigslist Scraper

Craigslist Scraper

ivanvs/craigslist-scraper

Developed by

Ivan Vasiljević

Maintained by Community

Extract data from classified advertisements on Craigslist. Scrape contact details from jobs, housing, items wanted, items for sale, services, community service, gigs, events and resumes listed on Craigslist. Download listings data in JSON, XML, Excel, and other versatile

0.0 (0)

Pricing

$25.00/month + usage

9

Monthly users

27

Runs succeeded

>99%

Last modified

22 days ago

U8

location field doesn't pull correct data

Closed
user-8E4QNYfcACnqSyPJF opened this issue
6 months ago

"location" field is often pulling a price value, and sometimes has a city name but no state/province

you can usually get the city name and state or province name from the addressLocality and addressRegion fields in the following section on listing screens:

{ "@type": "Product", "@context": "http://schema.org", "offers": { "priceCurrency": "...", "@type": "Offer", "availableAtOrFrom": { "address": { "addressLocality": "...", "streetAddress": "", "@type": "...", "addressRegion": "...", "postalCode": "...", "addressCountry": "..." } } } }

ivanvs avatar

Hi,

Thank you for raising this error ticket. I will take a look.

ivanvs avatar

I've improved method for location extraction for all housing categories.

Could you check if this helps you?

U8

user-8E4QNYfcACnqSyPJF

6 months ago

Any way to do this for non-housing categories?

U8

user-8E4QNYfcACnqSyPJF

6 months ago

here's an example of what i'm talking about

ivanvs avatar

Ok, I will investigate if there is some way to get better location.

We could get location from longitude and latitude, but reverse geocoding tools are not free, they are paid by request. So I don't see them as an real option for this public scraper.

U8

user-8E4QNYfcACnqSyPJF

6 months ago

I put on the original ticket the fields you can use to get location. Let me know if you have questions on those!

ivanvs avatar

Ok, I managed to do implementation of this. I just need to do some more testing. Tomorrow I will publish the version with this fix.

ivanvs avatar

New version is available. In result you will have address filed with information with location. Not all posts have this information.

U8

user-8E4QNYfcACnqSyPJF

5 months ago

Okay, we're still not seeing it in the "Location" field in most results. Should we be looking in a different field?

U8

user-8E4QNYfcACnqSyPJF

5 months ago

The addressLocality and addressRegions are the fields we care most about

ivanvs avatar

I've done some mapping:

postalCode -> postalCode streetAddress -> street addressLocality -> city addressRegion -> region addressCountry -> country

So you need to use region and city field in address object.

Not all ads have this information in it. Where there is, it will be extracted. Also not all categories have this data. This is currently only available on forSale, housing and jobs categories

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

2 hours

Price

$25.00