2 hours trial then $25.00/month - No credit card required now

Craigslist Scraper

ivanvs/craigslist-scraper

2 hours trial then $25.00/month - No credit card required now

Extract data from classified advertisements on Craigslist. Scrape contact details from jobs, housing, items wanted, items for sale, services, community service, gigs, events and resumes listed on Craigslist. Download listings data in JSON, XML, Excel, and other versatile

Back to issues Create new issue

Time out error

Closed

paomontero opened this issue

The crawler keeps on timing ou.

Ivan Vasiljević (ivanvs)

Hi CrewBloom,

Thank you for contact me, it seems that they have changed something in structure of HTML on some pages. I will take a look.

Thank you for informing me about this issue.

Ivan Vasiljević (ivanvs)

Hi CrewBloom,

I checked log and do some debugging. It seems that in general parser is working. I fixed one minor bug. The problem here is that after some time Craigslist is detecting that it is being parsed. Have you enabled Automatic proxy like I did on picture below?

That should help you with this issue. Also I have add some additional configuration so that it would be harder for the Craigslist to detect that we are scraping it.

paomontero-owner

Thanks! Will test it out now.

-- [image: Crewbloom] Jesus Paulo Montero (He/Him) Chief Technology Officer, CrewBloom

O. +1 (718) 747-8756 https://www.linkedin.com/company/crewbloom https://www.facebook.com/crewbloom/ https://www.instagram.com/crewbloom/ https://www.tiktok.com/@crewbloom https://crewbloom.com/30-minute-strategy-session/ https://crewbloom.zohodesk.com/portal/en/newticket

This email contains confidential information and is intended only for the individual to whom it is addressed.

paomontero-owner

Hi Ivan,

I am getting this error message when running your actor:

[image: image.png]

And I am not getting any results.

Kindly advise.

Thanks,

-- [image: Crewbloom] Jesus Paulo Montero (He/Him) Chief Technology Officer, CrewBloom

This email contains confidential information and is intended only for the individual to whom it is addressed.

Ivan Vasiljević (ivanvs)

Let me check what is happening with this.

Ivan Vasiljević (ivanvs)

Hi Paulo,

I checked the issue. Craigslist has changed structure of html. I have fixed the issue, I've tested quiet a few urls, and it seems that everything should work now.

Also, I've added additional field that could be interesting for you. On job posts I've managed to parse company name on pages where company name exists.

Thank you for informing me about this issue. Sorry for this inconvenience.

mr415

In the description of this actor is says contact details are available. Does that direct email address, or something different?

Ivan Vasiljević (ivanvs)

It is email address that you get when you press "Replay" button. It takes a lot of time to load this information and it is protected with captcha. So it will increase time needed to scrape page.

Add comment

Developer

Ivan Vasiljević

Actor Metrics

14 monthly users
5 stars
>99% runs succeeded
6.7 days response time
Created in Sep 2022
Modified 20 days ago

Categories

Jobs

Lead generation

Craigslist Scraper (Pay Per Result)

ivanvs/craigslist-scraper-pay-per-result

Ivan Vasiljević

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

19.8k

417

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

60.8k

554

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15.4k

200

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor and lead scraper to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

25.1k

209

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

79.7k

601

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.3k

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

21.2k

167

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!