3 days trial then $10.00/month - No credit card required now

Craigslist Scraper

zscrape/craigslist-scraper

3 days trial then $10.00/month - No credit card required now

Scrapes Craigslist for new posts matching your search criteria and sends an email alert. Ideal for finding new leads, items for sale, housing, job postings, gigs, and more! Be the first to respond to new posts.

Back to issues Create new issue

Crawler erroring out unexpectedly

Closed

lijern opened this issue

I first tried using this crawler today but it keeps erroring out. Log here-

2023-11-03T17:36:38.745Z ACTOR: Pulling Docker image of build zZwYDpP5V63mBThlO from repository. 2023-11-03T17:37:39.972Z ACTOR: Pulling Docker image of build zZwYDpP5V63mBThlO from repository. 2023-11-03T17:37:40.089Z ACTOR: Creating Docker container. 2023-11-03T17:37:40.209Z ACTOR: Starting Docker container. 2023-11-03T17:37:40.845Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2023-11-03T17:37:40.848Z Executing main command 2023-11-03T17:37:40.859Z _XSERVTransmkdir: ERROR: euid != 0,directory /tmp/.X11-unix will not be created. 2023-11-03T17:37:42.015Z INFO System info {"apifyVersion":"1.3.4","apifyClientVersion":"1.4.2","osType":"Linux","nodeVersion":"v18.16.0"} 2023-11-03T17:38:13.570Z ERROR 2023-11-03T17:38:13.572Z TimeoutError: Navigation timeout of 30000 ms exceeded 2023-11-03T17:38:13.574Z at /home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/LifecycleWatcher.js:106:111 2023-11-03T17:38:13.576Z at async FrameManager.waitForFrameNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:127:23) 2023-11-03T17:38:13.578Z at async Frame.waitForNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:440:16) 2023-11-03T17:38:13.581Z at async Page.waitForNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:829:16) ... [trimmed]

ZScrape Solutions (zscrape)

Hi lijern, I added a fix. Please try again and let me know

lijern

Hi Andrew,

It now ran, but there was no output: https://console.apify.com/actors/r8x53fkwxq4EcrQB3/runs/Zea1vuoJPk4bF0PDO#log It also took 38 seconds- would limiting results (once there are results) shorten that time frame?

Thanks, Liam

ZScrape Solutions (zscrape)

This output is normal for the first run (saves results). It will compare the next run if anything is new.

Add comment

Developer

ZScrape Solutions

Actor Metrics

2 monthly users
2 stars
93% runs succeeded
Created in Apr 2021
Modified 9 days ago

Categories

Automation

E-commerce

Jobs

Craigslist Scraper (Pay Per Result)

ivanvs/craigslist-scraper-pay-per-result

Extract data from classified advertisements on Craigslist. Scrape contact details from jobs, housing, items wanted, items for sale, services, community service, gigs, events and resumes listed on Craigslist. Download listings data in JSON, XML, Excel, and other versatile

Ivan Vasiljević

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

18.1k

360

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

59.4k

510

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15k

191

Contact Details Scraper

vdrmota/contact-info-scraper

Free email extractor to extract and download emails, phone numbers, Facebook, Twitter, LinkedIn, and Instagram profiles from any website. Extract contact information at scale from lists of URLs and download the data as Excel, CSV, JSON, HTML, and XML.

Vojta Drmota

24.7k

196

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

79k

570

Facebook Groups Scraper

apify/facebook-groups-scraper

Extract data from one or multiple public Facebook groups. Get group and post URLs, post text, comments, timestamp, likes and comments count, and basic commentator info. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

7.2k

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

6.8k

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

20.6k

154

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!