Craigslist Scraper avatar

Craigslist Scraper

Try for free

3 days trial then $10.00/month - No credit card required now

Go to Store
Craigslist Scraper

Craigslist Scraper

zscrape/craigslist-scraper
Try for free

3 days trial then $10.00/month - No credit card required now

Scrapes Craigslist for new posts matching your search criteria and sends an email alert. Ideal for finding new leads, items for sale, housing, job postings, gigs, and more! Be the first to respond to new posts.

LI

Crawler erroring out unexpectedly

Closed

lijern opened this issue
a year ago

I first tried using this crawler today but it keeps erroring out. Log here-

2023-11-03T17:36:38.745Z ACTOR: Pulling Docker image of build zZwYDpP5V63mBThlO from repository. 2023-11-03T17:37:39.972Z ACTOR: Pulling Docker image of build zZwYDpP5V63mBThlO from repository. 2023-11-03T17:37:40.089Z ACTOR: Creating Docker container. 2023-11-03T17:37:40.209Z ACTOR: Starting Docker container. 2023-11-03T17:37:40.845Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2023-11-03T17:37:40.848Z Executing main command 2023-11-03T17:37:40.859Z _XSERVTransmkdir: ERROR: euid != 0,directory /tmp/.X11-unix will not be created. 2023-11-03T17:37:42.015Z INFO System info {"apifyVersion":"1.3.4","apifyClientVersion":"1.4.2","osType":"Linux","nodeVersion":"v18.16.0"} 2023-11-03T17:38:13.570Z ERROR 2023-11-03T17:38:13.572Z TimeoutError: Navigation timeout of 30000 ms exceeded 2023-11-03T17:38:13.574Z at /home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/LifecycleWatcher.js:106:111 2023-11-03T17:38:13.576Z at async FrameManager.waitForFrameNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:127:23) 2023-11-03T17:38:13.578Z at async Frame.waitForNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:440:16) 2023-11-03T17:38:13.581Z at async Page.waitForNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:829:16) ... [trimmed]

zscrape avatar

Hi lijern, I added a fix. Please try again and let me know

LI

lijern

a year ago

Hi Andrew,

It now ran, but there was no output: https://console.apify.com/actors/r8x53fkwxq4EcrQB3/runs/Zea1vuoJPk4bF0PDO#log It also took 38 seconds- would limiting results (once there are results) shorten that time frame?

Thanks, Liam

zscrape avatar

This output is normal for the first run (saves results). It will compare the next run if anything is new.

Developer
Maintained by Community

Actor Metrics

  • 2 monthly users

  • 2 stars

  • >99% runs succeeded

  • Created in Apr 2021

  • Modified a month ago