3 days trial then $30.00/month - No credit card required now
Craigslist Scraper
3 days trial then $30.00/month - No credit card required now
Scrapes Craigslist for new posts matching your search criteria and sends an email alert. Ideal for finding new leads, items for sale, housing, job postings, gigs, and more! Be the first to respond to new posts.
Crawler erroring out unexpectedly
Closed
I first tried using this crawler today but it keeps erroring out. Log here-
2023-11-03T17:36:38.745Z ACTOR: Pulling Docker image of build zZwYDpP5V63mBThlO from repository. 2023-11-03T17:37:39.972Z ACTOR: Pulling Docker image of build zZwYDpP5V63mBThlO from repository. 2023-11-03T17:37:40.089Z ACTOR: Creating Docker container. 2023-11-03T17:37:40.209Z ACTOR: Starting Docker container. 2023-11-03T17:37:40.845Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2023-11-03T17:37:40.848Z Executing main command 2023-11-03T17:37:40.859Z _XSERVTransmkdir: ERROR: euid != 0,directory /tmp/.X11-unix will not be created. 2023-11-03T17:37:42.015Z INFO System info {"apifyVersion":"1.3.4","apifyClientVersion":"1.4.2","osType":"Linux","nodeVersion":"v18.16.0"} 2023-11-03T17:38:13.570Z ERROR 2023-11-03T17:38:13.572Z TimeoutError: Navigation timeout of 30000 ms exceeded 2023-11-03T17:38:13.574Z at /home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/LifecycleWatcher.js:106:111 2023-11-03T17:38:13.576Z at async FrameManager.waitForFrameNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:127:23) 2023-11-03T17:38:13.578Z at async Frame.waitForNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:440:16) 2023-11-03T17:38:13.581Z at async Page.waitForNavigation (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:829:16) 2023-11-03T17:38:13.583Z at async /home/myuser/main.js:15:5 2023-11-03T17:38:13.585Z at async run (/home/myuser/node_modules/apify/build/actor.js:182:13)
Hi lijern, I added a fix. Please try again and let me know
lijern
Hi Andrew,
It now ran, but there was no output: https://console.apify.com/actors/r8x53fkwxq4EcrQB3/runs/Zea1vuoJPk4bF0PDO#log It also took 38 seconds- would limiting results (once there are results) shorten that time frame?
Thanks, Liam
This output is normal for the first run (saves results). It will compare the next run if anything is new.
Andrew Taylor- 7 monthly users
- 73.8% runs succeeded
- 5.3 days response time
- Created in Apr 2021
- Modified 24 days ago
