Timeout Error

I'm also running into this issue

How long is your timeout set to?

2023-03-29T05:58:05.882Z ACTOR: Pulling Docker image from repository. 2023-03-29T05:58:14.756Z ACTOR: Creating Docker container. 2023-03-29T05:58:15.385Z ACTOR: Starting Docker container. 2023-03-29T05:58:16.540Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2023-03-29T05:58:16.545Z Executing main command 2023-03-29T05:58:17.549Z INFO System info {"apifyVersion":"1.3.4","apifyClientVersion":"1.4.2","osType":"Linux","nodeVersion":"v16.19.0"} 2023-03-29T05:58:17.671Z DEBUG RequestList: Loaded state from key value store using the persistStateKey. 2023-03-29T05:58:18.351Z INFO Starting the crawl. 2023-03-29T05:58:18.409Z DEBUG PuppeteerCrawler:SessionPool: Recreating state from KeyValueStore {"persistStateKeyValueStoreId":"upwork-sessions","persistStateKey":"SDK_SESSION_POOL_STATE"} 2023-03-29T05:58:18.412Z DEBUG PuppeteerCrawler:SessionPool: 0 active sessions loaded from KeyValueStore 2023-03-29T05:58:18.437Z DEBUG PuppeteerCrawler:AutoscaledPool: scaling up {"oldConcurrency":1,"newConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.6,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}} 2023-03-29T05:58:18.439Z INFO PuppeteerCrawler:AutoscaledPool: state {"currentConcurrency":0,"desiredConcur... [trimmed]

The failure is at 2023-03-29T05:59:18.920Z TimeoutError: waiting for selector .fe-proposal-more-connects-needed-dialog .desktop-size-controls button failed: timeout 5000ms exceeded

How do I set the timeout?

In Input -> Options

Isn't that the run timeout? The issue seems to be a PuppeteerCrawler timeout waiting for html elements to appear.

I'm getting the error with timeout = 0

ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.upwork.com/ab/proposals/job/~01792c185ef33e27e2/apply/","retryCount":2,"id":"pmp4ZGscKAxp4u5"} 2023-03-29T21:06:14.198Z TimeoutError: waiting for selector .cover-letter-area textarea failed: timeout 5000ms exceeded 2023-03-29T21:06:14.199Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34) 2023-03-29T21:06:14.200Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26) 2023-03-29T21:06:14.201Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77) 2023-03-29T21:06:14.202Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29) 2023-03-29T21:06:14.202Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51) 2023-03-29T21:06:14.203Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33) 2023-03-29T21:06:14.204Z at exports.focusAndType (/home/myuser/src/tools.js:35:20) 2023-03-29T21:06:14.204Z at runMicrotasks () 2023-03-29T21:06:14.205Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2023-03... [trimmed]

https://www.upwork.com/ab/proposals/job/~01792c185ef33e27e2/apply/

If you open the URL, the job was removed. This is why you're getting an error with this job.

You're right about that one. But this 2nd one is active

ERROR PuppeteerCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.upwork.com/ab/proposals/job/~012345924a448a7820/apply/","retryCount":3,"id":"IanfpQwPkwEddUo"} 2023-03-29T21:12:04.050Z TimeoutError: waiting for selector .cover-letter-area textarea failed: timeout 5000ms exceeded 2023-03-29T21:12:04.051Z at new WaitTask (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:509:34) 2023-03-29T21:12:04.051Z at DOMWorld.waitForSelectorInPage (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:420:26) 2023-03-29T21:12:04.052Z at Object.internalHandler.waitFor (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/QueryHandler.js:31:77) 2023-03-29T21:12:04.053Z at DOMWorld.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/DOMWorld.js:313:29) 2023-03-29T21:12:04.053Z at Frame.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/FrameManager.js:841:51) 2023-03-29T21:12:04.054Z at Page.waitForSelector (/home/myuser/node_modules/puppeteer/lib/cjs/puppeteer/common/Page.js:1333:33) 2023-03-29T21:12:04.054Z at exports.focusAndType (/home/myuser/src/tools.js:35:20) 2023-03-29T21:12:04.055Z at runMicrotasks () 2023-03-29T21:12:04.056Z at processTicksAndRejections (node:internal/process/task_queues:96:5)

Is this every run, or a few runs?

In a sample size of 20, I had 17 succeed and 3 fail.

One sec I think I might know why

{ "username": "gregoryprosper@gmail.com", "password": "[Redacted]", "testMode": true, "debugMode": true, "startUrls": [ { "url": "https://www.upwork.com/ab/proposals/job/~01717f434986da189c/apply/" } ], "coverLetter": "Hello,\r\n\r\nI'd love to assist you with your development needs.\r\n\r\nIf you'd like to know more about me. Let me start by saying, I love to build things! I'm the type of developer that needs to know how everything works. There's not a single line of code that I write, and I don't understand why it's there. I've personally built four apps across iOS & Android and manage them daily. You can find more info on them in the links below. I know what it takes to bring an idea from conception to reality. I've put in the late-night hours fixing bugs even though I have to be at my day job in the morning, where I also build apps. 😆\r\n\r\nStyles4Nailz\r\nhttps://styles4nailz.com\r\n\r\nHaitian Creole Bible \r\nhttps://creolebible.com\r\n\r\nFamily Frame\r\nhttps://play.google.com/store/apps/details?id=com.duvemessenger.familyframe\r\n\r\nBranded Pix\r\nhttps://play.google.com/store/apps/details?id=com.palmbeachsoftware.brandedpix\r\n\r\nI would love to use my experiences from my day job as a Senior Software Developer as well as my experience as an Entrepreneur/Developer to help you bring your ideas to life.\r\n\r\nAn important note is that I currently hold a full-time Android Developer position so I'm looking for something part-... [trimmed]

Does anything seem off?

You should add a proxy

Here's a sample query of a successful call

{ "username": "patrick@big-brain.co", "password": "redacted", "startUrls": [{ "url": "https://www.upwork.com/ab/proposals/job/~01d44f3f2429b9703e/apply/#/", "method": "GET" }], "coverLetter": "Hi, Great to connect! I am an expert in data and automation and can help with your lead generation. A few things I can do: - Get thousands of email addresses from Linkedin every day. - Email sequences where if someone clicks on a link in a sales email, they automatically get a Linkedin connection request from you. - Personalize Linkedin outreach at scale. For example, someone with a marketing title gets one message and someone with an operations title gets a different message. Comment on where they went to school, a skill they have, or mention a shared connection - without even opening their Linkedin profile yourself. - Build a fully automated newsletter that finds new content, curates it for relevancy, formats it into a templated format and sends it out to your subscribers on a weekly basis. No need for a human. That’s just the beginning! Don’t hire anyone who can just write an email, hire me and I’ll show you what’s possible. Pick a time that works to connect: https://www.big-brain.co/contact Patrick", "defaultAnswer": "Let's get on a call.", "securityQuestion": "redacted", "proxyConfig": { "useApifyProxy": true, "apifyProxyGroups": [ "qfCaFFuCodXxAS59E" ] }, "debugMode": true, "t... [trimmed]

Got it!!!! Verification by device was on