Upwork Job Scraper avatar
Upwork Job Scraper

Pricing

$25.00/month + usage

Go to Store
Upwork Job Scraper

Upwork Job Scraper

Developed by

Matthew James

Matthew James

Maintained by Community

Scrape recent Upwork.com jobs with or without cookies. Fast and effective.

5.0 (2)

Pricing

$25.00/month + usage

15

Total users

248

Monthly users

33

Runs succeeded

>99%

Issues response

11 hours

Last modified

5 days ago

KD

Set cookies not used in crawl

Closed

kevin_damstra opened this issue
a month ago

Even though I set a cookie to retrieve more detailed information from Upwork, the log shows the cookies are not set;

2025-05-20T19:35:36.911Z INFO Successfully set 0 cookies.

Just wondering what the correct format is, or which cookies to set?

matthewjames avatar

You can put in all of your cookies, just use any chrome extension that grabs them and it needs to be in an array of objects like:

[
{
"domain": ".example.com",
"expirationDate": 1747552123,
"hostOnly": false,
"httpOnly": true,
"name": "cookie_1",
"path": "/",
"sameSite": "no_restriction",
"secure": true,
"session": false,
"storeId": "0",
"value": "k3j9x0q5l2m8z",
"id": 1
},
{
"domain": ".example.com",
"expirationDate": 1747638523,
"hostOnly": false,
"httpOnly": false,
"name": "cookie_2",
"path": "/",
"sameSite": "no_restriction",
"secure": true,
"session": false,
"storeId": "0",
"value": "b7v6t1n9y4h3p",
"id": 2
},
{
"domain": ".example.com",
"expirationDate": 1747724923,
"hostOnly": false,
"httpOnly": false,
"name": "cookie_3",
"path": "/",
"sameSite": "no_restriction",
"secure": true,
"session": false,
"storeId": "0",
"value": "q8w4r1e7t2y9u",
"id": 3
}
// …and so on for all entries
]
KD

kevin_damstra

a month ago

Alright, set the cookies but got a 403 response. Even though the link to Upwork is accessible by hand, the crawler gets a 403 forbidden response;

2025-05-21T08:58:43.263Z INFO PuppeteerCrawler: Starting the crawler. 2025-05-21T08:58:44.841Z INFO Successfully set 10 cookies. 2025-05-21T08:58:45.192Z WARN PuppeteerCrawler: Reclaiming failed request back to the list or queue. Received 403 status code for https://www.upwork.com/nx/search/jobs/?payment_verified=1&per_page=50&q=Automation&sort=recency 2025-05-21T08:58:45.193Z at PuppeteerCrawler.postNavigationHooks (file:///home/myuser/src/main.js:274:23) {"id":"XDXoyn1pEmX9Zcf","url":"https://www.upwork.com/nx/search/jobs/?payment_verified=1&per_page=50&q=Automation&sort=recency","retryCount":1}

Any ideas on how to overcome this?

matthewjames avatar

Oh wow, it looks like Upwork has changed something again.. Sorry, this actor will not work for the time being.