Upwork Job Scraper avatar
Upwork Job Scraper

Pricing

$25.00/month + usage

Go to Store
Upwork Job Scraper

Upwork Job Scraper

Developed by

Neatrat

Neatrat

Maintained by Community

Scrape Upwork jobs without limits 🌟 Bypass CAPTCHAs & apply custom filters.

4.6 (6)

Pricing

$25.00/month + usage

14

Total users

127

Monthly users

101

Runs succeeded

97%

Issues response

10 hours

Last modified

2 days ago

OT

Cookies issue

Closed

OtisB opened this issue
2 months ago

Hey man, thanks again so much for enabling the cookies feature in your scraper. I've been playing around with it for some time now and even had AI help make sure that I'm doing it properly, but I'm still having issues.

It took a couple tries to get it to actually scrape jobs to begin with, but I finally got it. However, the whole reason that I asked for the cookies functionality was so that I could enable location based jobs only. For example, I'm in the United States, so I only wanna scrape jobs that are looking for US based freelancers.

However, now that I'm running this, it doesn't seem to be functioning the way that I am thought I would considering our previous conversation. It's still providing me with jobs that are worldwide as opposed to exclusive to the United States. I've double checked my cookies, my search URLs and I've actually double checked the links of the jobs that are being scraped to make sure that I'm not crazy.

Please help me out! I need to only scrape jobs that are looking for freelancers in the United States.

neatrat avatar

Hey Otis! Really sorry for the delay in getting back to you. I looked into it further and noticed that Upwork has changed how they handle sessions with cookies, that’s what’s causing the issues with the "only US" search. I’m working on it and should have it sorted in the next couple of days (or less) Thanks a lot for your patience, and again, sorry for the delay!

neatrat avatar

Hey there Otis! 👋

Great news! You can now filter jobs specifically for USA applicants using the new allowedApplicantCountries filter without the hassle of setting cookies:

{
"customFilters": [
{
"key": "allowedApplicantCountries",
"operator": "includes",
"value": "United States"
}
]
}

For best results, I recommend:

  1. Setting perPage to 50 to get more jobs per request
  2. If you're using a raw URL, add &location=United%2520States to only search for clients from the US (If you're using apify's inputs you'll see the location input)

I've also added two other major properties which you can filter as well:

  • clientLocation: Location of the job's client
  • paymentVerified: Whether the client has verified payment (either true, false or unknown)

All features are documented in the README. Let me know if this works for you!