Upwork Job Scraper
Pricing
$25.00/month + usage
Upwork Job Scraper
Scrape Upwork jobs without limits 🌟 Bypass CAPTCHAs & apply custom filters.
5.0 (5)
Pricing
$25.00/month + usage
29
Total users
478
Monthly users
256
Runs succeeded
>99%
Issues response
5 hours
Last modified
15 days ago
Not scrapping all jobs
Open
Hey there hope you are doing good,
I have been trying this actor for last 2 days and I felt that I have been missing few jobs in my list so I tried getting all the jobs at the URL in last 24 hours and it returned only 10 jobs
here's the Json
{ "maxJobAge": { "value": 24, "unit": "hours" }, "paymentVerified": false, "rawUrl": "https://www.upwork.com/nx/search/jobs/?payment_verified=1&q=automation%20AND%20NOT%20%28full%20OR%20stack,%20OR%20python,%20OR%20developement%29" }
it is impossible that this URL has only 10 jobs in last 24 hours let me know if I am using this wrong and help me
Thank you
Hey Riddhi! Thanks for reaching out, I'm doing great, hope you are too!
With your current JSON, you're getting the latest results from the rawUrl you're passing, exactly as you'd see them if you visited the URL directly. The maxJobAge parameter acts as a filter, so it removes any jobs older than 24 hours.
By default, the scraper returns 10 jobs (again, just like what you'd see when visiting the URL).
To get more results, set "pagesToScrape" to 20 (this scrapes 20 pages), and add "&per_page=50" to your rawUrl to get 50 jobs per page.
This way, you can get up to 1,000 jobs in a single scrape!
Let me know if this solves your issue!
riddhi898
Hello Thank you for your reply
Unfortunetly I do not see the result
Here's the JSON, I have removed time filter and set pages to scrape 20 and jobs per page is 50
{ "pagesToScrape": 20, "paymentVerified": false, "perPage": 50, "rawUrl": "https://www.upwork.com/nx/search/jobs/?payment_verified=1&q=automation%20AND%20NOT%20%28full%20OR%20stack,%20OR%20python,%20OR%20developement%29" }
I received 60 jobs, I am using another scrapper as well that returned 150 jobs with 3 pages and 50 jobs per page
It would really Help If this scrapper can work for me as your scrapper has one data point that is most important for me which is not provided by any other scrapper I have tried all there is on Apify
Thank you Riddhi
Hey Riddhi, when passing rawUrl, all other input building properties are ignored, like perPage, you should add the "per_page" query parameter within your raw url. I've just ran your json with "per_page" set to 50 and I'm already at 300+ jobs.
{ "pagesToScrape": 20, "rawUrl": "https://www.upwork.com/nx/search/jobs/?payment_verified=1&per_page=50&q=automation%20AND%20NOT%20%28full%20OR%20stack,%20OR%20python,%20OR%20developement%29", "page": 1, "sort": "newest" }
Note that I've added &per_page=50 within your rawUrl.
Try this out and let me know. Thanks!
