Work Scraper avatar

Work Scraper

Try for free

7 days trial then $40.00/month - No credit card required now

View all Actors
Work Scraper

Work Scraper

trudax/work-scraper
Try for free

7 days trial then $40.00/month - No credit card required now

Extract data from the top freelancing websites. Search by URL or search terms, filter by categories, English level, and hourly rate. Get info about freelancers and agencies without login. Download your data as an HTML table, JSON, CSV, Excel, or XML.

TE

Actor Returning 0 Results

Closed

testtheworkout opened this issue
a year ago

Hello, I tried twice on the latest build, and once on an older build and the actor is returning 0 results.

trudax avatar

I have tested the same URL here and was able to get results with no problems. Can you check if your login credentials are correct and try again?

TE

testtheworkout

a year ago

My credentials were set and saved and had been running for months with no problem. I also tried to input them again, save and run, and it's still returning 0 results for me. I tried to login to Upwork manually using the same credentials and secret word and I logged in with no problems, so I'm confident the credentials are correct (they were copied and pasted). I tried updating the proxy and that didn't work still returned 0 results. Any idea how to proceed?

TE

testtheworkout

a year ago

The problem still persists, I have again tried to login manually using the credentials with no problems, and have updated them again in the actor both on the saved runs and tried running it manually, here is the run ID: 62mV7tSWMZA2BDGrz - it's saying in the logs it's having a problem with the security question which I know is correct. I noticed that this pops up when I enter the security question (image attached), and I wonder if this is causing problems. i.e. the question is OK, but when this box pops up the script isn't handling it?

trudax avatar

Looking at the logs, it seems like the page didn't return any results for you but when I try it it is working. The pop-up and your credentials should not be a problem since the logs say that the scraper started looking for jobs. I have added more debug logs in a beta version of the scraper, can you run it once and share the run ID again so I can check if your run triggers a specific part of the code? Should be version 1.7.6.

TE

testtheworkout

a year ago

Thanks, here is the latest run ID, using beta: UbZkKWUIIjdw1X5M6

trudax avatar

Still the same. Is this happening just for one URL or all your runs are like this?

TE

testtheworkout

a year ago

I normally just run one URL everyday, and until a few days ago it worked. I check it every morning and it's the actor that most consistently returns the results.

I did just try a new URL to test (here is the run ID: Herz7e9iy17ZgR5HI) and again the actor returns 0 results for this URL as well.

Anything else I can try?

trudax avatar

Can you try without providing the login credentials? It will probably not return all the data but at least we will know if this is happening for your user only.

TE

testtheworkout

a year ago

Tried without the credentials with the same URL, here is the RUN ID: s5qrzZi4RhRqiJUfX

Returned three results - requested 100 but I appreciate it wasn't going to give this to me.

TE

testtheworkout

a year ago

I tried logging in using different Upwork credentials and faced the same problem of returning 0 records; here is the run ID: KdeQbQyOz3QMiCXPK

TE

testtheworkout

a year ago

Is there anything else I can try on this? Really keen to get it back up and going as it forms an important part of my workflow.

Let me know if there are any other settings I can try, or anything else I can provide.

trudax avatar

I am testing some improvements to see if I can fix this issue. It is a bit difficult since I am not able to replicate it on my side. I will let you know once I have a new beta version for you to try. I am almost done with it.

trudax avatar

I think I have found the issue. Can you try with the latest build (v1.7.8)?

TE

testtheworkout

a year ago

Unfortunately still returning 0 results; I have tried two runs logging in with two different Upwork accounts to see if that was the problem; here are the run IDs:

vvA9o9NbZTrXhUGtu 1bv3mlbivFwS7pTF3

I have also created a Loom so you can see all my settings in case there is something you can't see in the logs or from the run ID:

https://www.loom.com/share/7b943c16be254e219833bf7b1db67e38

I appreciate the effort you're putting in to try and fix this

trudax avatar

I don't see anything wrong with your settings. I have also tried with the same settings but for me works every time. I have made another beta release, this time it will take a screenshot if no jobs are found. Can you please run it and share the run ID so we can see what is going on?

TE

testtheworkout

a year ago

Thank you - here is the run ID when I have used 1.7.9:

ioYxlRKxVOOrmKVcD

Let me know if there's anything else I can run and try.

TE

testtheworkout

a year ago

If there's anything else I can do, or try, please let me know.

trudax avatar

Sorry for not responding early. I looked into the screenshots and the page was loaded with all the data. I will reach to Apify support to see if they can help me replicate your run and try to figure it out why you have no results.

TE

testtheworkout

a year ago

Awesome, thanks. Looking forward to resolving the problem :)

trudax avatar

I have release a new beta version, can you give it another try?

TE

testtheworkout

a year ago

Thanks, Gustavo, I tried running the Beta version, 1.7.10, here is the run ID: AEpoMtWqPHCfAnvBf

Still returning 0 results, unfortunately, but the error messages in the log do look a little different to before, so perhaps some clues in that.

trudax avatar

Yes, I have deployed a new beta version that might fix the issue. Can you check it out?

TE

testtheworkout

a year ago

Tried running the beta and it failed - Ha2oQsd9eJzyNWkYD - said there was an exception that was not handled, and it aborted itself.

TE

testtheworkout

a year ago

This is the exact error message: There was an uncaught exception during the run of the Actor and it was not handled.

I tried running it again with the same result: 8hC9a2jE2GXvxTdKS

TE

testtheworkout

a year ago

I tried running 1.7.12, just to see, with the same result: FekBtanePpsiSpgL9

trudax avatar

It seems like an internal error from Apify but I have never seen it before, even with v1.7.12. The error message says that there might be a misconfiguration in the crawler. Can you try to reset your input to default values and run it once to see if the same error happens?

trudax avatar

There is a button at the right since of the save input button for that.

TE

testtheworkout

a year ago

I tried resetting and running, and got the same error message - tried it twice:

Yd7PZoKTLONLcREku

Cavk51Uc7sVTScNfT

trudax avatar

Apify support told me to update my actor. Can you try the new beta version?

trudax avatar

Actually wait a bit more.

trudax avatar

Can you try it?

TE

testtheworkout

a year ago

Tried using the new 1.7.15 - Uf9GBZTvT5KifNiQH - There was an uncaught exception during the run of the Actor and it was not handled. Tried resetting all values to default, redoing them and using 1.7.15 - wRCCw6RrU54KlPVtn - There was an uncaught exception during the run of the Actor and it was not handled.

trudax avatar

Can you schedule a meeting with me so we can go over your issue in more detail? You can do that here: https://calendly.com/gustavorudiger

TE

testtheworkout

a year ago

Awesome, done for tomororw, thanks!

trudax avatar

I think now it will work, and it is faster!

TE

testtheworkout

a year ago

Anddd I now have results :) - thank you.

Only one problem now, I noticed that on the first page it scraped all of the results twice.

So when I asked for 50 I got 40 as the first page was duplicated.

It runs very quickly though!

Run ID if you want to see the result: STAxYqfsVncjGsmQy

trudax avatar

Nice, I have deployed a fix for the duplicated results.

TE

testtheworkout

a year ago

Just tested - first 10 results still duplicated using the latest actor: 4486x3eNuRvgX3oI7

trudax avatar

I am trying to keep the different ways of getting the data to avoid not getting any data at all so it is duplicating the results in some cases. I have another update in the beta version that might reduce the time the duplication occurs. Can you try it out?

Developer
Maintained by Community

Actor Metrics

  • 12 monthly users

  • 6 stars

  • 99% runs succeeded

  • 3.2 days response time

  • Created in Jun 2020

  • Modified 3 days ago

Categories