Work Scraper avatar

Work Scraper

Try for free

7 days trial then $40.00/month - No credit card required now

View all Actors
Work Scraper

Work Scraper

trudax/work-scraper
Try for free

7 days trial then $40.00/month - No credit card required now

Extract data from the top freelancing websites. Search by URL or search terms, filter by categories, English level, and hourly rate. Get info about freelancers and agencies without login. Download your data as an HTML table, JSON, CSV, Excel, or XML.

LT

Duplicate output items

Closed

altarey opened this issue
8 months ago

Running the Actor for the first times today via API. Noticed all results are duplicated jobs. How to fix this?

trudax avatar

I will take a look

trudax avatar

I have made some improvements. Can you try it once more?

LT

altarey

8 months ago

Thank you for a quick response.

  • Instead of 3 dups I see 2 dups now
  • The run has been marked as successful though I see failed status in the logs.
  • I expect more results than just 2 or 3. The maxItems value is set to 10.

input settings { "category": "531770282580668419", "debugMode": false, "maxItems": 10, "proxy": { "useApifyProxy": true }, "rhrs": false, "search": "AWS Developer United States", "searchFor": "job", "useBuiltInSearch": true, "startUrls": [ "https://www.upwork.com/search/profiles/" ] }

trudax avatar

I have found the issue, the new version should fix the problem. I have also added a flag to the input where you can enable or disable login.

LT

altarey

8 months ago

Nice. Now I get more unique jobs. But it seems the fix regressed applyUrl. It's no longer in output. Right side is the latest JSON.

trudax avatar

Ok, I see other things to improve also. I will work on it.

trudax avatar

Done

Developer
Maintained by Community

Actor Metrics

  • 12 monthly users

  • 6 stars

  • 99% runs succeeded

  • 3.2 days response time

  • Created in Jun 2020

  • Modified 3 days ago

Categories