Indeed Scraper avatar
Indeed Scraper
Try for free

Pay $5.00 for 1,000 results

View all Actors
Indeed Scraper

Indeed Scraper

misceres/indeed-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

User avatar

Daily Run Via API For Specific Roles

Closed

Chambiar opened this issue
6 months ago

Hello, I am trying to figure out if we can set up a daily task so that we can make a request to run a scrape but for specific roles that can change daily. The requested roles will depend on demand from our users. So for example if we have 1000 users who want engineering roles and 500 who want mechanic on Monday but on Tuesday we have 300 cashiers and 500 welder, is that possible? How could we set this up so its autonomous?

User avatar

Hi, there are several ways to do it:

  1. You can use API to run the Actor: Assuming you have an array of roles for the current day, for each requested role send POST request to https://api.apify.com/v2/acts/misceres~indeed-scraper/runs?token=<YOUR_APIFY_TOKEN> and specify input in the body:
1{
2    "country": "US",
3    "followApplyRedirects": false,
4    "maxConcurrency": 1,
5    "maxItems": 5,
6    "parseCompanyDetails": false,
7    "position": "<REQUESTED_ROLE>",
8    "saveOnlyUniqueItems": true
9}

Alternatively you can run the Actor only once, where all requested roles are put in position separated by comma : "position": "engineer, cashier, welder".

  1. Another approach would be to create a task, where you set non-changing parameters of the run (for examle country or maxItems). Then, similarly to running the actor, you send POST request to https://api.apify.com/v2/actor-tasks/<YOUR_INDEED_TASK>/runs?token=<YOUR_APIFY_TOKEN> and specify position in the body:
1{
2    "position": "<REQUESTED_ROLE>"
3}
  1. You could also create a task for each role, but that would be overkill if you have many roles.

Let me know if you have any more questions.

Developer
Maintained by Apify
Actor metrics
  • 452 monthly users
  • 99.9% runs succeeded
  • 6.3 days response time
  • Created in Mar 2023
  • Modified 13 days ago
Categories