Indeed Scraper avatar
Indeed Scraper

Pricing

$5.00 / 1,000 results

Go to Store
Indeed Scraper

Indeed Scraper

Developed by

Misceres

Misceres

Maintained by Apify

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

4.4 (29)

Pricing

$5.00 / 1,000 results

381

Total users

11K

Monthly users

1.6K

Runs succeeded

>99%

Issues response

23 days

Last modified

11 days ago

SA

startURLs array not working

Closed

socialime_agency opened this issue
a year ago

Hi, I'm trying to use the "startUrls" parameter, but no matter what URL I use i keep on getting the same error: "Input is not valid: Items in input.startUrls at positions [0] do not contain valid URLs"

I tried the URL with and without the https:// prefix, and the www prefix. I have even tried using the example URL provided in the description, https://www.indeed.com/cmp/Google/jobs, and that one still results in the same error. Is this an issue with the actor?

lhotanok avatar

Hello, please, try to use the following input format:

{
"followApplyRedirects": true,
"maxConcurrency": 5,
"maxItems": 50,
"parseCompanyDetails": false,
"saveOnlyUniqueItems": true,
"startUrls": [
{
"url": "https://www.indeed.com/cmp/Google/jobs"
}
]
}

This format worked OK for me, see an example run: https://console.apify.com/view/runs/m3U1AcMJqKc8ViAoz

It seems that you may be using a wrong format of startUrls based on the error message you provided: Input is not valid: Items in input.startUrls at positions [0] do not contain valid URLs. A start URL must be specified as an object with a single field url (not as a string):

{
"url": "https://www.indeed.com/cmp/Google/jobs"
}

The input editor gave me the same error message when I provided a start URL as a simple string - see the attached images. The Actor uses this expanded object format with url field mainly for legacy reasons so you may see simplified string startUrls in some of our other Actors.

You may also try to use the regular graphical editor instead of the JSON editor and it should fill in start URLs in the right format for you (see the last attached image).