Indeed Scraper avatar
Indeed Scraper
Try for free

Pay $5.00 for 1,000 results

View all Actors
Indeed Scraper

Indeed Scraper

misceres/indeed-scraper
Try for free

Pay $5.00 for 1,000 results

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

User avatar

startURLs array not working

Closed

socialime_agency opened this issue
a month ago

Hi, I'm trying to use the "startUrls" parameter, but no matter what URL I use i keep on getting the same error: "Input is not valid: Items in input.startUrls at positions [0] do not contain valid URLs"

I tried the URL with and without the https:// prefix, and the www prefix. I have even tried using the example URL provided in the description, https://www.indeed.com/cmp/Google/jobs, and that one still results in the same error. Is this an issue with the actor?

User avatar

Hello, please, try to use the following input format:

1{
2    "followApplyRedirects": true,
3    "maxConcurrency": 5,
4    "maxItems": 50,
5    "parseCompanyDetails": false,
6    "saveOnlyUniqueItems": true,
7    "startUrls": [
8        {
9            "url": "https://www.indeed.com/cmp/Google/jobs"
10        }
11    ]
12}

This format worked OK for me, see an example run: https://console.apify.com/view/runs/m3U1AcMJqKc8ViAoz

It seems that you may be using a wrong format of startUrls based on the error message you provided: Input is not valid: Items in input.startUrls at positions [0] do not contain valid URLs. A start URL must be specified as an object with a single field url (not as a string):

1{
2  "url": "https://www.indeed.com/cmp/Google/jobs"
3}

The input editor gave me the same error message when I provided a start URL as a simple string - see the attached images. The Actor uses this expanded object format with url field mainly for legacy reasons so you may see simplified string startUrls in some of our other Actors.

You may also try to use the regular graphical editor instead of the JSON editor and it should fill in start URLs in the right format for you (see the last attached image).

Developer
Maintained by Apify
Actor metrics
  • 369 monthly users
  • 99.9% runs succeeded
  • 6.0 days response time
  • Created in Mar 2023
  • Modified 5 days ago
Categories