Indeed job scraper avatar

Indeed job scraper

Try for free

1 day trial then $20.00/month - No credit card required now

View all Actors
Indeed job scraper

Indeed job scraper

curious_coder/indeed-scraper
Try for free

1 day trial then $20.00/month - No credit card required now

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

RO

Job types fields unusable

Closed

rayyala-owner opened this issue
3 months ago

The "Job Types" field in API output (like Zapier) is unusable due to improper formatting.

Problem:

  • API combines all job types into one field
  • Can't differentiate job types between records

Example:

In the attached Excel export, job types are saved like this:

  • jobTypes/0 "Permanent"
  • jobTypes/0 "Full-time", jobTypes/1 "Permanent"
  • jobTypes/0 "Full-time", jobTypes/1 "Permanent"

But in API integrations like Zapier, job types is available like this, making it impossible to know which job types belong to which record.:

  • Job Types "Permanent,Full-time,Permanent,Full-time,Permanent"
  • Job Types "Permanent,Full-time,Permanent,Full-time,Permanent"
  • Job Types "Permanent,Full-time,Permanent,Full-time,Permanent"

Possible solutions:

  • Send different columns for each job type in API output, OR
  • Use a different delimiter to separate records e.g. "Permanent,Full-time|Permanent,Full-time|Permanent"
curious_coder avatar

In order to quickly identify the reason of your issue, I need to inspect your run.

Please share the URL of the run where you faced this issue. You can find your runs on this page: https://console.apify.com/actors/runs

RO

rayyala-owner

3 months ago

Thanks for the quick reply! Here's the run: https://console.apify.com/view/runs/rgLrm8Uz97KPRETaM

Just to be clear, the Excel output is already good and doesn't need changes. The problem is with the API output. Btw this is a bug, not a feature request.

Current API behaviour:

  • Combines job types from multiple records into one string
  • Uses commas as delimiters, even though job type values can contain commas
  • This makes it impossible to determine which job types belong to which record

Example:

  • Job types for 3 records in the data: "Full-time,Permanent", "Part-time", "Contract,Temporary"
  • Current API output: "Full-time,Permanent,Part-time,Contract,Temporary"
  • This output is unusable because we can't tell where one record ends and another begins

Possible solutions:

  • Return an array of job types for each record
  • Use a different delimiter between values or records (like pipe "|", etc.)
  • Can we address this API output issue specifically?

Can we address this API output issue specifically?

RO

rayyala-owner

2 months ago

Any luck?

curious_coder avatar

This is not the issue with the scraper. It is either how apify zapier integration works or you need to change some configuration in your zapier integration to get the data correctly. You can contact Apify support team regarding this issue

The scraper is correctly storing the job types in array of job types for each records seperately

Developer
Maintained by Community

Actor Metrics

  • 102 monthly users

  • 19 stars

  • >99% runs succeeded

  • 3.3 days response time

  • Created in Jun 2023

  • Modified 2 days ago