7 days trial then $5.00/month - No credit card required now

Indeed Jobs Scraper | Remove Duplicate Jobs

cheap_scraper/indeed-jobs-scraper-remove-duplicate-jobs

7 days trial then $5.00/month - No credit card required now

Price for 1000 jobs ≈ $2.5 using datacenter proxies. The Indeed job scraper allows you to collect jobs in 2 ways: 1. By providing one or more start URLs, or 2. By entering keyword-based search queries.

You can access the Indeed Jobs Scraper | Remove Duplicate Jobs programmatically from your own applications by using the Apify API. You can choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

1{
2  "openapi": "3.0.1",
3  "info": {
4    "version": "0.0",
5    "x-build-id": "L5TnQHCrgV3Ipcfpn"
6  },
7  "servers": [
8    {
9      "url": "https://api.apify.com/v2"
10    }
11  ],
12  "paths": {
13    "/acts/cheap_scraper~indeed-jobs-scraper-remove-duplicate-jobs/run-sync-get-dataset-items": {
14      "post": {
15        "operationId": "run-sync-get-dataset-items-cheap_scraper-indeed-jobs-scraper-remove-duplicate-jobs",
16        "x-openai-isConsequential": false,
17        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
18        "tags": [
19          "Run Actor"
20        ],
21        "requestBody": {
22          "required": true,
23          "content": {
24            "application/json": {
25              "schema": {
26                "$ref": "#/components/schemas/inputSchema"
27              }
28            }
29          }
30        },
31        "parameters": [
32          {
33            "name": "token",
34            "in": "query",
35            "required": true,
36            "schema": {
37              "type": "string"
38            },
39            "description": "Enter your Apify token here"
40          }
41        ],
42        "responses": {
43          "200": {
44            "description": "OK"
45          }
46        }
47      }
48    },
49    "/acts/cheap_scraper~indeed-jobs-scraper-remove-duplicate-jobs/runs": {
50      "post": {
51        "operationId": "runs-sync-cheap_scraper-indeed-jobs-scraper-remove-duplicate-jobs",
52        "x-openai-isConsequential": false,
53        "summary": "Executes an Actor and returns information about the initiated run in response.",
54        "tags": [
55          "Run Actor"
56        ],
57        "requestBody": {
58          "required": true,
59          "content": {
60            "application/json": {
61              "schema": {
62                "$ref": "#/components/schemas/inputSchema"
63              }
64            }
65          }
66        },
67        "parameters": [
68          {
69            "name": "token",
70            "in": "query",
71            "required": true,
72            "schema": {
73              "type": "string"
74            },
75            "description": "Enter your Apify token here"
76          }
77        ],
78        "responses": {
79          "200": {
80            "description": "OK",
81            "content": {
82              "application/json": {
83                "schema": {
84                  "$ref": "#/components/schemas/runsResponseSchema"
85                }
86              }
87            }
88          }
89        }
90      }
91    },
92    "/acts/cheap_scraper~indeed-jobs-scraper-remove-duplicate-jobs/run-sync": {
93      "post": {
94        "operationId": "run-sync-cheap_scraper-indeed-jobs-scraper-remove-duplicate-jobs",
95        "x-openai-isConsequential": false,
96        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
97        "tags": [
98          "Run Actor"
99        ],
100        "requestBody": {
101          "required": true,
102          "content": {
103            "application/json": {
104              "schema": {
105                "$ref": "#/components/schemas/inputSchema"
106              }
107            }
108          }
109        },
110        "parameters": [
111          {
112            "name": "token",
113            "in": "query",
114            "required": true,
115            "schema": {
116              "type": "string"
117            },
118            "description": "Enter your Apify token here"
119          }
120        ],
121        "responses": {
122          "200": {
123            "description": "OK"
124          }
125        }
126      }
127    }
128  },
129  "components": {
130    "schemas": {
131      "inputSchema": {
132        "type": "object",
133        "properties": {
134          "startUrls": {
135            "title": "Start URLs",
136            "type": "array",
137            "description": "One or more URLs of the pages where the crawler will start. Note that the Actor will additionally crawl job page data.",
138            "items": {
139              "type": "object",
140              "required": [
141                "url"
142              ],
143              "properties": {
144                "url": {
145                  "type": "string",
146                  "title": "URL of a web page",
147                  "format": "uri"
148                }
149              }
150            }
151          },
152          "keywords": {
153            "title": "Keywords",
154            "type": "array",
155            "description": "Keyword to search for. (e.g., ['Software Engineer', 'Data Scientist', 'Product Manager']). JSON field name: `keywords`"
156          },
157          "country": {
158            "title": "Country",
159            "enum": [
160              "US",
161              "AR",
162              "AU",
163              "AT",
164              "BE",
165              "BR",
166              "CA",
167              "DE",
168              "ES",
169              "FR",
170              "HK",
171              "IN",
172              "IE",
173              "IT",
174              "MX",
175              "NL",
176              "NZ",
177              "SA",
178              "SG",
179              "CH",
180              "GB",
181              "AE"
182            ],
183            "type": "string",
184            "description": "Select country (default is USA) Enhance accuracy by selecting the associated country. Data is drawn directly from country-specific indeed.com platforms, ensuring relevant outcomes for your location. JSON field name: `country`",
185            "default": "US"
186          },
187          "location": {
188            "title": "Location",
189            "type": "string",
190            "description": "Location to search in. JSON field name: `location`"
191          },
192          "publishedAt": {
193            "title": "Published At",
194            "minimum": 1,
195            "maximum": 30,
196            "type": "integer",
197            "description": "How old publications should be in Days. Default is ANY. JSON field name: `publishedAt``"
198          },
199          "saveOnlyUniqueItems": {
200            "title": "Save Only Unique Items",
201            "type": "boolean",
202            "description": "If enabled, only unique items will be saved. Default is false. JSON field name: `saveOnlyUniqueItems`",
203            "default": false
204          },
205          "maxItems": {
206            "title": "Maximum Items",
207            "maximum": 10000,
208            "type": "integer",
209            "description": "Maximum number of items to scrape. Default is none, it will scrape all the jobs it finds. JSON field name: `maxItems`"
210          },
211          "proxy": {
212            "title": "Proxy configuration",
213            "type": "object",
214            "description": "Select proxies to be used by your crawler. JSON field name: `proxy`"
215          }
216        }
217      },
218      "runsResponseSchema": {
219        "type": "object",
220        "properties": {
221          "data": {
222            "type": "object",
223            "properties": {
224              "id": {
225                "type": "string"
226              },
227              "actId": {
228                "type": "string"
229              },
230              "userId": {
231                "type": "string"
232              },
233              "startedAt": {
234                "type": "string",
235                "format": "date-time",
236                "example": "2025-01-08T00:00:00.000Z"
237              },
238              "finishedAt": {
239                "type": "string",
240                "format": "date-time",
241                "example": "2025-01-08T00:00:00.000Z"
242              },
243              "status": {
244                "type": "string",
245                "example": "READY"
246              },
247              "meta": {
248                "type": "object",
249                "properties": {
250                  "origin": {
251                    "type": "string",
252                    "example": "API"
253                  },
254                  "userAgent": {
255                    "type": "string"
256                  }
257                }
258              },
259              "stats": {
260                "type": "object",
261                "properties": {
262                  "inputBodyLen": {
263                    "type": "integer",
264                    "example": 2000
265                  },
266                  "rebootCount": {
267                    "type": "integer",
268                    "example": 0
269                  },
270                  "restartCount": {
271                    "type": "integer",
272                    "example": 0
273                  },
274                  "resurrectCount": {
275                    "type": "integer",
276                    "example": 0
277                  },
278                  "computeUnits": {
279                    "type": "integer",
280                    "example": 0
281                  }
282                }
283              },
284              "options": {
285                "type": "object",
286                "properties": {
287                  "build": {
288                    "type": "string",
289                    "example": "latest"
290                  },
291                  "timeoutSecs": {
292                    "type": "integer",
293                    "example": 300
294                  },
295                  "memoryMbytes": {
296                    "type": "integer",
297                    "example": 1024
298                  },
299                  "diskMbytes": {
300                    "type": "integer",
301                    "example": 2048
302                  }
303                }
304              },
305              "buildId": {
306                "type": "string"
307              },
308              "defaultKeyValueStoreId": {
309                "type": "string"
310              },
311              "defaultDatasetId": {
312                "type": "string"
313              },
314              "defaultRequestQueueId": {
315                "type": "string"
316              },
317              "buildNumber": {
318                "type": "string",
319                "example": "1.0.0"
320              },
321              "containerUrl": {
322                "type": "string"
323              },
324              "usage": {
325                "type": "object",
326                "properties": {
327                  "ACTOR_COMPUTE_UNITS": {
328                    "type": "integer",
329                    "example": 0
330                  },
331                  "DATASET_READS": {
332                    "type": "integer",
333                    "example": 0
334                  },
335                  "DATASET_WRITES": {
336                    "type": "integer",
337                    "example": 0
338                  },
339                  "KEY_VALUE_STORE_READS": {
340                    "type": "integer",
341                    "example": 0
342                  },
343                  "KEY_VALUE_STORE_WRITES": {
344                    "type": "integer",
345                    "example": 1
346                  },
347                  "KEY_VALUE_STORE_LISTS": {
348                    "type": "integer",
349                    "example": 0
350                  },
351                  "REQUEST_QUEUE_READS": {
352                    "type": "integer",
353                    "example": 0
354                  },
355                  "REQUEST_QUEUE_WRITES": {
356                    "type": "integer",
357                    "example": 0
358                  },
359                  "DATA_TRANSFER_INTERNAL_GBYTES": {
360                    "type": "integer",
361                    "example": 0
362                  },
363                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
364                    "type": "integer",
365                    "example": 0
366                  },
367                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
368                    "type": "integer",
369                    "example": 0
370                  },
371                  "PROXY_SERPS": {
372                    "type": "integer",
373                    "example": 0
374                  }
375                }
376              },
377              "usageTotalUsd": {
378                "type": "number",
379                "example": 0.00005
380              },
381              "usageUsd": {
382                "type": "object",
383                "properties": {
384                  "ACTOR_COMPUTE_UNITS": {
385                    "type": "integer",
386                    "example": 0
387                  },
388                  "DATASET_READS": {
389                    "type": "integer",
390                    "example": 0
391                  },
392                  "DATASET_WRITES": {
393                    "type": "integer",
394                    "example": 0
395                  },
396                  "KEY_VALUE_STORE_READS": {
397                    "type": "integer",
398                    "example": 0
399                  },
400                  "KEY_VALUE_STORE_WRITES": {
401                    "type": "number",
402                    "example": 0.00005
403                  },
404                  "KEY_VALUE_STORE_LISTS": {
405                    "type": "integer",
406                    "example": 0
407                  },
408                  "REQUEST_QUEUE_READS": {
409                    "type": "integer",
410                    "example": 0
411                  },
412                  "REQUEST_QUEUE_WRITES": {
413                    "type": "integer",
414                    "example": 0
415                  },
416                  "DATA_TRANSFER_INTERNAL_GBYTES": {
417                    "type": "integer",
418                    "example": 0
419                  },
420                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
421                    "type": "integer",
422                    "example": 0
423                  },
424                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
425                    "type": "integer",
426                    "example": 0
427                  },
428                  "PROXY_SERPS": {
429                    "type": "integer",
430                    "example": 0
431                  }
432                }
433              }
434            }
435          }
436        }
437      }
438    }
439  }
440}

Indeed Jobs Scraper | Remove Duplicate Jobs OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for Indeed Jobs Scraper | Remove Duplicate Jobs from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

Indeed Jobs Scraper | Remove Duplicate Jobs API in Python

Indeed Jobs Scraper | Remove Duplicate Jobs API in JavaScript

Indeed Jobs Scraper | Remove Duplicate Jobs API through CLI

Indeed Jobs Scraper | Remove Duplicate Jobs API

Developer

cheap_scraper

Actor Metrics

2 monthly users
1 star
>99% runs succeeded
Created in Jan 2025
Modified a day ago

Categories

Jobs

Developer tools

Automation

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

34.3k

949

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.2k

109

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

75k

403

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.2k

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

5.6k

164

Youtube Video Downloader

epctex/youtube-video-downloader

Effortlessly download YouTube videos of your preferred quality with our user-friendly Video Downloader. Try it now!

epctex

692

Indeed Scraper

misceres/indeed-scraper

Scrape jobs posted on Indeed. Get detailed information from this job portal about saved and sponsored jobs. Specify the search based on location with the output attributes position, location, and description.

Misceres

6.2k

196

Indeed job scraper

curious_coder/indeed-scraper

This is an actively maintained scraper which can extract job postings and hiring company details at scale from any indeed search results page for a fixed monthly rental price. Well documented with examples and demos

Curious Coder

1.1k

Fast TikTok API (with no-watermark video download link)

novi/fast-tiktok-api

All in one TikTok APIs. Fastest TikTok API for Trend, Hashtag, Search, Music, User, Comment. Provides no-watermark download link.

Novi

995

Instagram Followers Count Scraper

apify/instagram-followers-count-scraper

Scrape the number of followers & follows from any Instagram profile. Schedule the scraper to run regularly to monitor how the numbers change. You can also export scraped data, run the scraper via API, monitor runs or integrate with other tools.

Apify

3.5k