# Clearedjobs Jobs Search Scraper (`alexist/clearedjobs-jobs-search-scraper`) Actor Scrape active security clearance job listings from ClearedJobs.net with precision. This scraper captures job titles, locations, company names, coordinates, posting dates, and 20+ fields per listing — perfect for defense contractors, HR teams, and staffing agencies. - **URL**: https://apify.com/alexist/clearedjobs-jobs-search-scraper.md - **Developed by:** [Alex](https://apify.com/alexist) (community) - **Categories:** Automation, Developer tools, Jobs - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## ClearedJobs Search Scraper: Extract Security Clearance Job Listings Fast --- ### What Is ClearedJobs.net? ClearedJobs.net is the leading specialized job board for positions requiring U.S. security clearances (Secret, Top Secret, SCI, and beyond). It connects federal contractors, defense agencies, and cleared professionals in a dedicated marketplace. Manual searching and collecting data across multiple pages is tedious and error-prone — the **ClearedJobs Search Scraper** automates extraction from search results pages, delivering structured records ready for analysis. --- ### Overview The **ClearedJobs Search Scraper** collects job listings from ClearedJobs.net search results pages, transforming live job data into clean, machine-readable records. It is ideal for: - **Defense contractors** monitoring competitor hiring and clearance demand - **Staffing agencies** building talent pipelines and market intelligence - **HR professionals** researching cleared talent availability by region - **Researchers** analyzing security clearance labor market trends - **Job aggregators** importing cleared positions into multi-source platforms The scraper handles multiple search result pages, respects URL failures gracefully, and allows configurable item limits to match your collection scope and budget. --- ### Input Format The scraper accepts a JSON configuration object: ```json { "urls": [ "https://clearedjobs.net/jobs?country=&state=&city=&zip=&latitude=&longitude=&keywords=&location_autocomplete_data=&city_state_zip=&locale=en&page=1&sort=relevance" ], "ignore_url_failures": true, "max_items_per_url": 20 } ```` #### Input Field Definitions | Field | Type | Description | Example | |---|---|---|---| | `urls` | Array | ClearedJobs search result page URLs to scrape. Include pagination URLs to collect multiple pages. | `["https://clearedjobs.net/jobs?page=1&sort=relevance", "https://clearedjobs.net/jobs?page=2&sort=relevance"]` | | `ignore_url_failures` | Boolean | If `true`, the scraper skips failed URLs and continues processing remaining URLs. If `false`, a single failed URL stops the entire run. | `true` / `false` | | `max_items_per_url` | Integer | Maximum number of job listings to extract per URL. Controls scrape scope and resource usage. Set higher for larger collections. | `20`, `50`, `100` | **Tips:** - Build URLs using ClearedJobs filters (keywords, location, clearance level) to target specific job types - Use pagination to scrape multiple result pages; include `page=1`, `page=2`, etc. - Set `max_items_per_url` to `0` for unlimited items, or cap at `50`–`100` for cost efficiency *** ### Output Format **Sample output** ```json { "id": 1919610, "title": "Mechanical Research and Development Engineer", "location": "State College", "coordinates": { "latitude": "0", "longitude": "0" }, "custom_block_list": [ { "id": 11, "block": "job_list", "path": "prepared_categories", "enabled": 1, "name": "front::jobs.additional_fields.categories", "relative_order": "1", "value": "Secret", "label": "Security Clearance" }, { "id": 18, "block": "job_list", "path": "location_extended_info", "enabled": 1, "name": "front::jobs.ji_location_extended_info", "relative_order": "2", "value": "State College", "label": "Location" }, { "id": 17, "block": "job_list", "path": "time", "enabled": 1, "name": "front::jobs.ji_posted", "relative_order": "6", "value": "July 14, 2026", "label": "Posted" } ], "short_description": "We are searching for a Mechanical Research and Development Engineer to join the Expeditionary Manufacturing and Repair Department at the Applied Research Laboratory (ARL) at Penn State. We are seeking...", "is_sponsored": false, "is_backfilled": false, "already_saved": false, "can_view_local": true, "url": "https://clearedjobs.net/job/mechanical-research-and-development-engineer-state-college-1919610", "company": { "id": 261563, "name": "Applied Research Laboratory at the Penn State University", "logo": "https://wjm.s3.amazonaws.com/cjng/uploads/ARLPSU-100.png", "url": "https://clearedjobs.net/company/applied-research-laboratory-at-the-penn-state-university-261563", "is_featured": false }, "omitted": { "value": null, "title": null }, "cant_see_content": false, "epp": null, "badge": null, "posted_date": "July 14, 2026", "modified_time": 3540115956, "display_logo": true, "from_url": "https://clearedjobs.net/jobs?country=&state=&city=&zip=&latitude=&longitude=&keywords=&location_autocomplete_data=&city_state_zip=&locale=en&page=1&sort=relevance" } ``` Each scraped job listing from the search results returns a record with 20+ fields: #### Core Identification | Field | Meaning | Example | |---|---|---| | `ID` | Unique job listing identifier in the ClearedJobs database | `12345678` | | `Title` | Job title as displayed in search results | `Senior Software Engineer - Secret Clearance` | | `Company` | Employer/hiring organization name | `Acme Defense Solutions` | | `URL` | Direct link to the full job detail page | `https://clearedjobs.net/jobs/12345678` | | `Short Description` | Truncated job summary shown in search results | `Seeking experienced engineer with active Secret clearance...` | #### Location & Geography | Field | Meaning | Example | |---|---|---| | `Location` | Job location (city, state) or remote designation | `Washington, DC` | | `Coordinates` | Latitude and longitude for map-based searches | `{"lat": 38.9072, "lon": -77.0369}` | #### Job Metadata & Status | Field | Meaning | Example | |---|---|---| | `Posted Date` | When the listing was published | `2024-07-10` | | `Modified Time` | Last update to the listing | `2024-07-15T14:32:00Z` | | `Is Sponsored` | Whether the listing received paid promotion | `true` / `false` | | `Is Backfilled` | Whether ClearedJobs filled or reposted the role | `false` | | `Badge` | Clearance level badge (e.g., "Top Secret") | `"Top Secret"`, `"Secret"`, `"SCI"` | | `EPP` | Enhanced Posting Position indicator (priority listing) | `true` / `false` | #### User & Access Flags | Field | Meaning | Example | |---|---|---| | `Already Saved` | Whether the current user saved this listing | `true` / `false` | | `Can View Local` | Whether the job is viewable in the user's region | `true` / `false` | | `Can't See Content` | Blocks applied (login required, restricted access) | `false` | | `Display Logo` | URL to company logo shown in results | `https://cdn.clearedjobs.net/logos/acme.png` | | `Omitted` | Whether the listing was omitted from results (filtered out) | `false` | | `Custom Block List` | Internal flags for custom blocking rules | `["archived"]` | *** ### How to Use 1. **Build search URLs** — Go to ClearedJobs.net, apply filters (keywords, location, clearance level), and copy the resulting URL. Bookmark or export URLs for multiple search criteria. 2. **Prepare bulk list** — Paste your URLs into the `urls` array. Include multiple pages by modifying the `page` parameter: `page=1`, `page=2`, etc. 3. **Configure limits** — Set `max_items_per_url` based on your needs. Use `20`–`50` for quick samples, or `100`+ for comprehensive collections. 4. **Enable error tolerance** — Keep `ignore_url_failures: true` to skip blocked or expired URLs without stopping the run. 5. **Run the scraper** — Start the actor, monitor progress in the logs, and wait for completion. 6. **Export & analyze** — Download results as JSON, CSV, or Excel for import into your CRM, spreadsheet, or talent database. **Troubleshooting:** - If results are empty, verify the search URL returns jobs in your browser - Add `&locale=en` to ensure English-language results - Use `&sort=relevance` or `&sort=date_posted` to control result ordering *** ### Real-World Applications - **Market intelligence:** Track hiring volume and clearance demand by contractor and region - **Talent acquisition:** Build targeted recruitment lists filtered by location and clearance type - **Compliance research:** Analyze industry hiring trends for federal security briefings - **Job board aggregation:** Combine ClearedJobs listings with other job sources into a unified platform - **Academic studies:** Research U.S. defense industry employment patterns and cleared-workforce sizing The ClearedJobs Search Scraper transforms hours of manual listing collection into minutes of automated extraction, enabling data-driven decisions in defense hiring and talent management. *** ### Conclusion The **ClearedJobs Search Scraper** empowers contractors, recruiters, and researchers to unlock security clearance job market intelligence instantly. With support for multi-page search, 20+ structured output fields, and reliable error handling, it is the efficient alternative to copy-paste workflows. Start scraping today and gain the competitive advantage in the cleared talent market. # Actor input Schema ## `urls` (type: `array`): Add the URLs of the Jobs list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. ## `ignore_url_failures` (type: `boolean`): If true, the scraper will continue running even if some URLs fail to be scraped. ## `max_items_per_url` (type: `integer`): The maximum number of items to scrape per URL. ## Actor input object example ```json { "urls": [ "https://clearedjobs.net/jobs?country=&state=&city=&zip=&latitude=&longitude=&keywords=&location_autocomplete_data=&city_state_zip=&locale=en&page=1&sort=relevance" ], "ignore_url_failures": true, "max_items_per_url": 20 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://clearedjobs.net/jobs?country=&state=&city=&zip=&latitude=&longitude=&keywords=&location_autocomplete_data=&city_state_zip=&locale=en&page=1&sort=relevance" ], "ignore_url_failures": true, "max_items_per_url": 20 }; // Run the Actor and wait for it to finish const run = await client.actor("alexist/clearedjobs-jobs-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://clearedjobs.net/jobs?country=&state=&city=&zip=&latitude=&longitude=&keywords=&location_autocomplete_data=&city_state_zip=&locale=en&page=1&sort=relevance"], "ignore_url_failures": True, "max_items_per_url": 20, } # Run the Actor and wait for it to finish run = client.actor("alexist/clearedjobs-jobs-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://clearedjobs.net/jobs?country=&state=&city=&zip=&latitude=&longitude=&keywords=&location_autocomplete_data=&city_state_zip=&locale=en&page=1&sort=relevance" ], "ignore_url_failures": true, "max_items_per_url": 20 }' | apify call alexist/clearedjobs-jobs-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=alexist/clearedjobs-jobs-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Clearedjobs Jobs Search Scraper", "description": "Scrape active security clearance job listings from ClearedJobs.net with precision. This scraper captures job titles, locations, company names, coordinates, posting dates, and 20+ fields per listing — perfect for defense contractors, HR teams, and staffing agencies.", "version": "0.0", "x-build-id": "qa51Opv4XFLbCaby9" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/alexist~clearedjobs-jobs-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-alexist-clearedjobs-jobs-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/alexist~clearedjobs-jobs-search-scraper/runs": { "post": { "operationId": "runs-sync-alexist-clearedjobs-jobs-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/alexist~clearedjobs-jobs-search-scraper/run-sync": { "post": { "operationId": "run-sync-alexist-clearedjobs-jobs-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "urls": { "title": "URLs of the Jobs list urls to scrape", "type": "array", "description": "Add the URLs of the Jobs list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list.", "items": { "type": "string" } }, "ignore_url_failures": { "title": "Continue running even if some URLs fail to be scraped", "type": "boolean", "description": "If true, the scraper will continue running even if some URLs fail to be scraped." }, "max_items_per_url": { "title": "Max items per URL", "type": "integer", "description": "The maximum number of items to scrape per URL." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```