ClearedJobs Search Scraper: Extract Security Clearance Job Listings Fast

---

What Is ClearedJobs.net?

ClearedJobs.net is the leading specialized job board for positions requiring U.S. security clearances (Secret, Top Secret, SCI, and beyond). It connects federal contractors, defense agencies, and cleared professionals in a dedicated marketplace. Manual searching and collecting data across multiple pages is tedious and error-prone — the ClearedJobs Search Scraper automates extraction from search results pages, delivering structured records ready for analysis.

---

Overview

The ClearedJobs Search Scraper collects job listings from ClearedJobs.net search results pages, transforming live job data into clean, machine-readable records. It is ideal for:

• Defense contractors monitoring competitor hiring and clearance demand
• Staffing agencies building talent pipelines and market intelligence
• HR professionals researching cleared talent availability by region
• Researchers analyzing security clearance labor market trends
• Job aggregators importing cleared positions into multi-source platforms

The scraper handles multiple search result pages, respects URL failures gracefully, and allows configurable item limits to match your collection scope and budget.

---

Input Format

The scraper accepts a JSON configuration object:

{
  "urls": [
    "https://clearedjobs.net/jobs?country=&state=&city=&zip=&latitude=&longitude=&keywords=&location_autocomplete_data=&city_state_zip=&locale=en&page=1&sort=relevance"
  ],
  "ignore_url_failures": true,
  "max_items_per_url": 20
}

Input Field Definitions

Field	Type	Description	Example
urls	Array	ClearedJobs search result page URLs to scrape. Include pagination URLs to collect multiple pages.	["https://clearedjobs.net/jobs?page=1&sort=relevance", "https://clearedjobs.net/jobs?page=2&sort=relevance"]
ignore_url_failures	Boolean	If true, the scraper skips failed URLs and continues processing remaining URLs. If false, a single failed URL stops the entire run.	true / false
max_items_per_url	Integer	Maximum number of job listings to extract per URL. Controls scrape scope and resource usage. Set higher for larger collections.	20, 50, 100

Tips:

• Build URLs using ClearedJobs filters (keywords, location, clearance level) to target specific job types
• Use pagination to scrape multiple result pages; include page=1, page=2, etc.
• Set max_items_per_url to 0 for unlimited items, or cap at 50–100 for cost efficiency

---

Output Format

Sample output

{
  "id": 1919610,
  "title": "Mechanical Research and Development Engineer",
  "location": "State College",
  "coordinates": {
    "latitude": "0",
    "longitude": "0"
  },
  "custom_block_list": [
    {
      "id": 11,
      "block": "job_list",
      "path": "prepared_categories",
      "enabled": 1,
      "name": "front::jobs.additional_fields.categories",
      "relative_order": "1",
      "value": "Secret",
      "label": "Security Clearance"
    },
    {
      "id": 18,
      "block": "job_list",
      "path": "location_extended_info",
      "enabled": 1,
      "name": "front::jobs.ji_location_extended_info",
      "relative_order": "2",
      "value": "State College",
      "label": "Location"
    },
    {
      "id": 17,
      "block": "job_list",
      "path": "time",
      "enabled": 1,
      "name": "front::jobs.ji_posted",
      "relative_order": "6",
      "value": "July 14, 2026",
      "label": "Posted"
    }
  ],
  "short_description": "We are searching for a Mechanical Research and Development Engineer to join the Expeditionary Manufacturing and Repair Department at the Applied Research Laboratory (ARL) at Penn State. We are seeking...",
  "is_sponsored": false,
  "is_backfilled": false,
  "already_saved": false,
  "can_view_local": true,
  "url": "https://clearedjobs.net/job/mechanical-research-and-development-engineer-state-college-1919610",
  "company": {
    "id": 261563,
    "name": "Applied Research Laboratory at the Penn State University",
    "logo": "https://wjm.s3.amazonaws.com/cjng/uploads/ARLPSU-100.png",
    "url": "https://clearedjobs.net/company/applied-research-laboratory-at-the-penn-state-university-261563",
    "is_featured": false
  },
  "omitted": {
    "value": null,
    "title": null
  },
  "cant_see_content": false,
  "epp": null,
  "badge": null,
  "posted_date": "July 14, 2026",
  "modified_time": 3540115956,
  "display_logo": true,
  "from_url": "https://clearedjobs.net/jobs?country=&state=&city=&zip=&latitude=&longitude=&keywords=&location_autocomplete_data=&city_state_zip=&locale=en&page=1&sort=relevance"
}

Each scraped job listing from the search results returns a record with 20+ fields:

Core Identification

Field	Meaning	Example
ID	Unique job listing identifier in the ClearedJobs database	12345678
Title	Job title as displayed in search results	Senior Software Engineer - Secret Clearance
Company	Employer/hiring organization name	Acme Defense Solutions
URL	Direct link to the full job detail page	https://clearedjobs.net/jobs/12345678
Short Description	Truncated job summary shown in search results	Seeking experienced engineer with active Secret clearance...

Location & Geography

Field	Meaning	Example
Location	Job location (city, state) or remote designation	Washington, DC
Coordinates	Latitude and longitude for map-based searches	{"lat": 38.9072, "lon": -77.0369}

Job Metadata & Status

Field	Meaning	Example
Posted Date	When the listing was published	2024-07-10
Modified Time	Last update to the listing	2024-07-15T14:32:00Z
Is Sponsored	Whether the listing received paid promotion	true / false
Is Backfilled	Whether ClearedJobs filled or reposted the role	false
Badge	Clearance level badge (e.g., "Top Secret")	"Top Secret", "Secret", "SCI"
EPP	Enhanced Posting Position indicator (priority listing)	true / false

User & Access Flags

Field	Meaning	Example
Already Saved	Whether the current user saved this listing	true / false
Can View Local	Whether the job is viewable in the user's region	true / false
Can't See Content	Blocks applied (login required, restricted access)	false
Display Logo	URL to company logo shown in results	https://cdn.clearedjobs.net/logos/acme.png
Omitted	Whether the listing was omitted from results (filtered out)	false
Custom Block List	Internal flags for custom blocking rules	["archived"]

---

How to Use

1. Build search URLs — Go to ClearedJobs.net, apply filters (keywords, location, clearance level), and copy the resulting URL. Bookmark or export URLs for multiple search criteria.

2. Prepare bulk list — Paste your URLs into the urls array. Include multiple pages by modifying the page parameter: page=1, page=2, etc.

3. Configure limits — Set max_items_per_url based on your needs. Use 20–50 for quick samples, or 100+ for comprehensive collections.

4. Enable error tolerance — Keep ignore_url_failures: true to skip blocked or expired URLs without stopping the run.

5. Run the scraper — Start the actor, monitor progress in the logs, and wait for completion.

6. Export & analyze — Download results as JSON, CSV, or Excel for import into your CRM, spreadsheet, or talent database.

Troubleshooting:

• If results are empty, verify the search URL returns jobs in your browser
• Add &locale=en to ensure English-language results
• Use &sort=relevance or &sort=date_posted to control result ordering

---

Real-World Applications

• Market intelligence: Track hiring volume and clearance demand by contractor and region
• Talent acquisition: Build targeted recruitment lists filtered by location and clearance type
• Compliance research: Analyze industry hiring trends for federal security briefings
• Job board aggregation: Combine ClearedJobs listings with other job sources into a unified platform
• Academic studies: Research U.S. defense industry employment patterns and cleared-workforce sizing

The ClearedJobs Search Scraper transforms hours of manual listing collection into minutes of automated extraction, enabling data-driven decisions in defense hiring and talent management.

---

Conclusion

The ClearedJobs Search Scraper empowers contractors, recruiters, and researchers to unlock security clearance job market intelligence instantly. With support for multi-page search, 20+ structured output fields, and reliable error handling, it is the efficient alternative to copy-paste workflows. Start scraping today and gain the competitive advantage in the cleared talent market.