ClearedJobs.Net Scraper

Extract security-cleared job listings from ClearedJobs.net with advanced filtering capabilities. This scraper now calls the site’s JSON API first (fast, lightweight), then falls back to HTML/JSON-LD via sitemaps if the API is empty or blocked.

Key Features

• Comprehensive Data Extraction - Captures job titles, company names, locations, security clearance requirements, salaries, job types, posting dates, and full descriptions
• Advanced Filtering - Search by keywords, location, and security clearance level
• API-First Architecture - Prioritizes JSON API extraction with intelligent HTML fallback for maximum reliability
• Full Detail Scraping - Optional deep extraction visits individual job pages for complete information
• Smart Pagination - Automatically navigates through multiple pages of results
• Proxy Support - Built-in support for Apify Proxy to ensure uninterrupted data collection

Input Configuration (key fields)

• keywords (string): Query terms (e.g., “engineer”, “cyber”).
• location / city / state / zip (string): Location filters passed to the API.
• remote (string): remote or hybrid to match the site’s remote filters.
• sort (string): date (recommended) or relevance.
• results_wanted (int): Max jobs to save.
• max_pages (int): API pagination safety cap.
• startUrls (array): Direct job URLs to force-collect (skips API).
• searchUrl (string, optional): Custom /jobs?... page to seed route discovery.
• proxyConfiguration (object): Standard Apify proxy settings.

Output Data

Each job listing includes the following fields:

{
  "title": "Senior Software Engineer",
  "company": "Lockheed Martin",
  "location": "Fort Worth, Texas",
  "security_clearance": "Secret",
  "salary": "$120,000 - $150,000",
  "job_type": "Full time",
  "date_posted": "December 1, 2025",
  "description_html": "<p>Full HTML description...</p>",
  "description_text": "Plain text description...",
  "url": "https://clearedjobs.net/job/..."
}

Output Fields

Field	Type	Description
title	String	Job title
company	String	Employer name
location	String	Job location (city, state)
security_clearance	String	Required security clearance level
salary	String	Salary information (if available)
job_type	String	Employment type (Full time, Part time, Contract, etc.)
date_posted	String	Date the job was posted
description_html	String	Full job description in HTML format
description_text	String	Job description in plain text
url	String	Direct link to job posting

Usage Examples

Quick examples

{
  "keywords": "engineer",
  "sort": "date",
  "results_wanted": 25,
  "max_pages": 4,
  "remote": "remote",
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

{
  "startUrls": [
    "https://clearedjobs.net/job/senior-software-engineer-aurora-colorado-1059802"
  ],
  "results_wanted": 5
}

Performance & Best Practices

Optimization Tips

• Use Specific Keywords - Narrow searches return faster and more relevant results
• Enable Proxy - Use Apify Proxy (residential) to avoid rate limiting
• Adjust collectDetails - Set to false for faster collection when full descriptions aren't needed
• Set Reasonable Limits - Use results_wanted and max_pages to control run time and compute units

Expected Performance

Results	Detail Mode	Estimated Time
20 jobs	Off	30-60 seconds
20 jobs	On	1-2 minutes
50 jobs	Off	1-2 minutes
50 jobs	On	2-3 minutes

Times may vary based on network conditions and proxy performance

Common Use Cases

Defense Contractors & Recruiters

Find qualified candidates by extracting jobs matching specific clearance levels and technical skills. Export data for talent pipeline management.

Job Seekers

Monitor new postings in your area and skill set. Set up scheduled runs to receive fresh opportunities automatically.

Market Research

Analyze hiring trends in the cleared job market, including salary ranges, in-demand skills, and geographic hotspots.

Competitive Intelligence

Track which companies are hiring, what positions are in demand, and required clearance levels across the industry.

Troubleshooting

Common Issues

Data Export Options

Export your scraped data in multiple formats:

• JSON - Structured data for programmatic processing
• CSV - Spreadsheet-compatible for analysis in Excel/Google Sheets
• Excel - Formatted spreadsheet with headers
• HTML - Human-readable table format
• XML - For integration with enterprise systems

Access exported data via:

• Direct download from Apify Console
• Apify API endpoints
• Webhook notifications
• Scheduled delivery to cloud storage

Legal & Ethical Considerations

This scraper is designed for legal data extraction from publicly available job listings. Users are responsible for:

• Complying with ClearedJobs.net Terms of Service
• Respecting robots.txt and rate limits
• Using collected data ethically and legally
• Adhering to data privacy regulations (GDPR, CCPA, etc.)
• Not using data for spam or unauthorized purposes

Support & Feedback

For issues, questions, or feature requests:

• Check the Apify Console logs for detailed error messages
• Review this documentation for configuration guidance
• Contact support through the Apify platform
• Rate and review to help improve this scraper

Built for the Apify platform
Reliable • Scalable • Easy to Use