AI Jobs Board Scraper

Scrape AI-focused job boards to extract ML/AI roles, salary ranges, required skills, and company AI focus areas. Targets ai-jobs.net and similar AI job aggregators.

Features

• Extracts job titles, companies, salaries, required skills, locations, and remote status
• Handles pagination automatically across multiple listing pages
• Keyword filtering to narrow results to specific AI/ML domains
• Detects job type (full-time, part-time, contract, internship)
• Extracts skills from job descriptions using known AI/ML skill keywords
• Proxy support including residential proxies for better success rates

Input Parameters

Parameter	Type	Default	Description
urls	array	[{"url":"https://ai-jobs.net/jobs/"}]	List of AI job board URLs to scrape
keywords	string	""	Optional keywords to filter jobs (e.g., 'machine learning', 'NLP')
maxResults	integer	100	Maximum number of job listings to extract (0 = unlimited)
maxPages	integer	10	Maximum number of listing pages to paginate through
useResidentialProxy	boolean	false	Enable residential proxies for better success rates

Output Fields

Field	Type	Description
jobTitle	string	Title of the job position
company	string	Name of the hiring company
salary	string	Salary information as displayed
salaryRange	string	Salary range if available
skills	array	List of required skills and technologies
location	string	Job location
remote	boolean	Whether the job offers remote work
jobType	string	Full-time, Part-time, Contract, Internship, or Freelance
postedDate	string	Date the job was posted
applicationUrl	string	Direct URL to apply for the job
source	string	Source URL where the job was found

Example Output

{
  "jobTitle": "Senior Machine Learning Engineer",
  "company": "TechCorp AI",
  "salary": "$150,000 - $200,000",
  "salaryRange": "$150,000 - $200,000",
  "skills": ["python", "pytorch", "transformers", "mlops", "aws"],
  "location": "San Francisco, CA",
  "remote": true,
  "jobType": "Full-time",
  "postedDate": "2024-01-15",
  "applicationUrl": "https://ai-jobs.net/job/12345/apply",
  "source": "https://ai-jobs.net/jobs/"
}

Use Cases

• Job Market Research: Track AI/ML job trends, popular skills, and salary ranges across the industry
• Competitive Intelligence: Monitor which companies are hiring for AI roles and what skills they require
• Career Planning: Find AI jobs matching your skill set and salary expectations
• Recruitment Analytics: Analyze the AI talent market for hiring strategies
• Skills Gap Analysis: Identify the most in-demand AI/ML skills across job postings

Cost Estimate

Using the default configuration (100 results, 10 pages):

• Estimated compute units: ~0.05 CU per run
• Cost per run: ~$0.00075 per result (Mid tier)
• Average runtime: 30-60 seconds for 100 listings
• Residential proxy usage increases costs by approximately 3-5x