Website Job Extractor (HTTP)
Pricing
from $4.00 / 1,000 job extracteds
Scrape job listings directly from company websites / career pages / ATS systems. Unlike job portals, letting you identify hiring intent the moment it happens. The freshest signal for B2B targeting. AI-extracted with automatic ATS detection and anti-hallucination validation.
List of companies to extract jobs from. Provide either a website_url (auto-discovers career pages) or specific career_urls.
Language for text output fields (description, department, employment_type). 'auto' = match website language. Default: keep original language.
Maximum USD to spend on the managed OpenRouter LLM (deepseek-chat-v3-0324) within this run. Free-tier users are hard-capped at $0.30 regardless of this value. Paying users default to $10.00 if left blank; maximum $50.00. Has no effect when you supply your own API key (BYOK mode).
Primary AI provider for job extraction. Leave all API key fields blank to use managed mode (recommended for first-time users). Supply your own key here to use BYOK mode.
Second-level fallback if primary fails (e.g., rate limit exceeded).
Third-level fallback if both primary and first fallback fail.
Override the model identifier for the selected provider. Free-text so you can pick any current model without waiting for us to rebuild. Defaults: Gemini -> gemini-3.6-flash (workhorse — was gemini-2.5-flash, restricted to existing users in Aug 2026). Groq -> openai/gpt-oss-120b (was llama-3.3-70b-versatile, decommissioned by Groq on 2026-08-16). OpenRouter -> meta-llama/llama-3.1-8b-instruct. Provider catalogs: Gemini https://ai.google.dev/gemini-api/docs/models, Groq https://console.groq.com/docs/models, OpenRouter https://openrouter.ai/models. This field takes any model string the provider supports. Defaults may change without notice as providers retire models.
API key for Groq or OpenRouter. Not needed for Gemini if GEMINI_API_KEY env var is set.
OPTIONAL -- leave blank to use managed mode (see above). API key for Google Gemini (free tier: 1M tokens/minute). Get one at https://aistudio.google.com/apikey
OPTIONAL -- leave blank to use managed mode (see above). API key for Groq (fast inference, free tier available). Get one at https://console.groq.com/keys
OPTIONAL -- leave blank to use managed mode (see above). API key for OpenRouter (many free models available). Get one at https://openrouter.ai/keys
Maximum jobs pushed per company. Filters (keywords, location, postedWithinDays) apply BEFORE this cap and before charging, so the cap counts only matching jobs. 0 means all jobs: the actor pages to the end of the company's job list, bounded by a hard limit of 10,000 jobs per company, the run's time limit and the page cap. Rows are pushed and charged one by one as they are read, so a run that stops early keeps every row already delivered. Default 200.
On: the actor reads every job's detail page. ATS career sites (Workday, Oracle, Phenom, Eightfold, SuccessFactors, iCIMS, Taleo, Greenhouse and more) get the full description from the job's detail page or API (included in the normal job price). For jobs on the employer's own site the actor also opens the detail page, stores the posting text as markdown in description_md and extracts structured fields: employment type, posting and closing dates, salary (min, max, currency, period), location parts, workload percent (for example 80-100%), department, contact person, email and phone, application deadline, remote or hybrid, required languages, reference number (JSON-LD JobPosting first, then the page text, then one LLM call per job for what is still missing; the LLM may only return values the page text contains). Each job whose employer-site detail page delivered data is charged one extra job-detail-result event (job-detail-result-managed when no API key is supplied). Off: no detail pages are read at all, rows come straight from the listing pages (title, location, link, posted date), which is the fast mode for 'all jobs' on huge career sites. Not set (default in code): ATS descriptions on, employer-site detail pages off, exactly as before this option existed. Replaces the older includeDescription and includeFullPostingText.
Deprecated alias of the ATS part of includeJobDetails, used only while includeJobDetails is not set. false = ATS rows are pushed straight from the listing pages with no per-job detail fetches. Default true.
Deprecated alias of the employer-site part of includeJobDetails, used only while includeJobDetails is not set. true = open the detail pages on the employer's own site (text and structured fields). Default false.
Only with includeJobDetails. Maximum characters of posting text stored in description_md per job, and the maximum sent to the LLM when it fills missing detail fields. Longer texts are cut at a paragraph boundary.
Only with includeJobDetails. On (default): when fields such as location, posting date, workload, department, contact person or application deadline are still missing after the JSON-LD and text pass, ONE LLM call per job fills them, and only with values written in the posting text. Off: the text and the deterministic fields are still read but no LLM call is made, so detail_llm_calls stays 0. Local runs can also set the environment variable WJE_FULLTEXT_LLM_FILL=0.
Only keep jobs whose title contains at least one of these keywords (case and accent insensitive). Applied on the company's own job list: server-side where the ATS supports search (Workday, Oracle, Eightfold, Phenom, SuccessFactors, iCIMS), otherwise page by page while listing, before descriptions are fetched and before any charge. Leave empty for all jobs.
Only keep jobs in this city, region or country (for example London, Texas, United Kingdom, GB, Germany, DE). Country names and ISO codes match both ways. Remote jobs match when they do not name a different country. Applied server-side where the ATS exposes location filters (Workday, Oracle), otherwise locally before descriptions are fetched and before any charge. A job whose location cannot be read is not kept.
Only keep jobs posted within the last N days. Jobs whose posting date is unknown are kept. Leave empty for no date filter.
Newest first uses the ATS's own newest-first sort where it has one; otherwise rows come in the site's own order. Relevance only differs from newest when keywords are set and the ATS supports relevance ranking. Rows are pushed as they are read (never buffered to sort). Workday career sites list newest first by posting day, and rows within the same day come in site order, so the posted date shown can differ slightly between neighbouring rows. Sites without a date sort return their own order.
Hard cap on pages fetched per company (career page, pagination and ATS pages combined). Independent of maxResultsPerCompany, which caps jobs. Defaults to 20 when omitted. A company also stops early after 3 consecutive pages that yield no jobs.
Upper bound of wall-clock time per company. Each company gets a fair share of the remaining run time (never more than this); when it is used up the company stops (remaining pages are skipped, rows already extracted are kept and charged) and its job_extraction_done row carries reason 'company_time_budget'. No company fee is charged when no rows were delivered. Default 240.
Maximum number of concurrent HTTP requests
URL to POST results to when extraction completes (e.g., your API endpoint)
When a supported ATS platform is detected (Lever, Greenhouse, Workday, Ashby, etc.), skip LLM extraction and output the ATS URL instead. Feed these URLs into the Career Site Jobs Scraper for faster, cheaper, structured extraction without hallucination risk. Supports 16 ATS platforms.
Automatically run browser-based extraction for companies flagged with JS rendering issues. Starts a separate browser actor run (additional cost). A 'browser_fallback_spawned' sentinel row is pushed to this dataset with the sub-run ID and dataset URL so you can poll the browser run for real results.
Internal. Selects which managed OpenRouter key is used for cost attribution ("default" or "jobfeed"). Ignored when you supply your own API key. Never changes pricing.
⚠️ DEPRECATED — this field will be removed on 2027-09-18. Please switch to enableBrowserFallback. Automatically run browser-based extraction for companies flagged with JS rendering issues. Starts a separate actor run (additional cost).
Alias of keywords, kept for existing integrations. Ignored when keywords is set. Only extract jobs matching these keywords. When set, each job gets a relevance score (high/medium/low). Leave empty to extract all jobs.
Local runs only. Base URL of an OpenAI-compatible server (for example http://localhost:1234/v1) used when llmProvider is openai_compatible. Not available on the Apify platform; ignored for every other provider.
Local runs only. Per-request timeout for the openai_compatible provider (default 180).
