QuikrJobs Search Scraper

This Actor collects complete public job records from official QuikrJobs category and detail pages at quikr.com. It uses ordinary direct HTTPS only and emits complete rows with more than 20 meaningful source-grounded fields.

Modes

• search: one supported role/category and optional city.
• searchMultiple: several role/category queries in queries.
• single: one official detail URL in startUrls, or one numeric jobId discovered from the selected category.
• multiple: two or more official detail URLs in startUrls, or numeric jobIds discovered from the selected category.
• startUrls: official category and/or detail URLs.

Every saved row is fetched from its detail page and must have a numeric ID, title, location, an 80-character description, an official detail URL, a source-backed timestamp, complete search provenance, and at least 21 meaningful source fields. Incomplete rows are skipped. When the site returns an access-denied or anti-bot response, the Actor writes a structured diagnostic, emits no fallback rows, discards staged rows, and exits with SKIPPED.

Local commands

npm ci
npm run check
npm test
apify validate-schema
APIFY_LOCAL_STORAGE_DIR=storage-quikr-validation apify run --resurrect --input-file INPUT.json
npm run validate -- storage-quikr-validation

The validator checks the actual files in storage/datasets/default/, strict schema compliance, required fields, official URLs, duplicate IDs/URLs, recursive null/blank/empty values, and the RUN_SUMMARY count. RUN_SUMMARY and RUN_DIAGNOSTICS are stored in the default key-value store.

Reliability and privacy

Every ordinary network request uses one attempt and counts against maxRequests. Responses are streamed through an 8 MB cap, requests are paced, and no proxy, custom user-agent, cookie, alternate identity, fingerprint, or challenge-bypass control is exposed. Only canonical detail pages whose numeric ID and path match the requested candidate are marked verified.

HTTP 401, 403, 429, or 451, or a source-authored denial/CAPTCHA/human-verification/security-challenge page, is terminal SKIPPED evidence. Generic transport failures are DEFERRED; the Actor does not retry or change routes. Use a new actor-relative storage path, never --purge, and do not reuse existing dataset storage for validation.

Email addresses and Indian phone numbers are recursively removed from visible text, listing snippets, JSON-LD, Apollo state, and optional raw output. Rows declare contactDetailsRedacted: true, inventory rank 229, and the actual local or Apify cloud execution environment.