Jobboard Guard

An Apify Actor for checking authorized recruitment websites for expired job listings, malformed or missing Google JobPosting JSON-LD, missing application links, and other technical quality issues.

Features

• Find likely job pages from robots.txt XML sitemaps and homepage links.
• Inspect JSON-LD JobPosting fields, expiry wording, published dates and apply links.
• Respect robots.txt, restrict to same website and public DNS, and cap requests.
• Export records to Apify Dataset, JSON to SUMMARY, and a styled HTML report to REPORT in the key-value store.
• Compare issues between repeated runs in a scheduled named Apify Task.
• Supports pay-per-event with event job-page-audited, when configured in Apify Console.

Try it immediately (offline preview)

Leave both URL fields empty and click Start. The Actor analyzes three explicitly labeled synthetic JobPosting examples (valid, expired, and missing fields) without visiting any website. The output is not a report about any real employer. No paid page-audit events are emitted for examples; the separately configured tiny Actor-start charge may still apply.

Usage

Supply either sites (recruitment website homepages), jobUrls (specific job detail URLs) or both. Check the authorization checkbox. Limit pages for initial tests.

Example:

{"sites":[],"jobUrls":["https://example.com/jobs/your-posting"],"authorized":true,"maxTotalPages":3,"secondsBetweenRequests":1}

The example URL is illustrative only: do not run against a site you do not have permission to audit. For an actual scan, provide a permitted site or direct job URL and check the authorization checkbox.

This first release checks server-rendered HTML and JSON-LD. It does not run JavaScript, submit job applications, certify Google eligibility, or verify the live functioning of application pages. An expired date in validThrough is not itself a violation. If a website does not expose job detail URLs in its sitemap or homepage, supply the URLs explicitly.

Pricing and publishing

Recommended test price: USD $0.02 per successful page audit. Event name: job-page-audited. Set the event and pricing separately in Apify Console. The software alone does not enable payment collection.

Before public release, test actual authorized job URLs, inspect dataset/report and operating costs, then complete marketplace registration and payout onboarding. Publishing and earnings are not guaranteed.

Deployment

This repository is linked to Apify under a Git-based Actor. After the source is committed to main, Apify can build it automatically. The code uses Python 3.12 and the Apify Python SDK, with an input schema at .actor/input_schema.json.

Local unit tests: PYTHONPATH=src pytest -q.

Security

The crawler rejects private/non-public destinations, restricts redirects to the same domain, honors robots.txt, uses bounded response sizes, and never bypasses authentication. Only audit sites you own, manage, or have permission to inspect.

This is an independent tool not affiliated with Google or Apify.