FSANZ Consultation Deadline Scraper avatar

FSANZ Consultation Deadline Scraper

Pricing

from $2.00 / 1,000 recognized consultation/publication/alert metadata records

Go to Apify Store
FSANZ Consultation Deadline Scraper

FSANZ Consultation Deadline Scraper

Export numbered FSANZ application/proposal consultation opening and closing dates, source statuses and document links from homepage discovery or supplied detail URLs.

Pricing

from $2.00 / 1,000 recognized consultation/publication/alert metadata records

Rating

0.0

(0)

Developer

Vixendata

Vixendata

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a month ago

Last modified

Categories

Security

Limited permissions

Share

FSANZ Food Standards Consultation Deadlines

Turn numbered FSANZ applications and proposals into deadline-ready rows: reference, title, observed status, opening and closing dates, source deadline wording and application/document links. Useful for food regulatory teams maintaining a consultation calendar and tracing the official evidence behind each entry.

Coverage

Discovers numbered application/proposal cards on the official FSANZ Consultation Hub homepage and accepts up to 30 explicit consultation detail URLs on that same host. This is a bounded recent inventory, not a complete archive. It does not follow “See All” pagination. Unnumbered policy projects, satisfaction surveys and registration forms are excluded. A source with no numbered cards can legitimately yield no rows; selector changes are reported as errors.

Default: discover homepage cards, return up to 10 records. Explicit URLs are processed first. At most 30 detail pages and 32 total requests are attempted. The status filter applies after fetching and can yield zero records. The run summary identifies counts, skipped-by-filter results through count differences, truncation and errors. Reaching your configured record limit is ordinary truncation; source failures mark the run failed and retain earlier rows.

Input

  • discoverRecent (default true): add homepage cards.
  • consultationUrls (default []): plain https://consultations.foodstandards.gov.au/fsanz/slug/ detail URLs. Forms, query strings, fragments, encoded paths and other hosts are rejected.
  • maxItems (default 10, range 1–30): maximum emitted records.
  • status (default all): all, open, closed, forthcoming or unknown.

Example:

{"discoverRecent":true,"maxItems":10,"status":"all"}

Output

One dataset row per consultation with reference, referenceType, title, observedStatus, openedDate, closingDate, closingTimeText, applicantName, applicationPageUrl, documentUrls, sourceUrl, audiences, interests, retrievedAt, warnings, coverage and attribution.

Dates use ISO calendar dates. Status comes from the source's Closes/Closed/Opens labels, never the machine clock. Deadline text preserves source wording and timezone rather than guessing a UTC conversion. An applicant name is extracted only when the overview explicitly says an application was made/submitted by that party to permit/allow/amend/approve something. The source name is retained without enrichment; the parser does not establish legal identity. Optional absent or unrecognized values are null, not invented. Document links include only directly linked official-host documents, never downloaded contents. Application pages are links only, so this actor does not discover documents listed exclusively there. No submission form, respondent data or personal contact details are collected. This is source metadata, not legal or regulatory advice.

The default key-value store contains RUN_SUMMARY with records, discovered/explicit URLs, fetched pages, requests, truncation and errors. Repeat snapshots may be compared by sourceUrl; this actor does not maintain a cross-run change history.

Respectful access

Single concurrency, at least five seconds between requests, robots checked first and any stricter delay honored. Robots failure, 401/403/429, redirects, oversize responses or unsupported rate rules stop the source. No application-configured scraping proxies, login, CAPTCHA handling, browser impersonation or access bypass. Maximum HTML size 2 MiB; bounded socket/read and run time. Other errors are recorded without retries. Source availability can change.

Attribution and reuse

Source: Food Standards Australia New Zealand. FSANZ-owned material is licensed under Creative Commons Attribution 4.0 under its copyright policy. Attribute FSANZ and link the original source when reusing output. No endorsement is implied. Logos and third-party material are excluded; applicants' documents are linked rather than reproduced. The included fixture fragments contain only FSANZ consultation metadata and explanatory text, trimmed from official pages captured 5 October 2026. Parsing and normalization are modifications.

Development

Python 3.12; Apify SDK pinned in requirements.txt. pip install -r requirements.txt; python -m unittest discover -s tests -v; python main.py to run the real SDK locally. Input can be supplied in the local Apify key-value store. Docker builds copy only runtime files, excluding tests/fixtures. No credentials are needed for the source. Tests cover real source fragments, typed dates/reference/applicant extraction, non-consultation filtering, malicious/out-of-scope URLs, robots gate, denials and request caps.

This specialized inventory is different from generic URL/hash monitors: it discovers recent numbered consultations and returns typed fields. Generic monitors can still track manually supplied FSANZ URLs. No claim of exhaustive marketplace uniqueness is made.