Page Metadata Extractor - SEO & RAG JSON Feed
Pricing
from $0.50 / 1,000 extracted results
Extract clean, structured metadata from any site: title, meta description, canonical URL, Open Graph tags, H1 and word count. Built-in retries, session rotation and optional pagination keep every crawl resilient. Built for SEO audits and LLM/RAG pipelines - pay only per result, never per wasted run.
src/state.ts used Actor.getValue()/Actor.setValue() for delta
state, which the Apify SDK docs confirm are shortcuts for the key-value
store "associated with the current Actor run" - i.e. a fresh, run-scoped
store every run, never shared across runs. Real cloud verification (two
separate runs against the same URLs, each getting a different
Key-value store ID and both classifying every page NEW_URL) caught
this before it was called done. Fixed by opening a named store
(Actor.openKeyValueStore('primer-actor-delta-state')), which persists
across separate runs of this Actor. 1.1.0 was built, tested, merged and
briefly deployed to the latest build tag with this bug present - local
tests never exercised two genuinely separate runs against the SAME
persistent store, so they passed despite it. Caught immediately by the
cloud-verification step that's part of shipping any change in this repo
(two real apify actors call runs against the same URLs, both showing
NEW_URL when the second should have shown UNCHANGED) and fixed and
redeployed within the same session before this was reported as done.eventType (NEW_URL / CONTENT_CHANGED / UNCHANGED), contentHash
and previousScrapedAt in the dataset. State (a content fingerprint per
URL) persists in the default key-value store across runs.onlyChanged (default false, fully backward
compatible). When enabled, a page is still crawled and its links still
followed, but it is only delivered to the dataset - and charged - when
it's new or its content differs from the last scrape of that same URL.
Unchanged pages are skipped, so a scheduled re-run only pays for what
actually changed.url/eventType/
previousScrapedAt/scrapedAt/contentHash.test/fingerprint.test.ts, test/delta.test.ts, test/state.test.ts:
unit coverage for the new pure fingerprint/classification functions and
state persistence. test/main.test.ts extended with two live-router
scenarios: a repeat crawl of an unchanged page, and the same with
onlyChanged=true.npm run lint added to CI (.github/workflows/test.yaml), matching the
local validation loop already documented in this repo's AGENTS.md.result, unchanged), or pricing - this is a purely additive
release. contentHash/eventType/previousScrapedAt are new fields
appended to every existing output record, not a replacement for any of
them.src/delta.ts and
the "Delta / change-detection mode" section of AGENTS.md.onlyChanged reduces how many
results are delivered (and therefore charged) using the existing
result event - it does not add a second pricing tier or touch
pricingInfos in Console. Apify allows only one "significant pricing
change" per Actor per month with a 14-day notice period, and this
Actor already has a live, differently-priced model from the rest of
this developer's fleet - a new tier here is a deliberate future
decision, not bundled into this release.