Pricing

from $3.50 / 1,000 snapshot fetcheds

Wayback Machine Scraper - Track Website Changes Over Time

Search the Internet Archive's Wayback Machine for historical snapshots of any website. Retrieve archived page metadata -- including timestamps, URLs, MIME types, HTTP status codes, and content hashes -- for up to 10,000 snapshots per run.

Pricing

from $3.50 / 1,000 snapshot fetcheds

Rating

0.0

(0)

Developer

Ryan Clinton

Actor stats

Bookmarked

Total users

Monthly active users

9 hours ago

Last modified

categories

Optional

On version records, the change categories detected (pricing, legal, product, layout, navigation, copy, contact).

Type:

Key Diffs

keyDiffs

Optional

On version records, human-readable change phrases (e.g. "Price changed: $9 → $12").

Type:

Alert Fired

fired

Optional

On alert records, always true. Filter with WHERE recordType = 'alert' AND fired = true.

Type:boolean | null

Alert Severity

severity

Optional

On alert records, the highest magnitude that triggered the alert: minor / moderate / major.

Type:string | null

Matched Changes

matchedChanges

Optional

On alert records, how many snapshot rows met the alert threshold.

Type:integer | null

Alert Threshold

threshold

Optional

On alert records, the configured threshold (any / moderate / major).

Type:string | null

Headline

headline

Optional

On alert / report records, a one-line summary suitable for Slack subjects, email titles, or dashboard tiles.

Type:string | null

Examples

examples

Optional

On alert records, up to 5 example change phrases that triggered the alert.

Type:

Key Takeaways

keyTakeaways

Optional

On report records, scannable bullets ready for executive summaries.

Type:

Metrics By URL

metricsByUrl

Optional

On report records, per-URL stats: snapshots, changedSnapshots, majorChanges, dateRange, updateFrequency, volatilityScore, changeVelocity.

Type:

Query URLs

queryUrls

Optional

On report records, the list of URLs included in this run.

Type:

Report Markdown Key

reportMarkdownKey

Optional

On report records, the key-value-store key (default: REPORT.md) where the markdown report is stored.

Type:string | null

Generated At

generatedAt

Optional

On alert / insights / report records, ISO 8601 timestamp the record was emitted.

Type:string | null

Alert Message

alertMessage

Optional

On alert records, a Slack-/email-/webhook-ready single-line message you can pipe directly to a notification channel.

Type:string | null

Key Events

keyEvents

Optional

On insights records, plain-English bullets describing the major events detected (e.g. "Major pricing increase on competitor.com on 2022-03-15").

Type:

Risk Signals

riskSignals

Optional

On insights records, plain-English bullets flagging events that may carry legal or operational risk (legal/policy updates, repeated pricing changes, page removals).

Type:

Business Signals

businessSignals

Optional

On insights records, plain-English bullets flagging product/pricing/positioning shifts useful for competitive intelligence.

Type:

Events

events

Optional

On insights records, typed event objects: { type, queryUrl, date, archiveUrl, summary, confidence, magnitude, categories }. type ∈ pricing-change | product-launch | legal-update | redesign | navigation-change | contact-change | page-removed | page-restored | copy-edit.

Type:

Coverage

coverage

Optional

On insights records, per-URL coverage report: completeness (0-1), gaps (90+ day windows), reliability tier (high/medium/low), so users can answer "can I trust this data?" before acting on it.

Type:

Cross-URL Comparison

comparison

Optional

On insights records (multi-URL only), per-URL ranking + firstToChange + mostVolatile + eventsByCategory.

Type:object | null

Chart Data

chartData

Optional

On insights records, dashboard-ready arrays per URL: dates, changeScores, magnitudeIndex, versions. Drop straight into Chart.js / D3 / Looker / Sheets.

Type:object | null

Schema Version

schemaVersion

Optional

Versioned output schema. Bumped on breaking changes. Currently "3.0". Stable across runs.

Type:string | null

Example:3.0

Deterministic

deterministic

Optional

Always true on insights / report records. The actor uses no LLMs and no model inference — same input always produces the same output. No hallucinations, no model drift.

Type:boolean | null

Run Summary

runSummary

Optional

On insights records, a single-sentence executive summary of the entire run. Template-based, no LLM. Use it as a Slack subject line, dashboard tile, or email lead.

Type:string | null

Event Clusters

clusters

Optional

On insights records, related events grouped into narratives (same-type events on the same URL within a 90-day window). Each cluster has clusterId, eventCount, summary, and the event IDs it contains.

Type:

Velocity Trend

velocityTrend

Optional

On insights records, per-URL change rate over time: { last30Days, previous30Days, trend: increasing|stable|decreasing|insufficient-data }.

Type:object | null

Delta Info

deltaInfo

Optional

On insights records, set when delta-since-last-run was active for this run. { deltaSinceLastRun, previousRunAt, previousEventCount, newEventCount }.

Type:object | null

Event ID

eventId

Optional

On event sub-objects (inside the insights.events array), a stable ID — type:url:date — for cross-run deduplication. Two runs that detect the same event produce the same eventId.

Type:string | null

Example:pricing-change:competitor-a.com/pricing:2022-03-15

Event Hash

eventHash

Optional

On event sub-objects, a content-derived SHA-1 prefix (16 chars) — useful when you want to detect summary changes within the same eventId.

Type:string | null

Confidence Breakdown

confidenceBreakdown

Optional

On event sub-objects, a 4-component breakdown of the confidence score: { keywordMatch, diffSize, patternMatch, structuralChange }. Sums to roughly the headline confidence — see how much each signal contributed.

Type:object | null

Extracted Entities

entities

Optional

On event sub-objects, deterministic regex extraction from the diff: { prices, plans, products, emails, domains }. No LLM.

Type:object | null

Cluster ID

clusterId

Optional

On event sub-objects, the ID of the cluster this event belongs to (or null if the event was not clustered).

Type:string | null

Importance Score

importanceScore

Optional

On event sub-objects, a 0-1 weighted score combining magnitude (40%), confidence (20%), recency (20%), category priority (10%), cluster size (10%). Use it to sort events by 'what really matters'.

Type:number | null

Evidence

evidence

Optional

On insights records, a chain-of-custody block: { reproducibleQueryHash, retrievalTimestamp, archiveSource, cdxApiVersion, schemaVersion, deterministic, queryParameters }. Run the same actor with the same parameters and the hash matches — useful for legal / compliance audits.

Type:object | null

Discovery

discovery

Optional

On insights records, per-URL OSINT-style discovery: { discoveredPaths, discoveredSubdomains, discoveredEmails, discoveredEndpoints }. Populated from the snapshot set without any extra requests.

Type:

Patterns

patterns

Optional

On insights records, periodicity per (queryUrl, eventType): { periodicity: weekly|monthly|quarterly|biannual|annual|irregular|one-off, avgIntervalDays, sampleSize, note }. Tells you 'they change pricing every quarter' or 'they redesign annually'.

Type:

Change Windows

changeWindows

Optional

On insights records, per-URL: { firstChange, lastChange, span }. Designed to be plugged into external SERP / traffic-analytics tools to correlate change dates with rank or traffic shifts.

Type:

First Occurrence

firstOccurrence

Optional

On insights records, populated when the query input is set: per-URL { firstSeenAt, firstSeenArchiveUrl, snapshotsBeforeMatch, matched }. Answers 'when did this statement first appear?' for legal evidence and content tracking.

Type:

Anomalies

anomalies

Optional

On insights records, surfaced rare or risky items detected in the snapshot set: rare paths (frequency 1 in 30+ snapshots), rare subdomains, risky endpoints (admin/wp-admin/.git/etc.), sensitive file extensions (.zip/.env/.sql), and infrequent error status codes (401/403/5xx). OSINT killer feature.

Type:

Benchmarks

benchmarks

Optional

On insights records, per-URL volatility tier (low/normal/high) and pricing-change benchmark (rare/typical/unusually-frequent). Answers 'is this normal behaviour?' against fixed thresholds.

Type:

Narrative Timeline

narrativeTimeline

Optional

On insights records, year-by-year per-URL summary entries. Plain-English, no LLM.

Type:

Top Signals

topSignals

Optional

On insights records, the 3 highest-importance event lines formatted for screenshots / dashboards / Slack tiles. Sort by importanceScore.

Type:

Portfolio Info

portfolio

Optional

On insights records, automatically populated when 2+ URLs are tracked: { totalUrls, totalEvents, totalMajorEvents, mostActive, leastActive, biggestChange, coverageReliabilityCounts }. Designed for agencies / funds / analyst teams tracking 25-500 companies at once.

Type:object | null

Chain Hash

chainHash

Optional

On event sub-objects, the rolling SHA-256 chain hash. Each event's chainHash = SHA256(prevChainHash + eventHash). Final chainHash = evidence.chainRoot. Modify any event in the chain and the chainRoot no longer matches — tamper-evident audit trail.

Type:string | null

Recommended Action

recommendedAction

Optional

On event sub-objects, a deterministic next-step suggestion templated per event type and magnitude. Null on minor events that don't warrant action.

Type:string | null

Surrounding Event IDs

surroundingEventIds

Optional

On event sub-objects, { before, after } event IDs in chronological order — context window for inferring cause.

Type:object | null

Other properties may be included.

Internet Archive Scraper

automation-lab/internet-archive-scraper

Search and extract metadata from the Internet Archive. Find books, videos, audio, software, and more from 40M+ items.

Stas Persiianenko

Darkweb Scraper

crawlerbros/darkweb-scraper

Crawl dark web .onion sites via Tor. Extract links, emails, phone numbers, cryptocurrency wallet addresses, social media handles, and API keys from hidden services.

Crawler Bros

5.0

Wayback Machine Scraper

glassventures/wayback-machine-scraper

Scrape Wayback Machine archive snapshots for any URL or domain. Get archived URLs, timestamps, status codes, MIME types. Export to JSON, CSV, Excel.

Glass Ventures

Dark Web Scraper

epctex/darkweb-scraper

Uncover valuable insights with our Dark Web Scraper. Extract sensitive data, including crypto wallets, API keys, emails, phone numbers, and more, from the depths of the Dark Web. You can specify search terms, and customize and retrieve OSINT data out of the box.

epctex

1.7K

5.0

Dark Web Search Results Scraper

lofomachines/dark-web-search-results-scraper

Scrapes search results from dark web search engines. Get titles, onion urls, page description.

Lofomachines

5.0

Wayback Machine Search

crawlerbros/wayback-machine-search

Query Internet Archive's Wayback Machine for historical snapshots of any URL or domain. Filter by date, HTTP status, MIME type, and deduplicate. Optionally fetch the archived page text. Free public CDX API, no authentication.

Crawler Bros

5.0

Wayback Machine Historical Content Scraper

happyfhantum/wayback-machine-historical-content-scraper

Compare archived website snapshots through the Wayback Machine and extract page-history change signals.

Kelsey Todd

4.0

Doxon

mr.data_scientist/doxon

Discover anyone's digital presence across 3000+ platforms in seconds. Doxon is a powerful OSINT (Open Source Intelligence) tool that searches for usernames across thousands of websites, social media platforms, and online services.

Ali Hassan

139

1.0

Internet Archive & Wayback Machine Scraper

cloud9_ai/internet-archive-scraper

Search Internet Archive and check Wayback Machine snapshots. Access 800B+ archived pages, books, movies, audio. Search items, get metadata, or check URL archive history. No API key needed. For SEO, OSINT, legal, and research.

cloud9

Social Media Email Scraper 2026

chitosibug3/social-media-email-scraper-2026

Find Social Media Email (Youtube、TikTok、Twitter、Instagram、Linkedin) from Private Database and realtime social network search (NOT ONLY find email in description!)