Pricing

from $1.80 / 1,000 page observations

Try for free

Go to Apify Store

Website Content Change Monitor - Markdown & Chunks

Try for free

Extract public static website content into Markdown and stable chunks. Compare saved observations with chunk upsert/removal manifests. Bounded crawl, robots-aware, no API key.

Pricing

from $1.80 / 1,000 page observations

Rating

0.0

(0)

Developer

Brandt May

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

Developer tools

Automation

Public pages and optional reference IDs

startUrls

Optional

Up to 10 public HTTP(S) URLs or objects {url,externalId}. Empty uses the Python documentation sample. No login, private IPs or custom request credentials.

Type:array

Default:

[
  "https://docs.python.org/3/library/urllib.parse.html"
]

Maximum page attempts across sources

maxPages

Optional

Global fetch-attempt cap across all roots, including failed/duplicate requests. A capped crawl preserves its prior baseline and cannot establish removals.

Type:integer

Minimum:1

Maximum:100

Default:10

Discovered-link depth

maxDepth

Optional

0 means supplied pages only. Higher values follow same-origin links inside the root path (or explicit pathPrefix); completeness is only for this declared scope.

Type:integer

Minimum:0

Maximum:5

Default:0

Allowed path for discovered links

pathPrefix

Optional

Absolute path such as /docs/. Otherwise infer the root directory/path. Not a regex. Applies to links; the supplied start URL itself is always requested.

Type:string

Maximum extracted characters per page

maxPageCharacters

Optional

Larger pages return explicitly truncated content and never replace history. A global 2,000,000-character cap also applies.

Type:integer

Minimum:1000

Maximum:250000

Default:100000

Chunk size — characters, not tokens

chunkCharacters

Optional

Approximate maximum Unicode string length, not model tokens. Chunks preserve heading paths; changing this value starts a new comparison scope.

Type:integer

Minimum:500

Maximum:8000

Default:2400

Compare complete saved scopes

comparePrevious

Optional

Opt in to named-store history. First complete run establishes a baseline. Unchanged checks still return and bill a real observation.

Type:boolean

Default:false

Comparison history name

baselineKey

Optional

One writer per namespace. A separate namespace starts independent history. Letters, digits, underscores and hyphens only.

Type:string

Default:default

Run time budget (seconds)

maxRunSeconds

Optional

Total work budget, also bounded by the platform deadline minus 25 seconds. Unfinished work is reported.

Type:integer

Minimum:30

Maximum:3600

Default:240

Website Content Crawler

jasondev/website-content-crawler

A powerful web crawler that extracts text content from websites, optimized for AI models, Large Language Models (LLMs), vector databases, and Retrieval-Augmented Generation (RAG) pipelines.

Jason Giang

Firecrawl Website Change Monitor - Track Page Changes with AI

alizarin_refrigerator-owner/firecrawl-website-change-monitor---track-page-changes-with-ai

Monitor websites for content changes. Get notified when pricing, inventory, competitor pages, or any web content changes. Uses Firecrawl for intelligent change detection. Markdown Comparison JSON Extraction Change Notifications Webhook Integration Scheduled Monitoring

The Howlers

Website Content Crawler — Text, Titles & Metadata

hipersoft/website-content-crawler

Extract clean, readable content from any list of websites: page title, meta description, headings, main body text, word count and link/image counts. Optional same-domain crawl. Bulk-ready. Great for LLM/RAG ingestion, content audits and research.

hiper soft

Website Content Crawler — Text, Markdown & HTML for AI/LLM

hichemdev/website-content-crawler

Crawl any website and extract clean text, Markdown, and HTML from every page — ready for LLM, RAG, and AI ingestion.

Hichem Ben Moussa

Website Change Detector

eloquent_mountain/website-change-detector

Monitors websites for changes. Detects modifications to HTML structure and visual differences via screenshots. Provides detailed change reports including HTML diff. Track multiple URLs. Use tasks for recurring runs. Integrate as API

Paco

Website Status Monitoring

serhattsnmz/website-status-monitoring

Monitor your websites and get notifications when they are down.

Serhat Sönmez

Simple Website Scrapper (markdown format)

manojaditya64/simple-website-scrapper-markdown-format

A simple website scrapper that scrapes websites and converts it into markdown format which is easy to use with LLM. You can feed markdown data to LLM for easy analysis.

Manojaditya Nadar

5.0

(1)

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David

4.6K

4.9

(7)

Website Content Crawler - Markdown, 45 Fields

parseforge/website-content-crawler

Crawls websites from start URLs with depth, domain and URL-pattern limits. 45 fields per page: Markdown and plain text, word count, title and meta tags, headings, Open Graph and JSON-LD, author and dates, emails, phones and social links, detected technologies, links and HTTP status. Ready for LLMs.

ParseForge

176

Website Content Extractor — Docs & Pages to Markdown

taroyamada/website-content-extractor

Extract website pages to Markdown. No API key / no login. Open Input → leave defaults → Start (1 URL ≈ USD 0.01/run): https://console.apify.com/actors/2SEQ0bWRQ39RCeI0P/input From USD 9/1k.