# Website to Markdown — RAG Content & Change Feed (`abdulwhab95/website-markdown-change-feed`) Actor

Turn public static HTML into clean Markdown with source URLs, content hashes and word counts for RAG pipelines. Optional same-site crawling and stored-state comparison skip unchanged pages. No LLM API key.

- **URL**: https://apify.com/abdulwhab95/website-markdown-change-feed.md
- **Developed by:** [ABDULWAHAB NASER RASHED ALQARAWI](https://apify.com/abdulwhab95) (community)
- **Categories:** AI
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.00 / 1,000 pages

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## Website to Markdown — RAG Content & Change Feed

Enter public web page URLs containing readable static HTML; no AI API key is needed.\
Get Markdown text, page titles, source URLs and content hashes for your content or RAG workflow.

### Link discovery

With crawling enabled, navigation/header/footer links are now collected before those elements are removed from the Markdown. Relative links respect a valid HTTP(S) HTML base URL. Credentials and invalid URLs are discarded; the network layer still checks public addresses and robots before fetching. Only same-host discovered pages are crawled.

### Real output example

Captured on 2026-09-14 from run `3FxIzMuJnAvVl5PmI` using the input below. Selected fields are shown; long values are shortened with an ellipsis. Live source data can change.

| title | wordCount | markdown |
| --- | --- | --- |
| Example Domain | 20 | # Example Domain This domain is for use in documentation examples without needing permission. Avoid use in operations. L… |

### Quick start

1. Leave the prefilled example in place and click **Start** for a small first run. Replace it with your own source when ready.
2. Set **Maximum delivered results** and Apify's **Maximum cost per run**.
3. Run the Actor. Export the dataset as JSON, CSV or Excel. Open **Run report** for errors, skipped items and limits.

```json
{
  "urls": [
    "https://example.com"
  ],
  "crawlLinks": false,
  "maxPages": 1,
  "maxResults": 1
}
```

### What it supports

Extracts main/article content when present; removes scripts, styles, navigation, forms, headers and footers. Preserves headings and simple list structure. It is a lightweight Markdown conversion, not a pixel-perfect HTML converter. Up to 100 pages, 200,000 characters per page and 1,000 queued links. crawlLinks stays on the input hosts. No JavaScript rendering, embeddings, LLM calls or authenticated pages. Use onlyChanges plus stateStoreName for incremental collection. Review your rights to use collected content in a downstream model.

### Price

**$0.0020 per page ($2 per 1,000)**, plus **$0.001 per run start** at the supported 512 MB–1 GB memory sizes. The custom `result` event is charged only for a delivered dataset row. There is no separate automatic dataset-row fee. A run that returns zero rows still incurs the start fee. Your account's displayed pricing and platform terms apply. Actor authors pay their own platform resource costs during development and testing.

Set the maximum cost in Apify to cap spending. maxResults also limits output. A limit may truncate a catalog or comparison; inspect RUN\_REPORT rather than assuming completeness.

### Output and reliability

Main fields: `url`, `title`, `language`, `wordCount`, `contentHash`, `markdown`. Each row includes `observedAt`. Nested values remain JSON; choose JSON export to preserve all detail.

RUN\_REPORT contains result count, HTTP request/download totals, source errors, skipped unchanged items and final status. PARTIAL means at least one source failed while other rows were delivered. FAILED means no successful result and at least one error. Successful empty feeds or no-change comparisons can legitimately return zero rows. A 240-second processing deadline and Apify's run timeout bound execution. Downloads are limited to 40 MB per run, with smaller per-response caps; robots checks count as requests. No proxy or external AI API subscription is required.

Only public pages and documented public APIs are supported. Access restrictions are reported. The crawler does not send your Apify token to target websites or connect to private network addresses. Use sources you are entitled to access. Static HTML tools do not execute website JavaScript.

### Repeated runs

For Actors with `stateStoreName`, use a distinct name for each collection and keep the same name for later runs. Apify creates that store in your account; storage retention and access follow your account settings. Do not start overlapping runs that share a store. `onlyChanges` emits new/updated items and retains at most 10,000 recent fingerprints. It does not infer removed pages/jobs. Other Actors are stateless: supply fresh inputs, or feed their datasets into the Dataset Change Detector.

Apify tasks, schedules and integrations can reuse this input. No recurring schedule or customer notification is created automatically.

### عربي

أداة جاهزة للتشغيل من واجهة Apify أو API. أدخل الروابط أو البيانات، وحدد عدد النتائج والحد الأعلى للتكلفة. النتائج بصيغ JSON وCSV وExcel، والتفاصيل والأخطاء في RUN\_REPORT. البيانات العامة فقط؛ الحقول غير المتوفرة تبقى فارغة. راجع حدود الأداة أعلاه قبل اعتماد النتائج.

# Actor input Schema

## `urls` (type: `array`):

Public HTTP(S) URLs without credentials.

## `maxPages` (type: `integer`):

Integer from 1 to 100.

## `crawlLinks` (type: `boolean`):

Crawl links on input hosts

## `stateStoreName` (type: `string`):

Optional named store in your account. Reuse for comparisons; avoid overlapping runs. Use letters, digits and hyphens, 3–61 characters.

## `onlyChanges` (type: `boolean`):

Return only new or updated items

## `maxResults` (type: `integer`):

Integer from 1 to 5000.

## `maxRequests` (type: `integer`):

Integer from 1 to 300.

## Actor input object example

```json
{
  "urls": [
    "https://example.com"
  ],
  "maxPages": 1,
  "crawlLinks": false,
  "onlyChanges": false,
  "maxResults": 1,
  "maxRequests": 100
}
```

# Actor output Schema

## `results` (type: `string`):

No description

## `runReport` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "urls": [
        "https://example.com"
    ],
    "maxPages": 1,
    "crawlLinks": false,
    "maxResults": 1
};

// Run the Actor and wait for it to finish
const run = await client.actor("abdulwhab95/website-markdown-change-feed").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "urls": ["https://example.com"],
    "maxPages": 1,
    "crawlLinks": False,
    "maxResults": 1,
}

# Run the Actor and wait for it to finish
run = client.actor("abdulwhab95/website-markdown-change-feed").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "urls": [
    "https://example.com"
  ],
  "maxPages": 1,
  "crawlLinks": false,
  "maxResults": 1
}' |
apify call abdulwhab95/website-markdown-change-feed --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,abdulwhab95/website-markdown-change-feed"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/1NcjVCJNCTHjZDzgI/builds/XI0TbagmDl3vdV0Xz/openapi.json