Pricing

from $0.0024 / page scraped

Website Content Crawler — Text, Titles & Metadata

Extract clean, readable content from any list of websites: page title, meta description, headings, main body text, word count and link/image counts. Optional same-domain crawl. Bulk-ready, no browser, no login. Great for LLM/RAG ingestion, content audits and research.

Pricing

from $0.0024 / page scraped

Rating

0.0

(0)

Developer

hiper soft

Actor stats

Bookmarked

Total users

Monthly active users

19 hours ago

Last modified

What you get per page

Field	Notes
`title`, `description`, `lang`	Page title, meta/OG description, `<html lang>`.
`text`	Readable body text with scripts/nav/header/footer stripped; prefers `<main>`/`<article>`.
`wordCount`	Word count over the full extracted text.
`headings`	`h1`/`h2` outline (level + text).
`internalLinkCount`, `externalLinkCount`, `imageCount`	Structure signals.
`links`	Arrays of internal/external links (toggle off to slim the output).
`canonicalUrl`, `domain`, `depth`	Canonical link, host, and crawl depth.

Input

{
  "urls": ["https://apify.com/blog", "example.com"],
  "crawl": true,
  "maxPagesPerDomain": 20,
  "maxDepth": 2
}

urls — pages/sites to extract, one per line. (Or use startUrls.)
crawl — follow same-domain links (BFS). Off = just the given URLs.
maxPagesPerDomain / maxDepth — crawl limits.
sameDomainOnly — keep the crawl on the start domain (default on).
includeLinks — include the internal/external link arrays (counts always included).
textMaxChars — truncate stored body text (word count uses the full text).
maxConcurrency / maxItems — parallelism and a global page cap.
proxyConfiguration — optional; enable if a target blocks datacenter IPs.

Output (one row per page)

{
  "input": "https://apify.com/blog",
  "url": "https://apify.com/blog",
  "domain": "apify.com",
  "depth": 0,
  "title": "Apify Blog",
  "description": "News and tutorials…",
  "lang": "en",
  "headings": [{ "level": 1, "text": "Apify Blog" }],
  "text": "…clean readable content…",
  "wordCount": 812,
  "internalLinkCount": 47,
  "externalLinkCount": 6,
  "imageCount": 12,
  "error": null
}

Notes

Every site is hard-capped in time so one slow page can never stall a bulk run. Only publicly available page content is collected; respect each site's terms.

Website Content Extractor

tropical_prune/website-content-extractor

CAPABILITIES: extract_content, convert_to_markdown, batch_urls, extract_metadata. INPUT: URLs (single or array), with optional selectors and output format. OUTPUT: structured JSON with title, text, metadata, word_count. FORMATS: json, markdown, text. PRICING: PPE $0.001/page.

Bado

Web Content Crawler — Generic Site Text Extractor

agency-shift/web-content-crawler

Generic web content crawler. Extract text content from any URL. Lightweight alternative for quick page scraping and data collection for AI training and research.

Valdeir Lima

Pinecone Integration

apify/pinecone-integration

This integration transfers data from Apify Actors to a Pinecone and is a good starting point for a question-answering, search, or RAG use case.

Apify

557

3.2

(6)

OpenAI Vector Store Integration

jiri.spilka/openai-vector-store-integration

This integration uploads data from Apify Actors to the OpenAI Vector Store linked to OpenAI Assistant.

Jiří Spilka

224

4.8

(5)

Qdrant Integration

apify/qdrant-integration

Transfer data from Apify Actors to a Qdrant vector database.

Apify

4.7

(2)

PGVector Integration

apify/pgvector-integration

This integration transfers data from Apify Actors to a Postgres SQL database (with PGVector extension).

Apify

4.6

(5)

Milvus Integration

apify/milvus-integration

This integration transfers data from Apify Actors to a Milvus/Zilliz database and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.5

(2)

Weaviate Integration

apify/weaviate-integration

This integration transfers data from Apify Actors to a Weaviate and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.6

(3)

Chroma Integration

apify/chroma-integration

This integration transfers data from Apify Actors to a Chroma and is a good starting point for a question-answering, search, or RAG use case.

Apify

4.5

(2)

Website Content Crawler

parseforge/website-content-crawler

Crawl any website and pull clean Markdown content ready for AI! Follow links across a whole domain and extract page text, titles, headings, images, and metadata. Perfect for building RAG pipelines, training datasets, knowledge bases, and vector databases. Start crawling content in minutes!