
Website Content Crawler
Pricing
Pay per usage
Go to Store

Website Content Crawler
apify/website-content-crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
4.6 (38)
Pricing
Pay per usage
1.1k
Monthly users
6k
Runs succeeded
>99%
Response time
2.3 days
Last modified
7 days ago
Links are not extracted
Closed
tom.a opened this issue
9 days ago
When crawling a specific website, the log says "No links found on ", but when I look at the HTML output of that URL, I can see href links. Why couldn't the Actor extract them?
Pricing
Pricing model
Pay per usageThis Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.