Website Content Crawler avatar
Website Content Crawler

Pricing

Pay per usage

Go to Store
Website Content Crawler

Website Content Crawler

Developed by

Apify

Apify

Maintained by Apify

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

4.0 (41)

Pricing

Pay per usage

1597

Total users

62K

Monthly users

8.1K

Runs succeeded

>99%

Issues response

8 days

Last modified

a day ago

RE

Website Crawler keeps running after execution completes (13 hrs)

Open

revscaleai opened this issue
10 days ago

I triggered the website content crawler and it continued to run for 13 hrs after I received a response. Please fix and refund, I have been charged 43 dollars.