Website Content Crawler avatar
Website Content Crawler

Pricing

Pay per usage

Go to Store
Website Content Crawler

Website Content Crawler

Developed by

Apify

Apify

Maintained by Apify

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

4.0 (40)

Pricing

Pay per usage

1392

Total users

53K

Monthly users

7.9K

Runs succeeded

>99%

Issues response

6.8 days

Last modified

4 days ago

FM

To much time

Closed

florian-morina opened this issue
7 days ago

it took to long i don't know why

jiri.spilka avatar

Hi, thanks for your interest in this Actor.

Your run failed because the target site (https://www.habitatskc.org/) was timing out — the page didn’t load within the 60-second limit, even after multiple retries.

I’ve tried to reproduce the issue (see this run) and it worked, likely because the page was responsive at that time.

If the site is often slow, you might consider increasing the timeout value. Let me close this issue now, but feel free to ask additional questions. Jiri