Website Content Crawler avatar
Website Content Crawler

Pricing

Pay per usage

Go to Store
Website Content Crawler

Website Content Crawler

Developed by

Apify

Maintained by Apify

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

4.6 (38)

Pricing

Pay per usage

1224

Monthly users

6.4k

Runs succeeded

>99%

Response time

4.6 days

Last modified

2 days ago

ES

get this error

Closed

esc4dinh4 opened this issue
22 days ago

2 min longer and get this error

jakub.kopecky avatar

Hey, thank you for using Website Content Crawler.

The site may have been unavailable at the time or this could be due to some network issue, and since you set the Actor run timeout to 180 seconds (can be changed in Input > Run options), it timed out as expected.

I tried to run the Actor with the exact input as you and it scraped the page successfully: https://console.apify.com/view/runs/vf3kCom2yH0ccb7qp

Closing this issue for now. Let me know if you encounter others or need additional help.

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.