Website Content Crawler avatar
Website Content Crawler

Pricing

Pay per usage

Go to Store
Website Content Crawler

Website Content Crawler

Developed by

Apify

Apify

Maintained by Apify

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

4.6 (38)

Pricing

Pay per usage

1298

Total users

48.9k

Monthly users

6.6k

Runs succeeded

>99%

Issue response

5.4 days

Last modified

4 days ago

DR

can we get the images on the pages too?

Open

disarming_rutabaga opened this issue
25 days ago

anyway to get the images that are on the crawled pages as well? thanks! :)

LU

luca.bartolini88

25 days ago

+1

jakub.kopecky avatar

Hi,

Thank you for using Website Content Crawler!

Currently, this Actor supports downloading only files/documents (.docx, .pdf, etc.), not images. I will create an issue to request this feature.

Jakub

DO

disarming_rutabaga-owner

18 days ago

yes definitely it would be waaaay better to also get the images too..! thank you![image: ltp|17454832862262373]