Website Content Crawler avatar
Website Content Crawler

Pricing

Pay per usage

Go to Store
Website Content Crawler

Website Content Crawler

Developed by

Apify

Apify

Maintained by Apify

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

4.0 (40)

Pricing

Pay per usage

1392

Total users

53K

Monthly users

7.9K

Runs succeeded

>99%

Issues response

6.8 days

Last modified

4 days ago

FQ

Crawling with markdown give half of the data where on the other pages gives us complete data

Closed

formidable_quagmire opened this issue
13 days ago

So for specifically one of the url the data is partially in the markdown. Not sure as we are not also removing any of the viewport from css selctor as well how this can be possible,

https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ:L_202500914