Website Content Crawler
Pricing
Pay per usage
Website Content Crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
3.6 (39)
Pricing
Pay per usage
1406
Total users
54K
Monthly users
8K
Runs succeeded
>99%
Issues response
7.6 days
Last modified
2 days ago
CORS Error
Open
I am getting CORS error when tying to run actor via API Access to fetch at 'https://api.apify.com/v2' from origin 'myorigin.com' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: How can I add header Access-Control-Allow-Origin ?
Hey,
This issue is not directly related to the Website Content Crawler.
What is your setup? From where and how are you trying to access api.apify.com?
fmateen
Hi Jakub, I am making my own application for example myorigin.com which is using the actor via API calls but API calls are getting blocked by CORS headers. The issue is not on direct execution of the actor on APIFY site but on API based calls
Hello, and thank you for your interest in this Actor!
I just checked that the API is responding with 'Access-Control-Allow-Origin': '*', which means that cross-origin requests from any domain should go through without errors. Can you please share a code snippet on how you are calling the API? Additionally, it would help if you could share what browser you're using, and what domain you're hosting your application on.
Cheers!
