Website Content Crawler
No credit card required
Website Content Crawler
No credit card required
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
Do you want to learn more about this Actor?
Get a demoConfiguring Crawler Settings for Crawling Image URLs
Closed
Does this scraper also crawl image URLs? If so, what settings do I need to configure?
Hello, and thank you for your interest in this Actor!
Website Content Crawler already stores the image URLs in the Markdown output. You can toggle this feature with the Output settings > Save Markdown input option (it's also on by default).
If you only want the image URLs (and don't care about the other webpage content), you'll be better off with some of the other Actors (e.g. Web Scraper), which you can partially program yourself, so it extracts the specific content from the webpage.
I'll close this issue now, but feel free to ask additional questions if you have any. Cheers!
ApifyActor Metrics
4k monthly users
-
839 stars
>99% runs succeeded
1 days response time
Created in Mar 2023
Modified 17 hours ago
