Website Content Crawler
Pricing
Pay per usage
Website Content Crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with π¦π LangChain, LlamaIndex, and the wider LLM ecosystem.
4.6 (38)
Pricing
Pay per usage
1231
Monthly users
6.4k
Runs succeeded
>99%
Response time
4.6 days
Last modified
3 days ago
Include images URLs list πΌοΈ
Closed
We're working on a project that requires the images from a website. It would be super helpful for us if we could get a list of all the image URLs on the page. Thanks π
Hello and thank you for your interest in this Actor!
To me, this seems like a job for a different Actor - the Website Content Crawler was made mainly for text extraction for feeding/training Large Language Models and other NLP use cases.
If you want to extract all the images from a certain webpage, you can easily do so e.g. with our Web Scraper - this one allows you to supply it with your custom code, e.g. you can do something like this there:
const imageUrls = $('img').map(function() {return this.getAttribute("src")}).toArray();
For the full-size working example, please check my Actor run here. If you like what you see, you can even copy the input from that run into your Actor (you can view/edit the input as JSON).
I'll close this issue now, but feel free to ask additional questions - either here, or in a new issue under Web Scraper. Thanks again!
Pricing
Pricing model
Pay per usageThis Actor isΒ paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.
