Deduplicate site images by content hash for agent memory

Created by

Dennis

Actor

Bulk Image Scraper — Real Dimension & File Size Filter

Crawl a site and return only unique images (SHA-256 content-hash dedup) — useful for agent memory stores that must avoid duplicate visual entries.

Try for free

Bulk Image Scraper — Real Dimension & File Size Filtercodeclouds/bulk-image-scraper

Image URL

Found on page

Found via

URL extension

+5 fields

Input

Start URLs(required):https://example.com

Max crawl depth:3

Max total images:200

Download full image files:false

Output fields

Image URL

Found on page

Found via

URL extension

Real format

Width (px)

Height (px)

File size (bytes)

Alt text

How it works

Sign up on Apify or log in

The Bulk Image Scraper — Real Dimension & File Size Filter Actor is ready to run with the inputs already set for "Deduplicate site images by content hash for agent memory". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Deduplicate site images by content hash for agent memory" task

The Bulk Image Scraper — Real Dimension & File Size Filter Actor will start running based on the input automatically. You can also change all the input fields, like start urls, max crawl depth, and more, to match your specific use case.

Receive the "Deduplicate site images by content hash for agent memory" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as image url, found on page, found via, and more.