Google Images Scraper avatar

Google Images Scraper

Try for free

Pay $3.00 for 1,000 images

View all Actors
Google Images Scraper

Google Images Scraper

hooli/google-images-scraper
Try for free

Pay $3.00 for 1,000 images

Scrape image details from images.google.com. Add your query and number of images and extract image details such as image URL, image source, description, image dimensions, thumbnail, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Do you want to learn more about this Actor?

Get a demo
jancurn avatar

Add an option to download the files to key-value store

Closed

Jan Čurn (jancurn) opened this issue
5 months ago

Currently, the Actor only stores links to the images. But that means the users need to implement image downloading and potentially anti-blocking and proxying themselves, which takes an unnecessary extra effort. Let's add flags downloadImages and downloadThumbnails to store the images to the key-value store. Use some hashing for the names to avoid collisions.

lhotanok avatar

We discussed this today on the meeting and agreed that it would be better to intregrate this Actor with a generic image downloader such as: Dataset Image Downloader & Uploader

This way we won't have to implement the downloading logic separately for Google Images Scraper or other actors with image links included in the dataset.

Do you think this solution would be ok?

jancurn avatar

Hey, yeah that sounds like a good idea. We could add downloader as recommended integration

lhotanok avatar

I've just tested this Actor-to-Actor integration and it works nicely.

The following run of the Dataset Image Downloader & Uploader was triggered with a successful run of Google Images Scraper: https://console.apify.com/view/runs/MXcJdcN8UC4bsobT2

The images were stored to the named KVS downloaded-images as individual files but it is also possible to store them in a single ZIP file or into the S3 bucket.

We could add downloader as recommended integration

Definitely, I'm just trying to figure out where can I set this (and what is the correct format). Does it need to be in the Actor's code or can we set it up in the Console?

jancurn avatar

Cool. The Store team will know how to add this

lhotanok avatar

The suggested integration is set up, see the attached image or Google Images Scraper Integrations directly.

I guess we should update the README as well and mention the possible integration there. We can probably close this Console issue now and leave the README updates for the internal GitHub ticket.

jancurn avatar

Great, thank you

Developer
Maintained by Apify

Actor Metrics

  • 136 monthly users

  • 18 stars

  • >99% runs succeeded

  • 4.1 days response time

  • Created in Feb 2024

  • Modified a month ago

Categories