Gumtree Scraper avatar
Gumtree Scraper
Deprecated
View all Actors
This Actor is deprecated

This Actor is unavailable because the developer has decided to deprecate it. Would you like to try a similar Actor instead?

See alternative Actors
Gumtree Scraper

Gumtree Scraper

voyn/gumtree-scraper

Export data from search results of Gumtree.com, the free classified ads, and community website. Get images, location, prices, and descriptions of the available products and adverts. Save the data as HTML, JSON, CSV, Excel, or XML.

JY

How to link extracted data with analyser

Open

jade_yew opened this issue
2 years ago

Hi, I am currently testing the Gumtree scraper and I am automatically getting data every 2 mins - great.

Now I want to link this exported data with some analysis program and then link to some notification application that notifies me if a new listing meets certain criteria: for example "price=under £100" "keyword includes: iphone 6"

Any advice?

voyn avatar

Hello Billy.

You can run Apify actors remotely by calling an API Endpoint. It'll return scraped data in JSON format. Details about how to do it: https://apify.com/voyn/gumtree-scraper/api

So if you create a custom script (PHP / Python / Node.js any language you prefer) that performs these steps:

  • Runs Gumtree Scraper remotely and retrieve scraped data in JSON format
  • Checks if there are any records matching your criterias
  • Notifies you via email

Optionally you can make this custom script run automatically in evey X hours/days/minutes etc. depending on your needs. If you need any help with that, feel free to contact me.

JY

jade_yew

2 years ago

Hi Fatih,

Thanks for the reply. I don't know any languages, I just came across Apify when I was looking for a Gumtree scraper to find the best deals as soon as they are uploaded. Would you be interested in helping me to write some basic code so that the process is integrated?

voyn avatar

Of course. I can create a simple script for it.

voyn avatar

But before doing it, can you first try built-in mail alert feature in APify? It's in the Integrations section of Gumtree Scraper page. https://console.apify.com/actors/P93C5Ba8O7I562ykJ#/webhooks

In that page, you can click on Gmail so scraped records will be emailed to you. If you set up Gumtree scraper to scrape Gumtree lists depending on your criterias & automate it, they'll be emailed to you.

Example List URL for computers between 500-1000£ sorted by latest results. https://www.gumtree.com/search?featured_filter=false&q=computer&search_location=uk&max_price=1000&min_price=500&search_category=computers-software&urgent_filter=false&sort=date&search_scope=false&photos_filter=false

JY

jade_yew

2 years ago

Hi, thanks for the cooperation.

So, I should enter many different URLs into the scraper?

I am looking for something a bit more specific, we want to be able to analyse HTML Table, JSON data etc, every 2 minutes.

voyn avatar

You can give as many Gumtree list URLs as you need with filters applied to search. If you prefer some kind of comparision between an old data and a new data, we'll need to create a script though.

JY

jade_yew

2 years ago

I have the extracted data every 2 mins.

I want to instantly determine if a new listing meets certain criteria - Here is the main point

and be instantly notified by integrating SMS/Email Actor

voyn avatar

Okay, I see. Can you tell me your criterias? I'll try to create a script during weekend.

JY

jade_yew

2 years ago

Hi Fatih,

That would be amazing.

For example, 2 criteria could be:

  1. Keywords include: “Trek mountain bike”

  2. Price: less than £200

However, I would need to be able to constantly add to and update this criteria by adding keywords to the script.

Many thanks Billy

JY

jade_yew

2 years ago

How's it going? I was told it's only gona be a few lines of script. Also, how do I get the exported data automatically inputted into this code you are making?

Developer
Maintained by Community