Gumtree Scraper avatar
Gumtree Scraper
Under maintenance
Try for free

3 days trial then $10.00/month - No credit card required now

View all Actors
This Actor is under maintenance.

This Actor may be unreliable while under maintenance. Would you like to try a similar Actor instead?

See alternative Actors
Gumtree Scraper

Gumtree Scraper

voyn/gumtree-scraper
Try for free

3 days trial then $10.00/month - No credit card required now

Export data from search results of Gumtree.com, the free classified ads, and community website. Get images, location, prices, and descriptions of the available products and adverts. Save the data as HTML, JSON, CSV, Excel, or XML.

User avatar

How to link extracted data with analyser

Open

jade_yew opened this issue
2 years ago

Hi, I am currently testing the Gumtree scraper and I am automatically getting data every 2 mins - great.

Now I want to link this exported data with some analysis program and then link to some notification application that notifies me if a new listing meets certain criteria: for example "price=under £100" "keyword includes: iphone 6"

Any advice?

User avatar

Hello Billy.

You can run Apify actors remotely by calling an API Endpoint. It'll return scraped data in JSON format. Details about how to do it: https://apify.com/voyn/gumtree-scraper/api

So if you create a custom script (PHP / Python / Node.js any language you prefer) that performs these steps:

  • Runs Gumtree Scraper remotely and retrieve scraped data in JSON format
  • Checks if there are any records matching your criterias
  • Notifies you via email

Optionally you can make this custom script run automatically in evey X hours/days/minutes etc. depending on your needs. If you need any help with that, feel free to contact me.

User avatar

jade_yew

2 years ago

Hi Fatih,

Thanks for the reply. I don't know any languages, I just came across Apify when I was looking for a Gumtree scraper to find the best deals as soon as they are uploaded. Would you be interested in helping me to write some basic code so that the process is integrated?

User avatar

Of course. I can create a simple script for it.

User avatar

But before doing it, can you first try built-in mail alert feature in APify? It's in the Integrations section of Gumtree Scraper page. https://console.apify.com/actors/P93C5Ba8O7I562ykJ#/webhooks

In that page, you can click on Gmail so scraped records will be emailed to you. If you set up Gumtree scraper to scrape Gumtree lists depending on your criterias & automate it, they'll be emailed to you.

Example List URL for computers between 500-1000£ sorted by latest results. https://www.gumtree.com/search?featured_filter=false&q=computer&search_location=uk&max_price=1000&min_price=500&search_category=computers-software&urgent_filter=false&sort=date&search_scope=false&photos_filter=false

User avatar

jade_yew

2 years ago

Hi, thanks for the cooperation.

So, I should enter many different URLs into the scraper?

I am looking for something a bit more specific, we want to be able to analyse HTML Table, JSON data etc, every 2 minutes.

User avatar

You can give as many Gumtree list URLs as you need with filters applied to search. If you prefer some kind of comparision between an old data and a new data, we'll need to create a script though.

User avatar

jade_yew

2 years ago

I have the extracted data every 2 mins.

I want to instantly determine if a new listing meets certain criteria - Here is the main point

and be instantly notified by integrating SMS/Email Actor

User avatar

Okay, I see. Can you tell me your criterias? I'll try to create a script during weekend.

User avatar

jade_yew

2 years ago

Hi Fatih,

That would be amazing.

For example, 2 criteria could be:

  1. Keywords include: “Trek mountain bike”

  2. Price: less than £200

However, I would need to be able to constantly add to and update this criteria by adding keywords to the script.

Many thanks Billy

User avatar

jade_yew

2 years ago

How's it going? I was told it's only gona be a few lines of script. Also, how do I get the exported data automatically inputted into this code you are making?

Developer
Maintained by Community
Actor metrics
  • 4 monthly users
  • 100.0% runs succeeded
  • days response time
  • Created in Aug 2022
  • Modified 17 days ago