Google Trends Scraper avatar

Google Trends Scraper

Try for free

7 days trial then $20.00/month - No credit card required now

View all Actors
Google Trends Scraper

Google Trends Scraper

emastra/google-trends-scraper
Try for free

7 days trial then $20.00/month - No credit card required now

Scrape data from Google Trends by search terms or URLs. Specify locations, define time ranges, select categories to get interest by subregion and over time, related queries and topics, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Do you want to learn more about this Actor?

Get a demo
CC

Interest by City & Related Queries Percentage Values

Closed

ccharisis opened this issue
a year ago

Hi! Not really an Issue but is there a way to extract the Interest by City data as well as the percentage of Rising Related Queries & Rising Topics ? Using the extendOutputFunction provided on the documentation the above data is not returned. Thank you in advance!

paja avatar

Hi, thank you for the suggestion, we are looking into it and will let you know soon.

CC

ccharisis

a year ago

Thanks you very much. I have progressed a bit so the info is inside the following Elements:

Javascript Code

widgets = document.querySelectorAll('trends-widget');

Locations

widgets[1].innerText

Related Topics

widgets[2].innerText

Related Queries

widgets[3].innerText

Now we need to put the above into the "metamorphInput" . Also I wonder how we could get more than 10 or 5 results respectively by activating the next page button before we scrap the page.

Thank you in advance !

misa avatar

Hey, happy to let you know that this feature has been implemented!

To use it, you'll have to insert a direct URL and add #GEO_MAP to the end of the URL, CITIES will be parsed with the city name used instead date https://console.apify.com/view/runs/W3oRKaddgtshLh3zE or add #GEO_MAPREGION to the end of the URL, and PROVINCES will be parsed with province name instead of date. Example run: https://console.apify.com/view/runs/nk1wc1gsiarN0Eiq0

Hope this will be useful for you and happy scraping!

misa avatar

Hey, I just realized you were also asking about the related queries and topics. We'll have to check on this with our delivery team and circle back with you later.

CC

ccharisis

a year ago

Thank you very much Misa!

misa avatar

Sure thing! Just to keep you in the loop, we're now internally discussing revamping this scraper a bit more to reflect all these Google Trends metrics in a more user-friendly way, so stay tuned! :)

CC

Cosmo_CSQ

a year ago

Hi! Α complete and robust solution would be a scraper that returns:

  1. Interest Over Time
  2. Locations: Interest by Region & Interest by City + the Interest value (Not only the 5 shown on page but also the data hidden in the next pages)
  3. Related "Rising" & "Top" Topics + the interest value (Not only the 5 shown on page but also the data hidden in the next pages)
  4. Related "Rising" & "Top" Queries + the interest value (Not only the 5 shown on page but also the data hidden in the next pages)

This is more or less all the data that GTrends offer but it is vital for us to have this data for our use cases.

Thank you in advance!

misa avatar

Thank you for the follow-up. Do you have any preference as to how the data should be structured?

CC

Cosmo_CSQ

a year ago

Hi! The data output could be in JSON Format. Bu the way, do we have any update on this ?

misa avatar

Hi, Thanks for your suggestion! We're in the final stages of development. Since this update will significantly impact some users of the current solution, we'll have to notify them and provide a few days for them to adjust before we switch to the new version. Given this, I'm expecting the new version to be live in about a week (hopefully sooner). But I'll keep you posted!

CC

ccharisis

a year ago

Hi! Really good job 👏 ! Thank you very much

Sent from Outlook for iOShttps://aka.ms/o0ukef

misa avatar

Happy to hear that! Enjoy scraping :)

CC

Cosmo_CSQ

a year ago

Hi Misa and happy new year!

How can we use the new scraper, I mean to get the new results. We have noticed that the results are still the same as before!

Thank you!

alexey avatar

Hi! I noticed high blocking rate in your run and added some unblocking patterns, please check re-run with your input copy: https://console.apify.com/view/runs/57Fs7if8ewz56Tf4A No more failed pages, please feel free to experiment with best RAM and concurrency settings for your data cases

Developer
Maintained by Apify

Actor Metrics

  • 109 monthly users

  • 38 stars

  • 99% runs succeeded

  • 5.5 hours response time

  • Created in Jan 2020

  • Modified 5 hours ago