Google News Scraper avatar

Google News Scraper

Try for free

7 days trial then $20.00/month - No credit card required now

Go to Store
Google News Scraper

Google News Scraper

lhotanova/google-news-scraper
Try for free

7 days trial then $20.00/month - No credit card required now

Gets featured articles from Google News with title, link, source, publication date and image.

CS

Crawling is not respecting the search term or page limits

Closed
chuckling_shirt opened this issue
11 days ago

Did a test search for lional messi, got 8000 results, 99.9% of which were not related.

lhotanova avatar

Hi, thank you for reporting the issue! I reviewed your test run and noticed that you used many input fields not supported by this Actor - where did you get this input from? Most importantly, you used queries array while the Actor currently supports a string query only. Therefore, the Actor didn't recognize your query and searched for an empty string instead, scraping completely unrelated results.

Please, use the input in this format:

1{
2  "fetchArticleDetails": true,
3  "language": "US:en",
4  "maxItems": 100,
5  "proxyConfiguration": {
6    "useApifyProxy": true
7  },
8  "query": "lionel messi"
9}

If you want to validate that all fields from your input are supported, use the Manual input editor (see the screenshot attached). It won't let you specify any unknown input fields, making it safer than the raw JSON editor.

It also seems that you had a typo in your query: lional messi. I changed the query to lionel messi as seen in the above JSON.

You can also take a look at my example run for query lionel messi: https://console.apify.com/view/runs/CDeTUufljbu19rA0j

Developer
Maintained by Community

Actor Metrics

  • 179 monthly users

  • 30 bookmarks

  • >99% runs succeeded

  • 2.5 days response time

  • Created in Oct 2022

  • Modified an hour ago

Categories