Google Ads Scraper avatar
Google Ads Scraper

Pricing

$25.00/month + usage

Go to Store
Google Ads Scraper

Google Ads Scraper

Developed by

Lexis Solutions

Lexis Solutions

Maintained by Community

Find and scrape any company's current and past ads on Google's ad network. Get ad copy, shown dates and locations, impressions, and more. Download and analyze data from the Google Ads Transparency Center (Google Ad Library) for competitive analysis.

4.4 (18)

Pricing

$25.00/month + usage

45

Total users

703

Monthly users

50

Runs succeeded

95%

Issues response

1.1 days

Last modified

12 days ago

Results max at 35

Closed

xn3sdgtJ7dSG7LgTI opened this issue
a month ago

Hello, I'm a newbie to apify, so I may be missing a common solution. The results returned max out at 35, maybe because of lazy loading. Is there a way to scrape the ads using this tool below the lazy loading threshold? The advertiser I'm researching has many more than 35 ads, and I've compared looking at the website with results to confirm there's info missing. AMAZING tool, but I have to get all the results

lexis-solutions avatar

Hi, happy to help! A few questions:

  • In the input tab you'll see the Max Items input, can you check it's set to a sufficiently high value? e.g 999999
  • Would you be able to share your startURLs (or better, a link to the run) so we can check if it's a bug with the actor itself?

Thanks for your interest in the actor!

a month ago

Hello! Thank you so much.

I tried the 999999 value, and ended up with the same amount of results. Start url: https://adstransparency.google.com/advertiser/AR07117872862404280321?region=US&preset-date=Yesterday Link to a run: https://console.apify.com/view/runs/2unQpnfqa9axdGjcO

I have lazy-load-scrolled past 35 results, grabbed a couple keywords and searched for them in the resultant run spreadsheet just to make sure it was not grabbing them all, verified. I'm super excited about getting the entire results, and I'm very thankful for your help. I love that your script is grabbing the ad variations and placing them in the spreadsheet, super awesome.

lexis-solutions avatar

Thanks for the example input. After inspection, it looks like Google serves more ads to logged-in users than to non-logged-in users. You should be able to verify this by visiting the search link in incognito; there are 34 ads.

We have added this as a priority ticket and will post an update on its progress. Thanks for drawing attention to the problem. We hope to come up with a workaround soon!

a month ago

Thank you for letting me know. Looking forward to it!

lexis-solutions avatar

Hi, we just added a section in the actor that describes the differences in ad visibility that depend on authentication and location. We got 3 pages from the search query you're interested in by pasting cookies from a logged-in browser, and setting the proxy country to the US. You can find instructions on how to copy your own cookies and use them in the actor here: https://console.apify.com/organization/DevbkY3adMTBuoECt/actors/3Y5oM7ystipacxama/information/latest/readme#note-on-ad-visibility

If you're happy with the actor and support, please consider reviewing the actor, helps us a lot! Thanks.