Google Ads & Insight Scraper

Google Ads & Insight Scraper

Extract ADS or INSIGHTS from a search url on google ads transparency website. From adstransparency.google.com get data about advertisers, regions, ADS, spend per advertisers / regions and more.

Features

• Extract ADS from a search URL on website https://adstransparency.google.com/
• Extract INSIGHTS from a search URL on website https://adstransparency.google.com/

INPUT

Batch ads : contains specific ad url; one per line Start url : contains 1 search url

If "batch ads" is provided, it takes priority on start url (start url is ignored)

What data can i get

input type: ADS

• Advertiser ID

• Advertiser name

• Ad ID

• Ad type

• Ad start date

• Ad end date

• Ad number of days running

• List of visible countries

• Image link

• Ad spend range (only for politial ads)

• Ad impressions range

• Ad spend currency (only for politial ads)

• Ad url

• ad impressions availability date (when no impressions numbers available yet)

  input type: INSIGHTS

• Total ads

• Total ads spend

• Currency

• Advertisers

  • Name
  • ID
  • Ad spend
  • Ad spend percentage ratio from total ad spend
  • Country
  • Country name
  • Country id

• Regions

  • ID
  • Name
  • Country id
  • Ad spend percentage ratio from total ad spend
  • Ad spend
  • Ad number percentage ratio from total ad
  • Total ads

• TEXT ad spend number percentage ratio of total ad spend

• TEXT ad spend number

• TEXT ad number percentage ratio of total ads

• TEXT ads number

• IMAGE ad spend number percentage ratio of total ad spend

• IMAGE ad spend number

• IMAGE ad number percentage ratio of total ads

• IMAGE ads number

• VIDEO ad spend number percentage ratio of total ad spend

• VIDEO ad spend number

• VIDEO ad number percentage ratio of total ads

• VIDEO ads number

Storage Objects

Ads object

• contains ouput from input "Crawl type" ADS

All Insights object

• contains output from input "Crawl type" INSIGHTS

Advertisers Insights object

• contains only advertisers from the output when running "Crawl type" INSIGHTS

Regions Insights object

• contains only regions from the output when running "Crawl type" INSIGHTS

Output Storage objects exemple

Ads object

{
  "ad_advertiser_id": "AR12051724274625413121",
  "ad_advertiser_name": "Mary Peltola for Alaska",
  "ad_id": "CR18438859991222845441",
  "ad_type": "image",
  "ad_start_date": "1722473998",
  "ad_end_date": "1723548413",
  "ad_number_days_running": 14,
  "ad_visible_countries": [
    "US"
  ],
  "ad_image_link": "https://tpc.googlesyndication.com/archive/simgad/13664241309647767647",
  "ad_spend_range": "0-100",
  "ad_impressions_range": "2000-3000",
  "ad_spend_currency": "USD",
  "ad_url": "https://adstransparency.google.com/advertiser/AR12051724274625413121/creative/CR18438859991222845441/",
  "website":"",
  // below contains fake value, to illustrate
  "targeted_countries": [
      "United States"
    ],
    "targeted_platform": [],
    "impressions_per_country": [
      {
        "name": "United States",
        "min": "2000",
        "max": "3000"
      }
    ],
    "impressions_per_platform": [],
    "headline": "Elevate Your EAP with Us - Personalized Mental Health EAP",
    "description": "Discover how our mental wellness programs can enhance your employees' experience."
}

All Insights object

{
  "insights_total_ads": "842213",
  "insights_total_ads_spend": "1474676100",
  "insights_total_ads_spend_currency": "USD",
  "insights_advertisers":[{
        "advertiser_name": "BIDEN FOR PRESIDENT",
        "advertiser_id": "AR12365610929977556993",
        "advertiser_adspend": 101352691,
        "advertiser_adspend_percent_of_total": 0.06872878151119038,
        "advertiser_country": "US",
        "advertiser_country_name": "United States",
        "advertiser_country_id": 2840
        },
        {
        "advertiser_name": "DONALD J. TRUMP FOR PRESIDENT, INC.",
        "advertiser_id": "AR11825178974693097473",
        "advertiser_adspend": 83425191,
        "advertiser_adspend_percent_of_total": 0.05657187455579022,
        "advertiser_country": "US",
        "advertiser_country_name": "United States",
        "advertiser_country_id": 2840
        },
    ...],
  "insights_regions": [{
        "region_id": 2016,
        "region_name": "American Samoa",
        "region_country_id": 2840,
        "region_adspend_percent_of_total": 0.0000017328824101275986,
        "region_adspend": 2555,
        "region_ads_percent_of_total": 0.0026097911098498837,
        "region_ads": 2198
        },
        {
        "region_id": 2316,
        "region_name": "Guam",
        "region_country_id": 2840,
        "region_adspend_percent_of_total": 0.000001186292696657206,
        "region_adspend": 1749,
        "region_ads_percent_of_total": 0.0055425409011734565,
        "region_ads": 4668
        },
    ...],
  "insights_text_adspend_percent_of_total": 0.2602584875736296,
  "insights_text_adspend": 383796971,
  "insights_image_adspend_percent_of_total": 0.0792972948807239,
  "insights_image_adspend": 116937825,
  "insights_video_adspend_percent_of_total": 0.6604442175456464,
  "insights_video_adspend": 973941302,
  "insights_text_ads_percent_of_total": 0.23062218227455525,
  "insights_text_ads": 194233,
  "insights_image_ads_percent_of_total": 0.3274397331791364,
  "insights_image_ads": 275774,
  "insights_video_ads_percent_of_total": 0.44193808454630834,
  "insights_video_ads": 372206
}

Advertisers Insights object

{
  "advertiser_name": "BIDEN FOR PRESIDENT",
  "advertiser_id": "AR12365610929977556993",
  "advertiser_adspend": 101352691,
  "advertiser_adspend_percent_of_total": 0.06872878151119038,
  "advertiser_country": "US",
  "advertiser_country_name": "United States",
  "advertiser_country_id": 2840
}

Regions Insights object

{
  "region_id": 2016,
  "region_name": "American Samoa",
  "region_country_id": 2840,
  "region_adspend_percent_of_total": 0.0000017328824101275986,
  "region_adspend": 2555,
  "region_ads_percent_of_total": 0.0026097911098498837,
  "region_ads": 2198
}