Google Ads & Insight Scraper

Google Ads & Insight Scraper

Extract ADS or INSIGHTS from a search url on google ads transparency website. From adstransparency.google.com get data about advertisers, regions, ADS, spend per advertisers / regions and more.

Features

• Extract ADS from a search URL on website https://adstransparency.google.com/
• Extract INSIGHTS from a search URL on website https://adstransparency.google.com/

INPUT

Batch ads : contains specific ad url; one per line Start url : contains 1 search url

If "batch ads" is provided, it takes priority on start url (start url is ignored)

What data can i get

input type: ADS

• Advertiser ID

• Advertiser name

• Ad ID

• Ad type

• Ad start date

• Ad end date

• Ad number of days running

• List of visible countries

• Image link

• Ad spend range

• Ad impressions range

• Ad spend currency

• Ad url

• ad impressions availability date (when no impressions numbers available yet)

  input type: INSIGHTS

• Total ads

• Total ads spend

• Currency

• Advertisers

  • Name
  • ID
  • Ad spend
  • Ad spend percentage ratio from total ad spend
  • Country
  • Country name
  • Country id

• Regions

  • ID
  • Name
  • Country id
  • Ad spend percentage ratio from total ad spend
  • Ad spend
  • Ad number percentage ratio from total ad
  • Total ads

• TEXT ad spend number percentage ratio of total ad spend

• TEXT ad spend number

• TEXT ad number percentage ratio of total ads

• TEXT ads number

• IMAGE ad spend number percentage ratio of total ad spend

• IMAGE ad spend number

• IMAGE ad number percentage ratio of total ads

• IMAGE ads number

• VIDEO ad spend number percentage ratio of total ad spend

• VIDEO ad spend number

• VIDEO ad number percentage ratio of total ads

• VIDEO ads number

Storage Objects

Ads object

• contains ouput from input "Crawl type" ADS

All Insights object

• contains output from input "Crawl type" INSIGHTS

Advertisers Insights object

• contains only advertisers from the output when running "Crawl type" INSIGHTS

Regions Insights object

• contains only regions from the output when running "Crawl type" INSIGHTS

Output Storage objects exemple

Ads object

[{
  "ad_advertiser_id": "AR12051724274625413121",
  "ad_advertiser_name": "Mary Peltola for Alaska",
  "ad_id": "CR18438859991222845441",
  "ad_type": "image",
  "ad_start_date": "1722473998",
  "ad_end_date": "1723548413",
  "ad_number_days_running": 14,
  "ad_visible_countries": [
    "US"
  ],
  "ad_image_link": "https://tpc.googlesyndication.com/archive/simgad/13664241309647767647",
  "ad_spend_range": "0-100",
  "ad_impressions_range": "2000-3000",
  "ad_spend_currency": "USD",
  "ad_url": "https://adstransparency.google.com/advertiser/AR12051724274625413121/creative/CR18438859991222845441/"
},
{
  "ad_advertiser_id": "AR07109796124864544769",
  "ad_advertiser_name": "WinSenate",
  "ad_id": "CR18434134290246664193",
  "ad_type": "video",
  "ad_start_date": "1722644263",
  "ad_end_date": "1723543208",
  "ad_number_days_running": 12,
  "ad_visible_countries": [
    "US"
  ],
  "ad_image_link": "",
  "ad_spend_range": "2500-3000",
  "ad_impressions_range": "70000-80000",
  "ad_spend_currency": "USD",
  "ad_url": "https://adstransparency.google.com/advertiser/AR07109796124864544769/creative/CR18434134290246664193/"
},
{
  "ad_advertiser_id": "AR09169555100203483137",
  "ad_advertiser_name": "Friends of Janelle Stelson",
  "ad_id": "CR18433459533704593409",
  "ad_type": "text",
  "ad_start_date": "1696981941",
  "ad_end_date": "1723553578",
  "ad_number_days_running": 69,
  "ad_visible_countries": [
    "US"
  ],
  "ad_image_link": "https://tpc.googlesyndication.com/archive/simgad/12573165053427247794",
  "ad_spend_range": "1000-1500",
  "ad_impressions_range": "4000-5000",
  "ad_spend_currency": "USD",
  "ad_url": "https://adstransparency.google.com/advertiser/AR09169555100203483137/creative/CR18433459533704593409/"
},
...]

All Insights object

[{
  "insights_total_ads": "842213",
  "insights_total_ads_spend": "1474676100",
  "insights_total_ads_spend_currency": "USD",
  "insights_advertisers":[{
        "advertiser_name": "BIDEN FOR PRESIDENT",
        "advertiser_id": "AR12365610929977556993",
        "advertiser_adspend": 101352691,
        "advertiser_adspend_percent_of_total": 0.06872878151119038,
        "advertiser_country": "US",
        "advertiser_country_name": "United States",
        "advertiser_country_id": 2840
        },
        {
        "advertiser_name": "DONALD J. TRUMP FOR PRESIDENT, INC.",
        "advertiser_id": "AR11825178974693097473",
        "advertiser_adspend": 83425191,
        "advertiser_adspend_percent_of_total": 0.05657187455579022,
        "advertiser_country": "US",
        "advertiser_country_name": "United States",
        "advertiser_country_id": 2840
        },
    ...],
  "insights_regions": [{
        "region_id": 2016,
        "region_name": "American Samoa",
        "region_country_id": 2840,
        "region_adspend_percent_of_total": 0.0000017328824101275986,
        "region_adspend": 2555,
        "region_ads_percent_of_total": 0.0026097911098498837,
        "region_ads": 2198
        },
        {
        "region_id": 2316,
        "region_name": "Guam",
        "region_country_id": 2840,
        "region_adspend_percent_of_total": 0.000001186292696657206,
        "region_adspend": 1749,
        "region_ads_percent_of_total": 0.0055425409011734565,
        "region_ads": 4668
        },
    ...],
  "insights_text_adspend_percent_of_total": 0.2602584875736296,
  "insights_text_adspend": 383796971,
  "insights_image_adspend_percent_of_total": 0.0792972948807239,
  "insights_image_adspend": 116937825,
  "insights_video_adspend_percent_of_total": 0.6604442175456464,
  "insights_video_adspend": 973941302,
  "insights_text_ads_percent_of_total": 0.23062218227455525,
  "insights_text_ads": 194233,
  "insights_image_ads_percent_of_total": 0.3274397331791364,
  "insights_image_ads": 275774,
  "insights_video_ads_percent_of_total": 0.44193808454630834,
  "insights_video_ads": 372206
}]

Advertisers Insights object

[{
  "advertiser_name": "BIDEN FOR PRESIDENT",
  "advertiser_id": "AR12365610929977556993",
  "advertiser_adspend": 101352691,
  "advertiser_adspend_percent_of_total": 0.06872878151119038,
  "advertiser_country": "US",
  "advertiser_country_name": "United States",
  "advertiser_country_id": 2840
},
{
  "advertiser_name": "DONALD J. TRUMP FOR PRESIDENT, INC.",
  "advertiser_id": "AR11825178974693097473",
  "advertiser_adspend": 83425191,
  "advertiser_adspend_percent_of_total": 0.05657187455579022,
  "advertiser_country": "US",
  "advertiser_country_name": "United States",
  "advertiser_country_id": 2840
},
...]

Regions Insights object

[{
  "region_id": 2016,
  "region_name": "American Samoa",
  "region_country_id": 2840,
  "region_adspend_percent_of_total": 0.0000017328824101275986,
  "region_adspend": 2555,
  "region_ads_percent_of_total": 0.0026097911098498837,
  "region_ads": 2198
},
{
  "region_id": 2316,
  "region_name": "Guam",
  "region_country_id": 2840,
  "region_adspend_percent_of_total": 0.000001186292696657206,
  "region_adspend": 1749,
  "region_ads_percent_of_total": 0.0055425409011734565,
  "region_ads": 4668
},
...]