Website Tools Detector - Third-Party Tools, Tags & Pixels Detection

Apify Actor for detecting and identifying third-party tools, tags, pixels, and scripts on websites.

Description

This actor analyzes websites to detect third-party tools including analytics platforms, marketing tools, chat widgets, payment processors, cookie consent managers, scheduling tools, lead generation tools, and more. It can identify 380 tools by analyzing scripts, cookies, global JavaScript variables, and network requests.

Features

✅ Comprehensive Detection: Detects 380 third-party tools across multiple categories
✅ Multiple Detection Methods: Analyzes scripts, cookies, global variables, and network requests
✅ Category Classification: Organizes detected tools by category (Analytics, Advertising, CRM, Chat, etc.)
✅ Detailed Results: Provides detection methods and details for each tool found
✅ Site Summary: Aggregates results across multiple pages with frequency analysis
✅ Flexible Configuration: Enable/disable specific detection methods

Detected Tool Categories (380 Tools)

• Analytics & Web Analytics (50+ tools): Google Analytics 4, Google Universal Analytics, Adobe Analytics, Adobe Experience Cloud, Matomo, Mixpanel, Amplitude, Segment, Hotjar, Crazy Egg, FullStory, LogRocket, Microsoft Clarity, Plausible Analytics, Fathom Analytics, Simple Analytics, Heap Analytics, Smartlook, Mouseflow, Lucky Orange, PostHog, Countly, Clicky, StatCounter, Woopra, Kissmetrics, Chartbeat, Parse.ly, Webtrends, AT Internet, Webtrekk, Snowplow Analytics, CleverTap, Localytics, Branch.io, Adjust, AppsFlyer, Open Web Analytics, GoSquared, Eulerian Analytics, Singular, Tune, Adobe SiteCatalyst, Yandex Metrica, Baidu Analytics, Inspectlet, SessionCam, SessionStack, and more.

• Social Media Pixels (14+ tools): Facebook Pixel (Meta Pixel), TikTok Pixel, LinkedIn Insight Tag, Pinterest Tag, Snapchat Pixel, Twitter Pixel (X Pixel), Reddit Pixel, Quora Pixel, Instagram Pixel, WhatsApp Business API, WeChat Analytics, VKontakte (VK), Odnoklassniki, Mixi (Japan).

• Advertising & Remarketing (49+ tools): Google Ads (Google AdWords), Google Tag Manager (GTM), Microsoft Advertising (ex-Bing Ads), Criteo, AdRoll, Perfect Audience, The Trade Desk, Amazon DSP, MediaMath, Sizmek, DoubleClick, Google Display Network, Google Shopping, Facebook Ads Manager, Instagram Ads, Twitter Ads, LinkedIn Ads, Pinterest Ads, Snapchat Ads, TikTok Ads, Outbrain, Taboola, Revcontent, Content.ad, MGID, Zemanta, TripleLift, OpenX, Index Exchange, PubMatic, Rubicon Project, AppNexus, Media.net, Yahoo Gemini, Yahoo DSP, Verizon Media, Quantcast, Lotame, Liveramp, Neustar, BlueKai, Krux (Salesforce DMP), Adobe Audience Manager, Oracle BlueKai, Nielsen, Comscore, Integral Ad Science, DoubleVerify, Moat (Oracle), and more.

• CRM & Marketing Automation (43+ tools): HubSpot, Salesforce Marketing Cloud (Pardot), Marketo, Mailchimp, ActiveCampaign, Klaviyo, Sendinblue (Brevo), ConvertKit, GetResponse, Constant Contact, AWeber, Campaign Monitor, Drip, Autopilot, Pardot, Eloqua, Oracle Eloqua, Infusionsoft (Keap), Ontraport, SharpSpring, Act-On, Oracle Responsys, IBM Watson Campaign Automation, Selligent, Emarsys, Braze, Iterable, Customer.io, Twilio SendGrid, SparkPost, Postmark, Mailgun, SendGrid, Mandrill, SocketLabs, Amazon SES, Mailjet, Omnisend, Moosend, Benchmark Email, VerticalResponse, Emma, iContact, and more.

• A/B Testing & Optimization (24+ tools): Google Optimize, Optimizely, VWO (Visual Website Optimizer), AB Tasty, Kameleoon, Convert, Unbounce, Instapage, Landingi, Leadpages, ClickFunnels, Builder.io, Webflow, Framer, Adobe Target, Monetate, Maxymiser, SiteSpect, Qubit, Evergage, Certona, Barilliance, RichRelevance, Bloomreach.

• Chat & Support (29+ tools): Intercom, Drift, Zendesk Chat, LiveChat, Olark, Tawk.to, Tidio, Crisp Chat, Freshchat, Gorgias Chat, Userlike, Pure Chat, JivoChat, Zoho Chat, Chatra, Help Scout, Freshdesk, Zendesk, Groove, Kayako, TeamSupport, LiveAgent, Comm100, BoldChat, SnapEngage, Velaro, Provide Support, Bold360, Zoho Desk.

• Error Tracking & APM (36+ tools): Sentry, Bugsnag, Rollbar, New Relic Browser, Datadog RUM, Raygun, Airbrake, Honeybadger, GlitchTip, TrackJS, Errorception, Loggly, Logentries, Papertrail, Sumo Logic, Splunk, Elastic (ELK Stack), Grafana, Prometheus, AppDynamics, Dynatrace, Instana, AppOptics, SolarWinds, Pingdom, UptimeRobot, StatusCake, Monitis, Site24x7, GTmetrix, WebPageTest, Lighthouse CI, Calibre, SpeedCurve, Catchpoint, ThousandEyes.

• Cookie Consent (40+ tools): Cookiebot, OneTrust, Didomi, Axeptio, Quantcast Choice, CookieHub, Iubenda, CookieYes, CookiePro, TrustArc, Usercentrics, Cookie Law Info, GDPR Cookie Consent, Complianz, Real Cookie Banner, Borlabs Cookie, Cookie Notice, Cookie Consent, Cookie Bar, Cookie Script, Cookie Control, Cookie Information, Cookie-Script.com, Termly, Sourcepoint, Commanders Act, Crownpeak, Osano, Securiti, BigID, WireWheel, DataGrail, Transcend, Ketch, Fides, Ethyca, Evidon (Ghostery), and more.

• Tag Managers & CDP (17+ tools): Google Tag Manager (GTM), Tealium iQ, Adobe Launch / DTM, Piwik PRO Tag Manager, mParticle, RudderStack, Segment, Lytics, Treasure Data, BlueConic, Zeotap, ActionIQ, Amperity, Redpoint Global, AgilOne, Celebrus, SessionM.

• Push Notifications (8+ tools): OneSignal, PushOwl, Webpushr, PushEngage, PushCrew, Aimtell, WonderPush, Pushpad.

• Forms & Surveys (9+ tools): Typeform, SurveyMonkey, Survicate, Qualaroo, Google Forms, Wufoo, JotForm, Formstack, Gravity Forms.

• Social Sharing & Widgets (3+ tools): ShareThis, AddThis, AddToAny.

• Reviews & UGC (6+ tools): Trustpilot, Reviews.io, Yotpo, Judge.me, Verified Reviews / Avis Vérifiés, Google Customer Reviews.

• Payment & E-commerce (12+ tools): Adyen, Mollie, PayPlug, Afterpay / Clearpay, Klarna, PayPal, Stripe, Recharge, Shopify Analytics, WooCommerce Google Analytics, Google Merchant Center, Facebook Shop.

• Recommendation & Personalization (3+ tools): Nosto, Dynamic Yield, Algolia.

• Lead Generation & Sales (20+ tools): Dealfront (ex-Leadfeeder), Clearbit, ZoomInfo, Lusha, Hunter.io, Snov.io, Apollo.io, LinkedIn Sales Navigator, Outreach, Salesforce Sales Cloud, Pipedrive, Copper, Zoho CRM, Freshsales, Close, Aircall, RingCentral, Gong, Chorus.ai, Revenue.io.

• Scheduling & Booking (20+ tools): Calendly, Acuity Scheduling, Cal.com, Doodle, YouCanBook.me, SimplyBook.me, Appointlet, Setmore, Square Appointments, Reservio, Bookly, WooCommerce Bookings, Amelia, LatePoint, Booknetic, FluentBooking, and more.

• And more...

Input

{
  "startUrls": ["https://example.com"],
  "crawlPages": false,
  "maxPages": 10,
  "maxConcurrency": 3,
  "checkScripts": true,
  "checkCookies": true,
  "checkGlobalVariables": true,
  "checkNetworkRequests": true
}

Parameters

• startUrls (required): List of URLs to analyze
• crawlPages (optional, default: false): Enable crawling of pages to analyze multiple pages
• maxPages (optional, default: 10): Maximum number of pages to crawl and analyze
• maxConcurrency (optional, default: 3): Number of pages to analyze concurrently
• checkScripts (optional, default: true): Detect tools from script tags and inline scripts
• checkCookies (optional, default: true): Detect tools from cookies
• checkGlobalVariables (optional, default: true): Detect tools from global JavaScript variables
• checkNetworkRequests (optional, default: true): Detect tools from network requests

Output

The actor generates two types of records:

Page Record

Each page record contains:

• URL and title
• HTTP status code
• List of detected tools with detection methods
• Summary by category

Site Summary

The site summary provides:

• Total pages analyzed
• Total unique tools detected
• Tools frequency across pages
• Tools grouped by category

Example Output

Page Record Example

{
  "type": "page",
  "url": "https://example.com",
  "title": "Example Website",
  "httpStatus": 200,
  "tools": [
    {
      "tool": "Google Analytics 4 (GA4)",
      "category": "Analytics",
      "detected": true,
      "methods": ["script", "globalVariable"],
      "details": {
        "scriptUrls": ["gtag.js"],
        "globalVariables": ["gtag", "dataLayer"]
      }
    },
    {
      "tool": "Facebook Pixel (Meta Pixel)",
      "category": "Social Media",
      "detected": true,
      "methods": ["script", "cookie", "globalVariable"],
      "details": {
        "scriptUrls": ["fbevents.js"],
        "cookieNames": ["_fbp"],
        "globalVariables": ["fbq"]
      }
    }
  ],
  "summary": {
    "totalTools": 2,
    "byCategory": {
      "Analytics": 1,
      "Social Media": 1
    }
  }
}

Site Summary Example

{
  "type": "site-summary",
  "pagesAnalyzed": 5,
  "totalUniqueTools": 12,
  "toolsFrequency": [
    {
      "tool": "Google Analytics 4 (GA4)",
      "category": "Analytics",
      "pagesCount": 5,
      "pages": ["https://example.com", "https://example.com/about", ...]
    }
  ],
  "byCategory": {
    "Analytics": {
      "count": 8,
      "tools": ["Google Analytics 4 (GA4)", "Hotjar"]
    },
    "Social Media": {
      "count": 3,
      "tools": ["Facebook Pixel (Meta Pixel)"]
    }
  }
}

Detection Methods

The actor uses multiple methods to detect tools:

1. Script Analysis: Checks script tags (external and inline) for tool-specific patterns
2. Cookie Detection: Analyzes cookies set by tools
3. Global Variables: Checks for tool-specific JavaScript global variables
4. Network Requests: Monitors network requests to tool domains
5. ID Patterns: Matches tool-specific ID patterns (e.g., GA tracking IDs)

Use Cases

• Competitive Analysis: Identify tools used by competitors
• Technology Audit: Audit your own website's third-party tools
• Privacy Compliance: Identify tracking tools for GDPR/privacy compliance
• Performance Analysis: Understand which tools may impact page performance
• Security Audit: Identify potential security risks from third-party scripts