💎 Semrush SEO Scraper

Try our other scrapers ►	Ahrefs Scraper	Similarweb Scraper	Social Blade Scraper

Welcome to this Semrush Scraper on Apify!

This versatile & powerful scraper is designed to effortlessly extract comprehensive SEO data from Semrush. Whether you're an SEO professional, digital marketer, or competitive analyst, this scraper helps you uncover detailed SEO insights including domain authority metrics, organic traffic analytics, keyword rankings, backlink profiles, website traffic patterns, competitor intelligence, and trending website data. Perfect for analyzing any domain across Semrush's entire suite, it provides comprehensive traffic analytics, search performance metrics, authority scoring, backlink analysis, and competitive landscape insights across global markets.

One of its best features is its speed & efficiency while scraping thousands of SEO data points in minutes, giving you enterprise-level competitive intelligence from all major Semrush SEO tools in one go.

Transform your SEO strategy with enterprise-level Semrush data at your fingertips! 💎

Key Features

• 🔍 Comprehensive SEO Data Extraction:

  • ✅ Scrapes detailed SEO metrics from Semrush with advanced filtering options
  • ✅ Extracts domain authority scores, traffic analytics, keyword performance, and backlink intelligence automatically
  • ✅ Provides key metrics such as authority scores, organic traffic, bounce rates, pages per visit, search rankings, and many many more.

• 📈 Advanced Traffic Analytics:

  • ✅ Captures detailed website traffic data including visits, bounce rates, and time on site
  • ✅ Provides traffic distribution by device (desktop vs mobile) and geographic breakdown
  • ✅ Extracts traffic channel analysis (direct, organic, paid, social, referral)

• 🖇️ Comprehensive Backlink Analysis:

  • ✅ Scrapes detailed backlink profiles with historical data trends
  • ✅ Provides referral domain counts, backlink quality metrics, and authority scoring
  • ✅ Extracts top-performing pages with backlink distribution analysis

• 📍 Keyword Intelligence:

  • ✅ Captures organic keyword rankings with search volume data
  • ✅ Provides keyword difficulty scores, traffic share analysis, and search trends
  • ✅ Extracts top-performing organic pages with keyword distribution

• 🏆 Trending Website Data:

  • ✅ Scrapes global website rankings with traffic volume analysis
  • ✅ Provides month-over-month and year-over-year growth metrics
  • ✅ Captures industry-specific trending data across multiple categories

• 📊 Flexible Data Output:

  • ✅ Outputs data in various formats including CSV, XLSX, JSON, JSONL, XML, and RSS

🗂️ Use Cases

• SEO Specialists & Digital Marketers: To gather detailed domain authority metrics, traffic analytics, keyword performance data, and comprehensive competitor analysis for strategic optimization.

• Business Intelligence Teams: To analyze website performance trends, market positioning, traffic patterns, and competitive landscape insights for data-driven decision making.

• Enterprise SEO Teams: To monitor domain authority changes, backlink profile evolution, organic traffic trends, and keyword ranking fluctuations across large website portfolios.

• Competitive Analysts: To track trending websites, market share analysis, traffic growth patterns, and industry benchmarking across global markets.

• Web Development Agencies: To provide clients with comprehensive website performance audits, SEO health assessments, and competitive positioning reports.

• Data Scientists & Researchers: To collect large-scale SEO datasets for market research, trend analysis, and predictive modeling in digital marketing.

It essentially streamlines the process of collecting and analyzing comprehensive SEO analytics data from Semrush, making it a valuable tool for professionals who need enterprise-level competitive intelligence and detailed website performance insights.

📌 Output

Domain Authority Overview

Requires: Domain or URL

{
    "data_captured_at": "2025-08-20T14:35:16.688795",
    "type": "domain_authority",
    "last_updated": "2025-08-01T00:00:00",
    "authority_score": 57,
    "authority_score_last_month": 58,
    "authority_score_month_over_month_change": -0.0172,
    "organic_traffic": 4209,
    "authority_analysis_health": "Very good",
    "authority_analysis_link_power_score": 5.829999923706055,
    "authority_analysis_natural_profile_score": 6.0,
    "authority_analysis_organic_traffic_score": 4.849999904632568,
    "backlinks_score": 57,
    "backlinks": 1872579,
    "backlinks_month_over_month_change": -0.0005,
    "referral_domains": 24484,
    "referral_domains_month_over_month_change": -0.006,
    "authority_score_history": [
        {
            "date": "2025-08-01T00:00:00",
            "value": 57
        },
        {
            "date": "2025-07-01T00:00:00",
            "value": 58
        },
        {
            "date": "2025-06-01T00:00:00",
            "value": 58
        },
        ...
        {
            "date": "2024-09-01T00:00:00",
            "value": 54
        },
        {
            "date": "2024-08-01T00:00:00",
            "value": 54
        }
    ],
    "backlinks_history": [
        {
            "date": "2025-08-01T00:00:00",
            "value": 1872579
        },
        {
            "date": "2025-07-01T00:00:00",
            "value": 1873536
        },
        ...
        {
            "date": "2024-09-01T00:00:00",
            "value": 2814888
        },
        {
            "date": "2024-08-01T00:00:00",
            "value": 3164214
        }
    ],
    "referral_domains_history": [
        {
            "date": "2025-08-01T00:00:00",
            "value": 24484
        },
        {
            "date": "2025-07-01T00:00:00",
            "value": 24631
        },
        ...
        {
            "date": "2024-09-01T00:00:00",
            "value": 19172
        },
        {
            "date": "2024-08-01T00:00:00",
            "value": 19113
        }
    ],
    "backlink_indexed_pages": [
        {
            "url": "https://www.make.com/en",
            "domains": 5619,
            "backlinks": 41244
        },
        {
            "url": "https://www.make.com/",
            "domains": 3626,
            "backlinks": 38664
        },
        {
            "url": "https://www.make.com/en/integromat-shutdown?fromImt=1",
            "domains": 2003,
            "backlinks": 13945
        },
        ...
    ]
}

Domain Stats Overview

Requires: Domain or URL

{
  "data_captured_at": "2025-08-20T14:54:44.444507",
  "type": "website_overview",
  "last_updated": "2025-08-12T00:00:00",
  "domain": "make.com",
  "country": "US",
  "categories": [
    {
      "category": "Computer Software and Development"
    }
  ],
  "visits": 9596826,
  "visits_history": [
    {
      "date": "2025-07-01T00:00:00",
      "value": 9596826
    },
    {
      "date": "2025-06-01T00:00:00",
      "value": 8520850
    },
    {
      "date": "2025-05-01T00:00:00",
      "value": 8602605
    }
  ],
  "bounce_rate": 0.3703,
  "pages_per_visit": 7.4525,
  "time_on_site": 870.0,
  "global_rank": {
    "category": null,
    "rank": 6166,
    "change": 1,
    "rank_last_month": 6165
  },
  "category_rank": {
    "category": null,
    "rank": null,
    "change": null,
    "rank_last_month": null
  },
  "country_rank": {
    "country": null,
    "rank": 5970,
    "change": -1,
    "rank_last_month": 5971
  },
  "authority_score": 58,
  "backlinks_google_penalty_risk": "Low",
  "traffic_organic": 794155,
  "traffic_paid": 70152,
  "traffic_history": [
    {
      "date": "2025-07-15T00:00:00",
      "organic_traffic": 794155,
      "paid_traffic": 70152,
      "search_traffic": 864307
    },
    {
      "date": "2025-06-15T00:00:00",
      "organic_traffic": 1017680,
      "paid_traffic": 67011,
      "search_traffic": 1084691
    },
    ...
    {
      "date": "2025-02-15T00:00:00",
      "organic_traffic": 763187,
      "paid_traffic": 59296,
      "search_traffic": 822483
    }
  ],
  "traffic_by_country_history": [
    {
      "country": "US",
      "traffic_share": 0.1785,
      "traffic": 1713245,
      "desktop_share": 0.603,
      "mobile_share": 0.397
    },
    {
      "country": "IN",
      "traffic_share": 0.1473,
      "traffic": 1413459,
      "desktop_share": 0.3383,
      "mobile_share": 0.6617
    },
    {
      "country": "DE",
      "traffic_share": 0.0602,
      "traffic": 577390,
      "desktop_share": 0.8386,
      "mobile_share": 0.1614
    },
    ...
  ],
  "traffic_by_device_history": [
    {
      "date": "2025-07-01T00:00:00",
      "value": 9596826,
      "desktop_visits": 7127326,
      "mobile_visits": 2469500,
      "desktop_share": 0.7426753387005245,
      "mobile_share": 0.25732466129947545
    },
    {
      "date": "2025-06-01T00:00:00",
      "value": 8520850,
      "desktop_visits": 6019297,
      "mobile_visits": 2501553,
      "desktop_share": 0.7064197820639959,
      "mobile_share": 0.29358021793600403
    },
    ...
    {
      "date": "2025-02-01T00:00:00",
      "value": 7863356,
      "desktop_visits": 6597947,
      "mobile_visits": 1265409,
      "desktop_share": 0.8390751989354164,
      "mobile_share": 0.16092480106458362
    }
  ],
  "inbound_traffic_sources": null,
  "outbound_traffic_sources": null,
  "total_backlinks": 1873536,
  "total_backlinks_last_month": 1772151,
  "total_backlinks_change": 5.72,
  "backlinks_history": [
    {
      "date": "2025-07-01T00:00:00",
      "backlinks": 1873536
    },
    {
      "date": "2025-06-01T00:00:00",
      "backlinks": 1772151
    },
    ...
    {
      "date": "2025-02-01T00:00:00",
      "backlinks": 1370868
    }
  ],
  "backlinks_last_updated": "2025-07-01T00:00:00",
  "referral_domains": 24631,
  "referral_domains_last_month": 23504,
  "referral_domains_change": 4.79,
  "referral_domains_history": [
    {
      "date": "2025-07-01T00:00:00",
      "referringDomains": 24631
    },
    {
      "date": "2025-06-01T00:00:00",
      "referringDomains": 23504
    },
    ...
    {
      "date": "2025-02-01T00:00:00",
      "referringDomains": 20532
    }
  ],
  "top_organic_keywords": [
    {
      "keyword": "make",
      "traffic_share": 0.0038,
      "search_volume": 74000,
      "cpc": 1.08
    },
    {
      "keyword": "sheets",
      "traffic_share": 0.0005,
      "search_volume": 1500000,
      "cpc": 3.69
    },
    {
      "keyword": "integromat",
      "traffic_share": 0.0001,
      "search_volume": 2400,
      "cpc": 7.79
    },
    {
      "keyword": "make ai",
      "traffic_share": 0.0001,
      "search_volume": 2400,
      "cpc": 0.72
    }
    ...
  ],
  "top_organic_keywords_last_updated": "2025-07-15T00:00:00",
  "competitors": [
    {
      "domain": "n8n.io",
      "relevance": 0.1,
      "visits": 12154282,
      "favicon": null
    },
    {
      "domain": "thebricks.com",
      "relevance": 0.05,
      "visits": 534741,
      "favicon": null
    },
    ...
  ]
}

Website Traffic

Requires: Domain or URL

{
  "data_captured_at": "2025-08-20T14:35:16.687510",
  "type": "website_traffic",
  "last_updated": "2025-07-01T00:00:00",
  "domain": "make.com",
  "bounce_rate": 0.3703,
  "time_on_site": 870.0,
  "pages_per_visit": 7.4525,
  "visits": 9596826,
  "visits_month_over_month_change": 0.1263,
  "visits_6_month_change": 0.5006,
  "search_traffic_history": [
    {
      "date": "2025-07-15T00:00:00",
      "search_traffic": 864307,
      "paid_traffic": 70152,
      "organic_keywords_value": 541745,
      "organic_traffic": 794155
    },
    {
      "date": "2025-06-15T00:00:00",
      "search_traffic": 1084691,
      "paid_traffic": 67011,
      "organic_keywords_value": 979292,
      "organic_traffic": 1017680
    },
    {
      "date": "2025-05-15T00:00:00",
      "search_traffic": 1466334,
      "paid_traffic": 72910,
      "organic_keywords_value": 735218,
      "organic_traffic": 1393424
    },
    ...
  ],
  "traffic_organic": 794155,
  "traffic_paid": 70152,
  "organic_keywords_value": 541745,
  "traffic_by_channel": {
    "last_updated": "2025-07-01T00:00:00",
    "direct": {
      "value": 7529281,
      "share": 0.6947
    },
    "paid": {
      "value": 158187,
      "share": 0.0146
    },
    "search": {
      "value": 949652,
      "share": 0.0876
    },
    "mail": {
      "value": 8822,
      "share": 0.0008
    },
    "social": {
      "value": 133660,
      "share": 0.0124
    },
    "referral": {
      "value": 813772,
      "share": 0.0751
    },
    "display_ad": {
      "value": 3452,
      "share": 0.0003
    },
    "search_paid": {
      "value": 158187,
      "share": 0.0146
    },
    "social_paid": {
      "value": 1327,
      "share": 0.0001
    }
  },
  "organic_keywords": [
    {
      "keyword": "make",
      "rank": 1,
      "traffic_share": 0.3836,
      "search_volume": 74000,
      "search_trend": [
        0.45,
        0.36,
        0.67,
        0.67,
        0.55,
        0.82,
        0.67,
        1.0,
        0.55,
        0.67,
        0.67,
        0.67
      ]
    },
    {
      "keyword": "google sheets",
      "rank": 12,
      "traffic_share": 0.0377,
      "search_volume": 2240000,
      "search_trend": [
        0.3,
        0.54,
        0.3,
        0.44,
        0.81,
        0.36,
        0.54,
        0.36,
        0.36,
        0.44,
        0.67,
        0.54
      ]
    },
    ...
  ],
  "top_pages_organic": [
    {
      "url": "https://www.make.com/en",
      "traffic": 80584,
      "traffic_share": 0.4727,
      "keywords_count": 4402
    },
    {
      "url": "https://www.make.com/en/ai-automation",
      "traffic": 4330,
      "traffic_share": 0.0254,
      "keywords_count": 601
    },
    {
      "url": "https://www.make.com/en/pricing",
      "traffic": 3695,
      "traffic_share": 0.0216,
      "keywords_count": 944
    },
    ...
  ]
}

Top Websites Ranking Search

Requires: Top Website Industry Top Website Country

{
  "data_captured_at": "2025-08-20T14:35:16.684128",
  "type": "top_trending_websites",
  "last_updated": "2025-07-01T00:00:00",
  "country": "global",
  "industry": "all",
  "total_traffic": 258481645124,
  "total_traffic_history": [
    {
      "date": "2024-08-01T00:00:00",
      "value": 253835747207
    },
    {
      "date": "2024-09-01T00:00:00",
      "value": 255287549341
    },
   ...
    {
      "date": "2025-06-01T00:00:00",
      "value": 240912290393
    },
    {
      "date": "2025-07-01T00:00:00",
      "value": 261095990778
    }
  ],
  "ranks": [
    {
      "domain": "google.com",
      "rank": 1,
      "traffic": 101348173032,
      "traffic_month_over_month_change_percentage": 0.049700704,
      "traffic_year_over_year_change_percentage": 0.025684018000000003,
      "desktop_traffic": 27202730749,
      "mobile_traffic": 74145442283,
      "desktop_share": 0.268408693863785,
      "mobile_share": 0.731591306136215,
      "top_source": "direct",
      "traffic_month_over_month_change": 50370755,
      "traffic_year_over_year_change": 26030283
    },
    {
      "domain": "youtube.com",
      "rank": 2,
      "traffic": 47122481920,
      "traffic_month_over_month_change_percentage": 0.10016614,
      "traffic_year_over_year_change_percentage": -4.007165,
      "desktop_traffic": 15015343636,
      "mobile_traffic": 32107138284,
      "desktop_share": 0.3186450081617433,
      "mobile_share": 0.6813549918382568,
      "top_source": "direct",
      "traffic_month_over_month_change": 47200771,
      "traffic_year_over_year_change": -1888275602
    },
    {
      "domain": "facebook.com",
      "rank": 3,
      "traffic": 9943581521,
      "traffic_month_over_month_change_percentage": 0.08486653000000001,
      "traffic_year_over_year_change_percentage": -12.077345,
      "desktop_traffic": 5007493785,
      "mobile_traffic": 4936087736,
      "desktop_share": 0.5035905598425073,
      "mobile_share": 0.4964094401574927,
      "top_source": "direct",
      "traffic_month_over_month_change": 8438772,
      "traffic_year_over_year_change": -1200920645
    },
    ...
    {
      "domain": "scribd.com",
      "rank": 98,
      "traffic": 208417570,
      "traffic_month_over_month_change_percentage": 0.10387157999999999,
      "traffic_year_over_year_change_percentage": 0.19089552,
      "desktop_traffic": 78201945,
      "mobile_traffic": 130215625,
      "desktop_share": 0.37521762200758796,
      "mobile_share": 0.6247823779924121,
      "top_source": "direct",
      "traffic_month_over_month_change": 216486,
      "traffic_year_over_year_change": 397859
    },
    {
      "domain": "foxnews.com",
      "rank": 99,
      "traffic": 206866207,
      "traffic_month_over_month_change_percentage": 0.08592751500000001,
      "traffic_year_over_year_change_percentage": -15.930272,
      "desktop_traffic": 63774007,
      "mobile_traffic": 143092200,
      "desktop_share": 0.30828624899570956,
      "mobile_share": 0.6917137510042904,
      "top_source": "direct",
      "traffic_month_over_month_change": 177754,
      "traffic_year_over_year_change": -32954349
    },
    {
      "domain": "ameblo.jp",
      "rank": 100,
      "traffic": 204472793,
      "traffic_month_over_month_change_percentage": -4.6212068,
      "traffic_year_over_year_change_percentage": 0.13217987,
      "desktop_traffic": 31778216,
      "mobile_traffic": 172694577,
      "desktop_share": 0.15541537597131566,
      "mobile_share": 0.8445846240286844,
      "top_source": "search",
      "traffic_month_over_month_change": -9449110,
      "traffic_year_over_year_change": 270271
    }
  ]
}

📍 Input

Semrush Search Parameters

- urls: (Optional) (Array of Strings) The URLs or Domains of the web pages to search for on Semrush. Enter a list of complete URLs or just domain names to analyze multiple targets at once (e.g. ["make.com", "example.com"]). Default value is ["make.com"].

- include_overview: (Optional) (Boolean) If set to True, the search will include basic domain metrics and stats from Semrush showing domain authority, backlinks, organic traffic, and more. 💡 Default value is True.

- include_traffic: (Optional) (Boolean) If set to True, the search will include web-traffic data from Semrush showing organic search traffic estimates, visits, top pages, and traffic trends. 💡 Default value is True.

- include_authority: (Optional) (Boolean) If set to True, the search will include domain authority metrics from Semrush showing domain rating, backlinks, referall, health scores and other authority metrics. 💡 Default value is True.

- include_top_websites: (Optional) (Boolean) If set to True, the search will include top websites data from Semrush showing the top trending 100 websites worldwide for a specific industry and country. 💡 Default value is True

- industry_top_websites: (Optional) (String) The indsutry for the top websites search on Semrush. Choose from all, accounting-and-auditing, advertising-and-marketing, banking, education and many more to filter. 💡 Default value is all.

- country_top_websites: (Optional) (String) The country for the top websites search on Semrush. Choose from global, us, uk, de, fr, jp, br, ru and many more to filter. 💡 Default value is global.

JSON Input

Sample JSON input if you use the apify api via CURL, Python, JS etc.

{
    "urls": ["https://www.make.com/"],
    "include_overview": true,
    "include_authority": true,
    "include_traffic": true,
    "include_top_websites": true,
    "industry_top_websites": "all",
    "country_top_websites": "global"
}

Available Search Types

Each run can include up to 4 different search types:

• overview - Basic Domain metrics and stats
• traffic - Traffic analysis data
• authority - Domain authority metrics
• top_websites - Top 100 trending websites worldwide or in a specific industry and country

Usage Limits

This service has different usage limits depending on your subscription status:

User Type	Monthly Runs	Search Types per Run	Reset Period
Free	10 runs	Up to 4 types	30 days
Paid	Unlimited	Up to 4 types	N/A

How Limits Work

• Free users: Limited to 10 runs per 30-day period from your first usage
• Paid users: No limits on the number of runs
• All users: Can select any combination of the 4 search types in a single run
• Usage resets automatically 30 days after your first run (for free users)

⚙️ While the scraper is running

During the run, the actor will output log messages letting you know what is going on at any point. Each message always contains specific information about the process including which url / page the actor is working on.

If you provide invalid inputs to the actor, it will immediately stop with a failure state and output log messages explaining what is wrong. If you are unsure what went wrong feel free to open up an issue in the issue tab.

🔗 Legality of web scraping and scraping of job listings

The Semrush Scraper is designed to ethically extract only publicly available SEO data and information, and it does not scrape private user data such as personal email addresses or personal identifiers.

Our scrapers are ethical and do not extract any private user data, such as email addresses, gender, or location. They only extract what the user has chosen to share publicly. We therefore believe that our scrapers, when used for ethical purposes by Apify users, are safe. However, you should be aware that your results could contain personal data. Personal data is protected by the GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. You can also read this blog post on the legality of web scraping.

💬 Feedback and Support

Your satisfaction is important to us! Therefore we are constantly striving to enhance the performance of our Actors.

If you have any technical feedback or encounter any bugs with the Semrush Scraper, please create an issue in the Actor’s Issues tab on the Apify Console.

You can also contact us directly for custom integrations or project use cases at business@radeance.com.