Semrush Scraper - Extract Website Traffic & SEO Analytics

Fast, reliable extraction of domain authority, traffic data, rankings, and competitor insights from Semrush. No account required. Perfect for SEO tracking, competitor monitoring, and market research.

What does this Semrush scraper do?

• Extract domain authority scores - Track SEO health and authority metrics (0-100 scale)
• Get website traffic analytics - Scrape monthly visits, bounce rate, pages per visit, and traffic sources
• Track global rankings - Monitor domain rankings globally and by country
• Analyze competitors - Discover competing domains in your niche
• Monitor keyword performance - Extract top organic keywords with rankings and search volume
• Category insights - Identify website category and category rankings

Use Cases

• SEO Agencies: Monitor client domain authority and traffic metrics automatically
• Competitor Research: Track competitor traffic, rankings, and keyword strategies
• Market Research: Analyze industry leaders and emerging competitors
• E-commerce: Monitor competitor website performance and market position
• Content Marketing: Find keyword opportunities and content gaps
• n8n/Zapier/Make Integration: Automate SEO reporting and competitor monitoring workflows
• Lead Generation: Qualify leads based on domain authority and traffic metrics
• Portfolio Tracking: Monitor multiple website portfolios for clients or investments

Why use this Semrush data extractor?

✅ Simple single-mode interface - Just provide domains and extract all available data

✅ Clean, flat output - Single record per domain that works perfectly in:

• Google Sheets
• Airtable
• n8n workflows
• Zapier automations
• Make scenarios
• Excel/CSV
• SQL databases

✅ Enterprise reliability - Built with Rebrowser anti-bot evasion and residential proxies for consistent, unblocked scraping

✅ No Semrush account needed - Extracts publicly available Semrush data without requiring a subscription

✅ Fast performance - Optimized scraping (~60-80 seconds per domain)

Input

Field	Type	Required	Description
urls	Array	✅ Yes	Domains to analyze (e.g., ["github.com", "stackoverflow.com"])
useProxies	Boolean	No	Enable proxy rotation (default: true, highly recommended)
proxyGroups	Array	No	Proxy groups (default: ["RESIDENTIAL"])

Input Example

{
  "urls": ["github.com", "stackoverflow.com"],
  "useProxies": true
}

Output

Each domain returns one flat record with all available SEO metrics:

{
  "domain": "github.com",
  "scrapedAt": "2025-11-02T13:36:46.810Z",
  "authorityScore": 62,
  "organicTrafficEstimate": 62100000,
  "traffic": {
    "visits": 737600000,
    "bounceRate": 44.09,
    "pagesPerVisit": 5.34,
    "timeOnSite": 729,
    "organicTraffic": 62100000,
    "paidTraffic": 14480,
    "searchTraffic": 62114480,
    "monthOverMonthChange": -2.29
  },
  "globalRank": 40,
  "countryRank": 68,
  "category": null,
  "categoryRank": 3,
  "competitors": [],
  "topKeywords": []
}

Available Fields

Always included:

• domain - Analyzed domain
• scrapedAt - Timestamp of data extraction
• authorityScore - Semrush authority score (0-100)
• organicTrafficEstimate - Monthly organic search traffic estimate
• globalRank - Global traffic ranking
• countryRank - Country-specific traffic ranking (US)
• category - Website category (may be null)
• categoryRank - Rank within category

Traffic metrics (nested object):

• visits - Total monthly visits
• bounceRate - Percentage of single-page visits
• pagesPerVisit - Average pages viewed per session
• timeOnSite - Average session duration (seconds)
• organicTraffic - Organic search traffic
• paidTraffic - Paid search traffic
• searchTraffic - Combined search traffic
• monthOverMonthChange - Traffic change percentage

Competitor & keyword data:

• competitors - Array of competing domains (when available)
• topKeywords - Array of top organic keywords with rankings and search volume (when available)

Example Output with Competitors

{
  "domain": "make.com",
  "scrapedAt": "2025-11-02T13:38:31.513Z",
  "authorityScore": 62,
  "organicTrafficEstimate": 657960,
  "traffic": {
    "visits": 8300000,
    "bounceRate": 37.22,
    "pagesPerVisit": 6.68,
    "timeOnSite": 770,
    "organicTraffic": 657960,
    "paidTraffic": 123320,
    "searchTraffic": 781280,
    "monthOverMonthChange": -5.79
  },
  "globalRank": 6757,
  "countryRank": 7264,
  "category": null,
  "categoryRank": 2084770,
  "competitors": [
    {"domain": "n8n.io"},
    {"domain": "zapier.com"},
    {"domain": "chatgpt.com"}
  ],
  "topKeywords": []
}

Integration Examples

n8n Workflow - Daily Competitor Monitoring

1. Schedule Trigger (daily at 9am)
2. Apify Node: Run semrush-scraper
   Input: { "urls": ["competitor1.com", "competitor2.com"] }
3. Filter: Authority score > 50
4. Google Sheets: Append to tracking sheet
5. Slack: Alert if competitor traffic increased > 10%

Zapier Automation - SEO Alert System

1. Trigger: Schedule (weekly)
2. Apify: Run semrush-scraper with client domains
3. Filter: Bounce rate > 60% OR traffic change < -10%
4. Gmail: Send alert to client
5. Airtable: Log metrics for reporting

Make Scenario - Bulk Domain Analysis

1. Google Sheets: Watch new rows (domain list)
2. Apify: Run semrush-scraper
3. Router:
   - Path A: Authority > 60 → Add to "High Authority" sheet
   - Path B: Authority < 30 → Add to "Needs Work" sheet
4. Slack: Post weekly summary

Google Sheets Direct Import

=IMPORTDATA("https://api.apify.com/v2/datasets/YOUR_DATASET_ID/items?format=csv&token=YOUR_TOKEN")

Pricing

Pay-per-domain: $0.015 per domain analyzed

Typical costs:

• 10 competitor domains: $0.15
• Daily monitoring (100 domains): $1.50
• Monthly audit (1,000 domains): $15.00

No hidden fees. Includes residential proxy costs.

FAQ

Q: Can I analyze multiple domains at once? A: Yes, provide an array in the urls field. Each domain costs $0.015.

Q: Do I need a Semrush account? A: No, this scraper extracts publicly available Semrush data without requiring any subscription.

Q: How often can I run this scraper? A: As often as needed. Schedule daily/hourly via Apify Scheduler, n8n, Zapier, or Make.

Q: Why are some fields empty (null or [])? A: Some data like competitors and keywords are not always visible on Semrush's free overview pages. The scraper extracts all publicly visible data.

Q: Can I use this for SEO competitor analysis? A: Yes! Track competitor authority scores, traffic metrics, and discover competing domains in your niche.

Q: Does this work with n8n, Zapier, and Make? A: Yes! The flat output structure is perfect for automation tools. See integration examples above.

Q: Why are residential proxies recommended? A: Semrush has enterprise anti-bot protection. Residential proxies ensure reliable scraping without blocks.

Q: How fast is the scraper? A: ~60-80 seconds per domain. Optimized for reliability and speed.

Q: Can I track SEO metrics over time? A: Yes! Schedule daily/weekly runs and store results in Google Sheets, Airtable, or a database.

Q: What countries are supported? A: Currently extracts US-based rankings and traffic data. More countries coming soon.

Q: What's included in the free trial? A: First few runs include free Apify platform credits. Perfect for testing before committing.

Technical Details

• Engine: Playwright with Rebrowser for anti-bot evasion
• Proxies: Residential proxies (required, included in pricing)
• Rate limiting: Smart delays between requests
• Session management: Cookie persistence across requests
• Timeout: 120 seconds per domain
• Modal blocking: JavaScript injection prevents signup popups
• Request interception: Captures API responses for enhanced data extraction

Common Use Cases in Detail

SEO Agency Client Reporting

Track 50+ client domains daily. Export to Google Sheets for automated weekly reports showing authority score trends, traffic changes, and competitor movements.

E-commerce Competitor Intelligence

Monitor top 20 competitors' authority scores and traffic. Set up alerts when competitors gain significant traffic or authority improvements.

Lead Qualification

Batch analyze prospect domains to qualify leads based on authority score, traffic volume, and category relevance before outreach.

Portfolio Management

Track domain authority and traffic for website portfolios. Identify underperforming assets that need SEO attention.

Market Research

Analyze 100+ domains in a specific niche to identify market leaders, emerging competitors, and traffic distribution patterns.

---

🔗 Explore More of Our Actors

🔍 SEO & Marketing

Actor	Description
Ahrefs Scraper Pro	Extract SEO metrics and backlink data from Ahrefs
Event Scraper Pro	Extract events from Eventbrite, Meetup, and other platforms

🏢 Business Intelligence

Actor	Description
Indeed Salary Analyzer	Get salary data for compensation benchmarking and HR analytics
Crunchbase Scraper	Extract company data and funding information for business intelligence
Northdata Scraper	Extract German company data from Northdata for business research
Shopify Store Intelligence	Analyze Shopify stores for competitive intelligence and market research
Apify Store Radar	Monitor Apify Store actors for market intelligence

---

Keywords

semrush scraper, semrush api alternative, extract semrush data, domain authority checker, seo metrics extractor, competitor analysis tool, keyword ranking tracker, traffic analytics, seo automation, n8n semrush, zapier seo, make automation, website traffic analyzer, competitor monitoring, seo reporting tool, domain analysis, website authority score, organic traffic estimate, semrush free alternative, bulk domain analyzer, seo competitor research

Support

Issues or feature requests? Contact via Apify support or raise an issue on the actor's GitHub repository.

License

Apache-2.0