Semrush Parser Spider

The Semrush Parser Spider is a powerful tool designed to extract competitor data from Semrush, providing valuable insights into market dynamics and competitive landscapes. This actor is ideal for businesses and researchers looking to gain a competitive edge through detailed competitor analysis.

Features

• Comprehensive Data Extraction: Extracts detailed competitor information including domain authority, global and country ranks, and more.
• High Data Quality: Ensures accurate and up-to-date data directly from Semrush.
• Efficient Performance: Optimized for fast data retrieval and processing.
• Proxy Support: Utilizes Apify's residential proxies to ensure anonymity and prevent IP bans.
• Flexible Configuration: Easily customize URLs and proxy settings to suit your needs.
• Scalable: Handles multiple URLs simultaneously for large-scale data collection.
• User-Friendly Interface: Simple setup and execution through the Apify platform.

Input Parameters

Parameter	Type	Required	Description	Example
Urls	Array	Yes	The URLs for the spider to scrape.	["https://www.semrush.com/website/lowes.com/competitors/"]
proxyConfiguration	Object	No	Specifies proxy servers for the scraper to use, ensuring anonymity.	{"useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"]}

Example Usage

Example Input JSON

{
  "Urls": ["https://www.semrush.com/website/lowes.com/competitors/"],
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Example Output JSON

[
  {
    "domain": "homedepot.com",
    "overview_url": "https://www.semrush.com/website/homedepot.com/overview/",
    "global_rank": "183",
    "country": "United States",
    "country_rank": "54",
    "category": "Retail",
    "category_rank": "18",
    "authority_score": "98",
    "visits": "197.86M",
    "pages_per_visit": "5.6",
    "bounce_rate": "43.8%",
    "actor_id": "zNAAp7SgLM9fDlsGy",
    "run_id": "L2QrJaq12xxPObCK5"
  }
]

Use Cases

• Market Research and Analysis: Gain insights into competitor strategies and market positioning.
• Competitive Intelligence: Monitor competitor performance and identify market trends.
• Price Monitoring: Track competitor pricing strategies.
• Content Aggregation: Collect data for content creation and marketing strategies.
• Academic Research: Analyze market dynamics for academic studies.
• Business Automation: Automate data collection for business intelligence.

Installation and Usage

1. Search for "Semrush Parser Spider" in the Apify Store.
2. Click "Try for free" or "Run".
3. Configure input parameters.
4. Click "Start" to begin extraction.
5. Monitor progress in the log.
6. Export results in your preferred format (JSON, CSV, Excel).

Output Format

The output is a JSON array where each object contains:

• domain: The competitor's domain.
• overview_url: URL to the competitor's overview page on Semrush.
• global_rank: Global rank of the competitor.
• country: Country of the competitor.
• country_rank: Rank within the country.
• category: Business category.
• category_rank: Rank within the category.
• authority_score: Domain authority score.
• visits: Estimated monthly visits.
• pages_per_visit: Average pages per visit.
• bounce_rate: Bounce rate percentage.
• actor_id and run_id: Identifiers for the actor and run.

Support

For custom/simplified outputs or bug reports, please contact:

• Email: support@getdataforme.com
• Subject line: "custom support"
• Contact form: https://getdataforme.com/contact/

We're here to help you get the most out of this Actor!