🔎 Ahrefs Scraper

Pull rich, structured SEO data from Ahrefs' free tools — without an Ahrefs subscription or API key. Give the actor a domain/URL and/or a keyword, tick the datasets you want, and it returns clean JSON you can pipe straight into spreadsheets, dashboards, or your own pipelines.

It covers 9 Ahrefs free tools in one run:

🧰 Tool	What you get
🏆 Domain Overview / Website Authority	Domain Rating, backlinks, referring domains
📊 Web Traffic	Est. monthly visits, traffic value, history, top pages/countries/keywords
🔗 Backlinks	Backlink & referring-domain overview
🧩 Broken Links	Broken inbound & outbound links
💡 Keyword Ideas	Keyword + question ideas with volumes
⚙️ Keyword Difficulty	KD score + the ranking SERP
🎯 Keyword Ranking	Where a domain ranks for a keyword
🔎 SERP Overview	Full SERP snapshot for a keyword
🤖 AI Visibility	AI citations across LLMs, top cited domains/pages & topics
🌍 Top Websites	AhrefsTop trending websites (Top 1000/100) + movers up & down

✨ Why Choose Us?

• All-in-one — 9 Ahrefs tools behind a single, simple input.
• Bulk-ready — analyse many domains in one run.
• Resilient — starts on a direct connection and auto-escalates to datacenter → residential proxies only if Ahrefs blocks it, then sticks with the working tier.
• Live results — every record is pushed the moment it's collected, so a long run never loses data.
• Per-section output — each tool gets its own clean dataset view (table) for easy export.

🔑 Key Features

• ✅ Single + bulk URL/domain input
• ✅ 188-country localisation for keyword, SERP & traffic data
• ✅ exact / subdomains scope and http/https/both protocol control
• ✅ Cloudflare Turnstile solving via CapSolver, 2Captcha, Playwright, or a static token
• ✅ Polite rate limiting with configurable delay
• ✅ Live dataset writes + friendly, emoji-rich run log

🛡️ Captcha — handled for you

Ahrefs gates every free tool behind a Cloudflare Turnstile challenge. This actor solves it automatically with a built-in solver — you don't need to bring your own captcha key or configure anything. Just enter your target and press Start.

📥 Input

{
  "keyword": "ai automation",
  "url": "make.com",
  "country": "us",
  "mode": "subdomains",
  "include_web_authority": true,
  "include_traffic": true,
  "include_backlinks": true,
  "include_keywords": true,
  "include_serp": true,
  "include_ai_visibility": true,
  "proxyConfiguration": { "useApifyProxy": true }
}

Field	Type	Description
keyword	string	Keyword (or brand for AI Visibility)
url	string	Single domain/URL to analyse
urls	array	Bulk list of domains/URLs (overrides url)
country	string	2-letter country code (default us)
mode	string	subdomains or exact
include_*	boolean	Toggle each dataset on/off
include_top_websites	boolean	AhrefsTop trending websites (no keyword/domain needed)
category_top_websites	string	Category filter for Top Websites (default all)
country_top_websites	string	Country filter for Top Websites (default worldwide)
proxyConfiguration	object	Proxy settings (fallback only)

Captcha solving is built in — no key required.

📤 Output

One record per tool, e.g. a traffic record:

{
  "data_captured_at": "2026-06-09T16:09:17+00:00",
  "type": "traffic",
  "domain": "make.com",
  "mode": "subdomains",
  "website_authority": { "domainRating": 89.0, "backlinks": 2705381, "refdomains": 35390 },
  "website_traffic": { "trafficMonthlyAvg": 360938, "costMontlyAvg": 17315114 },
  "website_traffic_history": [ ... ],
  "website_traffic_top_pages": [ ... ],
  "website_traffic_top_countries": [ ... ],
  "website_traffic_top_keywords": [ ... ]
}

Each type (traffic, backlinks, broken_links, keyword_ranking, keyword_difficulty, keywords, serp, ai_visibility, top_websites) has its own dataset view in the Output tab.

🚀 How to Use (Apify Console)

1. Log in at console.apify.com → Actors.
2. Open Ahrefs Scraper.
3. Enter a domain/URL and/or keyword, choose the datasets, and add your captcha key.
4. Click Start.
5. Watch the live log as data streams in.
6. Open the Output tab and switch between per-section views.
7. Export to JSON / CSV / XLSX.

🤖 Use via API

curl -X POST "https://api.apify.com/v2/acts/<ACTOR_ID>/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
     -H "Content-Type: application/json" \
     -d '{"url":"make.com","keyword":"ai automation","include_traffic":true,"include_backlinks":true}'

💡 Best Use Cases

• Competitor SEO benchmarking at scale
• Keyword research & content gap analysis
• Backlink & broken-link audits
• Tracking AI/LLM brand visibility

💰 Pricing

This actor uses pay-per-event: you are billed per result record it produces (plus standard platform usage). Captcha-solver costs (CapSolver/2Captcha) are billed by those providers directly, not by Apify.

❓ FAQ

Do I need an Ahrefs account? No — this uses Ahrefs' public free tools.

Do I need a captcha key? No — Ahrefs protects every free tool with Cloudflare Turnstile, but this actor solves it automatically with a built-in solver.

Will it use a proxy? Only if Ahrefs blocks the direct connection — it then escalates to datacenter, then residential, and stays there.

Some fields are empty — why? A given tool may have no data for a target (e.g. a brand-new domain), or Ahrefs returned an error for that one call; the rest of the run still succeeds.

🛟 Support & Feedback

Open an issue on the actor's Issues tab in the Apify Console with your run ID and input, and we'll help.

⚖️ Legal

Data is collected only from publicly available Ahrefs free-tool endpoints. You are responsible for compliance with applicable laws (GDPR, CCPA, etc.) and Ahrefs' Terms of Service.