Ahrefs Scraper

Extract Ahrefs' free SEO data at scale — Domain Rating, backlinks, referring domains, broken links, organic traffic, keyword ideas, keyword difficulty, SERP overviews, AI-visibility citations, and the top-websites ranking — for any domain, keyword, or brand. No Ahrefs subscription, login, or cookies required. Bulk input, 188 countries, JSON/CSV/Excel out.

Why use the Ahrefs Scraper?

• No Ahrefs account or subscription. Pulls straight from Ahrefs' public free tools — no seats, no API key, no login.
• The whole free-tool suite in one actor. Domain Rating, backlinks (overview + individual list), broken links, traffic, keyword ideas, keyword difficulty, SERP, keyword rank, and AI visibility — mix any of them in a single run.
• Bulk by design. Feed lists of domains, keywords, and brands together; every input fans out across parallel workers.
• 188 countries. Localise keyword and traffic data to any market.
• Clean, flat output. One row per data point with a rowType discriminator — pipe straight into a sheet, database, or dashboard.
• Captcha handled for you. The actor solves Ahrefs' Cloudflare Turnstile automatically; you paste nothing.

What does the Ahrefs Scraper do?

The Ahrefs Scraper turns Ahrefs' free SEO tools into a structured data feed. Give it three kinds of input — domains/URLs, keywords, and brands — and toggle which datasets you want for each:

Input	Datasets you can pull
Domain / URL	Domain Rating & backlink counts, backlinks overview, individual backlinks list, broken inbound links, organic-traffic overview (12-month history, top pages/countries/keywords)
Keyword	Keyword ideas (+ question ideas), keyword difficulty, SERP overview, keyword rank (for a domain you choose)
Brand	AI-visibility citations across ChatGPT, Gemini, Perplexity, Copilot, Grok, and Google AI

It also scrapes the Top Websites ranking (Ahrefs' most-visited sites, filterable by 26 categories and by country) — a global dataset that runs once per run and needs no captcha at all.

Everything runs account-free and returns one flat row per data point.

Supported inputs

• Domains / URLs — e.g. apify.com, https://example.com/blog. Scope each with the mode setting (exact URL, domain + subdomains, path prefix, or whole domain).
• Keywords — any seed phrase, localised by country.
• Brands — any brand or entity name for AI-visibility.

All three accept bulk lists and can be combined in one run.

Use cases

• Backlink research & outreach — pull a competitor's referring domains and top backlinks to build a prospect list.
• Broken-link building — find broken inbound links pointing at any site and pitch your replacement.
• Keyword research — expand a seed keyword into hundreds of ideas with difficulty and volume bands, plus question keywords for content.
• Rank tracking — check where your domain ranks for a basket of keywords across markets.
• Competitor traffic intelligence — estimate a rival's organic traffic, value, trend, and top pages/countries.
• AI-search visibility (GEO) — measure how often a brand is cited by ChatGPT, Gemini, Perplexity, and Google AI Overviews.
• Domain Rating enrichment — score a list of domains by authority for lead-qualification or link-vetting.
• Market mapping — pull the top-visited websites in any category or country to size a niche or find leaders to benchmark.

How it works

1. Input — provide domains/URLs, keywords, and/or brands, then pick the datasets and locale.
2. Processing — each worker solves Ahrefs' Cloudflare Turnstile automatically, queries the matching free-tool endpoint, and rotates residential proxies to scale.
3. Output — every data point is flattened to one row (tagged with rowType) and pushed to the dataset, ready to export.

Input configuration

Field	Type	Description
urls	array	Domains / URLs for the website datasets.
keywords	array	Seed keywords for the keyword datasets.
brands	array	Brand names for AI-visibility.
country	string	Two-letter country code for keyword & traffic data (default us).
mode	select	URL scope: exact, subdomains, prefix, domain (default subdomains).
protocol	select	Protocol for the traffic dataset: both, https, http.
searchEngine	select	Engine for keyword ideas (Google, Bing, YouTube, Amazon, ChatGPT, Gemini, Perplexity, …).
rankDomain	string	Optional — when set, each keyword also returns where this domain ranks.
includeBacklinks	boolean	Backlinks overview (DR, backlinks, referring domains, dofollow split). On by default.
includeBacklinksList	boolean	Individual top backlinks. Reuses the overview call — no extra cost.
includeWebsiteAuthority	boolean	Standalone Domain Rating row (redundant with the backlinks overview).
includeBrokenLinks	boolean	Broken inbound links pointing at the target.
includeTraffic	boolean	Organic-traffic overview with 12-month history and top pages/countries/keywords.
includeKeywordIdeas	boolean	Related keyword ideas. On by default.
includeQuestionIdeas	boolean	Also pull question-style keyword ideas.
includeKeywordDifficulty	boolean	SERP scored for keyword difficulty.
includeSerpOverview	boolean	Full organic SERP with per-result metrics.
includeTopWebsites	boolean	Ahrefs top-websites ranking (global, no captcha). Runs once per run.
topWebsitesCategory	string	Optional category slug filter, e.g. finance, shopping, news.
topWebsitesCountry	string	Optional country slug filter, e.g. united-kingdom, india. Combines with category.
topWebsitesLimit	integer	Cap on top-website rows (default 100).
maxBacklinks / maxKeywordIdeas / maxSerpResults	integer	Per-target row caps (default 100).
maxItems	integer	Hard cap on total output rows.
maxConcurrency	integer	Parallel workers (default 3).
proxy	object	Proxy configuration (default Apify Residential, US).

Example input

{
  "urls": ["apify.com"],
  "keywords": ["seo tools"],
  "brands": ["Apify"],
  "country": "us",
  "mode": "subdomains",
  "includeBacklinks": true,
  "includeBacklinksList": true,
  "includeTraffic": true,
  "includeKeywordIdeas": true,
  "includeKeywordDifficulty": true
}

Output overview

Each data point is a single flat row tagged with a rowType, so one dataset cleanly holds every tool's output:

website_authority · backlinks_overview · backlink · broken_link · traffic_overview · keyword_idea · serp_result · keyword_rank · ai_visibility · top_website

Output samples

Backlinks overview (rowType: "backlinks_overview")

{
  "rowType": "backlinks_overview",
  "url": "apify.com",
  "mode": "subdomains",
  "domainRating": 81,
  "backlinks": 3281785,
  "refDomains": 12319,
  "dofollowBacklinks": 94,
  "dofollowRefDomains": 71
}

Individual backlink (rowType: "backlink")

{
  "rowType": "backlink",
  "targetDomain": "apify.com",
  "sourceUrl": "https://github.com/docling-project/docling",
  "targetUrl": "https://apify.com/vancura/docling",
  "sourceTitle": "GitHub - docling-project/docling",
  "anchor": "Docling Actor",
  "domainRating": 97
}

Traffic overview (rowType: "traffic_overview")

{
  "rowType": "traffic_overview",
  "url": "apify.com",
  "monthlyOrganicTraffic": 477073,
  "monthlyTrafficValue": 16976950,
  "trafficHistory": [{ "date": "2026-07-01", "organic": 466379 }],
  "topPages": [{ "url": "https://apify.com/", "traffic": 31978, "share": 36.56 }],
  "topCountries": [{ "country": "in", "share": 22.9 }]
}

Keyword idea (rowType: "keyword_idea")

{
  "rowType": "keyword_idea",
  "seedKeyword": "seo tools",
  "keyword": "free seo tools",
  "country": "us",
  "difficultyLabel": "Hard",
  "volumeLabel": "MoreThanOneThousand",
  "isQuestion": false
}

Top website (rowType: "top_website")

{
  "rowType": "top_website",
  "rank": 1,
  "domain": "moneysavingexpert.com",
  "category": "Finance",
  "monthlyVisits": "5.4M",
  "monthlyVisitsChange": "-905.2K",
  "scope": "finance/united-kingdom"
}

AI visibility (rowType: "ai_visibility")

{
  "rowType": "ai_visibility",
  "brand": "Apify",
  "totalAiCitations": 16716,
  "citationsByModel": [
    { "model": "Chatgpt", "count": 270 },
    { "model": "Perplexity", "count": 207 }
  ],
  "topCitedDomains": [{ "domain": "apify.com", "mentions": 454 }]
}

Key output fields

Field	Appears in	Meaning
domainRating	authority, backlinks, backlink, broken_link, serp_result	Ahrefs Domain Rating (0–100).
backlinks / refDomains	authority, backlinks_overview	Total backlinks and referring domains.
sourceUrl / targetUrl / anchor	backlink, broken_link	Linking page, linked page, and anchor text.
httpCode	broken_link	HTTP status of the broken target (e.g. 404).
monthlyOrganicTraffic / monthlyTrafficValue	traffic_overview	Estimated monthly organic visits and traffic value.
trafficHistory	traffic_overview	12 months of organic-traffic points.
difficultyLabel / volumeLabel	keyword_idea	Difficulty and search-volume bands.
position / urlRating	serp_result	Organic position and URL Rating of the result.
topPosition	keyword_rank	Best organic position your domain holds for the keyword.
totalAiCitations / citationsByModel	ai_visibility	AI citations and their per-model breakdown.
rank / monthlyVisits / monthlyVisitsChange	top_website	Ranking position, estimated monthly visits, and month-over-month change.

FAQ

Do I need an Ahrefs account or subscription? No. The actor uses Ahrefs' public free tools — no login, API key, or cookies.

Are the numbers the same as paid Ahrefs? They match Ahrefs' free tools, which show real Ahrefs metrics but at free-tier depth (e.g. keyword volume/difficulty as labelled bands, and top-N backlinks rather than the full index).

Can I scrape many domains and keywords at once? Yes. Provide bulk lists of urls, keywords, and brands together; they fan out across parallel workers.

Which countries are supported? Any two-letter country code (188 markets) for keyword and traffic data.

Why do some fields come back null? A dataset is only populated when its toggle is on and Ahrefs returns that field for the target. Non-organic SERP entries (AI overview, questions) have fewer metrics than organic ones.

How is it billed? Pay-per-result — you're charged per output row. See the Pricing tab on the actor's page.

Support

Found a bug or need a field added? Open an issue on the actor's Issues tab in Apify Console and we'll take a look.

Additional services

Need a tailored SEO or data-extraction pipeline — scheduled runs, enrichment, or delivery straight to your warehouse? Reach out through the developer profile on Apify.

Explore more scrapers

• Ubersuggest Scraper — keyword volume, CPC, difficulty, domain backlinks & top pages.
• SimilarWeb Scraper — website traffic, engagement, and audience data.
• Browse the full store profile for more SEO and directory scrapers.

⚠️ Disclaimer

This actor extracts data made publicly available by Ahrefs' free online tools (ahrefs.com) and the public Ahrefs top-websites ranking (ahrefstop.com). It does not access any account-gated or paid Ahrefs data, and it is not affiliated with, endorsed by, or sponsored by Ahrefs. "Ahrefs" is a trademark of its respective owner and is used here only to describe the data source. Use the collected data in compliance with Ahrefs' terms, applicable laws (including copyright and data-protection rules such as GDPR/CCPA), and only for legitimate purposes. You are responsible for how you use the output.

SEO keywords

Ahrefs scraper, Ahrefs API, Ahrefs free tools scraper, Domain Rating checker, backlink checker, backlinks scraper, referring domains, broken link checker, organic traffic checker, keyword research tool, keyword difficulty checker, keyword ideas, SERP checker, keyword rank checker, AI visibility checker, AI citations, SEO data extraction, bulk domain analysis, competitor backlink analysis, DR checker, SEO scraper, Apify SEO actor, top websites ranking, most visited websites, Ahrefs top websites, website ranking by category, top sites by country.