Ahrefs Scraper

Ahrefs Scraper

Ahrefs Scraper pulls SEO data from Ahrefs' free SEO tools and AhrefsTop for any website or keyword: Domain Rating, backlinks, organic traffic, keyword ideas, keyword difficulty, SERP results, rank checks, AI search visibility, organic competitors and top website rankings.

Run 14 Ahrefs search types on many domains and keywords in one go, from Domain Rating and top backlinks to Google AI Overview citations, with keyword data for 216 countries and one clean dataset row per lookup.

ParseBird SEO Suite   •  Authority, traffic, backlink & keyword data
Ahrefs Scraper You are here	Similarweb Scraper Traffic, ranks, similar sites	MOZ Scraper Domain Authority, PA, Spam Score
Ubersuggest Scraper Keyword volume, SERP, backlinks

Copy to your AI assistant

Copy this block into ChatGPT, Claude, Cursor, or any LLM to start using this actor.

Ahrefs Scraper (Apify actor parsebird/ahrefs-scraper) returns SEO data from Ahrefs' free tools and AhrefsTop for websites and keywords. Call it with the Apify API client: client.actor("parsebird/ahrefs-scraper").call(run_input={"url": "make.com", "keyword": "ai agent", "include_web_authority": true, "include_traffic": true, "include_backlinks": true, "include_keywords_difficulty": true}). Inputs: url (string, domain or URL), urls (array of strings, bulk), keyword (string), keywords (array of strings, bulk), country (2-letter keyword database code, default "us"), mode ("subdomains" default, "domain", "prefix", "exact"), traffic_country (2-letter code or "" for worldwide), boolean switches include_web_authority (default true), include_traffic (default true), include_backlinks (default true), include_broken_links, include_competitors, include_xml_sitemap, include_keywords, include_keywords_difficulty, include_serp, include_keywords_ranking, include_ai_visibility, include_ai_overview, include_ai_mode, include_top_websites (all default false), category_top_websites (e.g. "all", "business", "news", "shopping"), country_top_websites (e.g. "worldwide", "united-states", "germany"), max_top_websites (1-1000, default 100), proxyConfiguration (optional). Output: one row per lookup with type (authority, traffic, backlinks, broken_links, competitors, xml_sitemap, keywords, keyword_difficulty, serp, keyword_ranking, ai_visibility, ai_overview, ai_mode, top_websites), domain or keyword, data_captured_at and the type's fields such as domain_rating, backlinks, refdomains, organic_traffic_monthly_avg, traffic_history, top_pages, top_keywords, top_backlinks, keyword_ideas, keyword_difficulty, serp_results, domain_position, total_ai_citations, citations_by_model, competitors, websites_rankings. Failed lookups have an error field and are not charged. API docs: https://apify.com/parsebird/ahrefs-scraper/api. Get a token: https://console.apify.com/settings/integrations

What is Ahrefs Scraper?

Ahrefs Scraper gets the data behind Ahrefs' free SEO tools (Website Authority Checker, Website Traffic Checker, Backlink Checker, Broken Link Checker, Keyword Generator, Keyword Difficulty Checker, SERP Checker, Keyword Rank Checker, AI Visibility Checker, AI Overviews Tracker, AI Mode Tracker and Sitemap Generator) plus the public AhrefsTop website rankings, and returns it as structured JSON.

Use it as an Ahrefs API alternative for quick SEO checks at scale: no Ahrefs account, no API key and no browser work on your side. Type a domain such as make.com and a keyword such as ai agent, click Start, and download Domain Rating, backlinks and organic traffic as JSON, CSV or Excel about a minute later.

What can Ahrefs Scraper do?

• 🔗 Website authority and backlinks: Domain Rating (DR), total backlinks, referring domains, dofollow metrics and the top 20 backlinks with anchor text, source page and the linking site's DR.
• 📈 Organic traffic: monthly average organic traffic and traffic value, recent traffic history, top pages, top countries and top keywords. Sites listed on AhrefsTop also get monthly traffic history going back years, exact traffic by country, organic keyword count and traffic rank.
• 🔑 Keyword research: keyword ideas and question ideas with difficulty and volume range, Keyword Difficulty (0 to 100), SERP results with Ahrefs page metrics, and where your domain ranks for a keyword.
• 🤖 AI search visibility: citations across ChatGPT, Gemini, Perplexity, Copilot, Grok, Google AI Overviews and Google AI Mode, with top cited domains, pages and topics.
• 🏆 Competitors and top websites: organic competitors of a site, and the AhrefsTop ranking of the top 1,000 websites worldwide or the top 100 by country and category, with trending up and trending down lists.
• 🧰 Site checks: broken inbound and outbound links, and up to 1,000 URLs from the site's sitemap as Ahrefs crawled it.
• 📦 Bulk runs: add many URLs and keywords; every search type you switch on runs for each one.

As an Apify Actor it also gives you scheduling for weekly SEO monitoring, a REST API, integrations with Google Sheets, Zapier, Make, Slack and webhooks, and exports to JSON, CSV, Excel, XML and HTML.

What data can you extract from Ahrefs?

Search type (type)	Needs	Main fields
authority	URL or domain	domain_rating, backlinks, refdomains, dofollow_backlinks, dofollow_refdomains
traffic	URL or domain	organic_traffic_monthly_avg, traffic_value_monthly_avg_usd, traffic_history, top_pages, top_countries, top_keywords, plus traffic_history_all_time, traffic_by_country, traffic_rank, organic_keywords for AhrefsTop sites
backlinks	URL or domain	total_backlinks, total_referring_domains, top_backlinks (anchor, source URL, target URL, DR, surrounding text), referring_domains_history
broken_links	URL or domain	broken_links_inbound, broken_links_outbound with HTTP codes and totals
competitors	URL or domain	competitors (domain, traffic, traffic change, pages)
xml_sitemap	URL or domain	xml_sitemap_entries (URL, last modified), xml_sitemap_crawled_total
keywords	Keyword	keyword_ideas, keyword_ideas_questions (difficulty label, volume range), totals
keyword_difficulty	Keyword	keyword_difficulty, referring_domains_needed, serp_results
serp	Keyword	serp_results (position, type, title, URL, page metrics)
keyword_ranking	Keyword + URL	domain_position, domain_found, domain_top_result, keyword_ranking_results
ai_visibility	Keyword or brand	total_ai_citations, citations_by_model, monthly_citations_by_model, top_cited_domains, top_cited_pages, top_topics
ai_overview / ai_mode	Keyword or brand	total mentions, monthly change, ai_overview_citations_history, ai_mode_citations_history, top cited domains and pages
top_websites	Category + country	websites_rankings (rank, rank change, domain, categories, traffic), website_rankings_trending_up, website_rankings_trending_down

SERP page metrics include Ahrefs rank, Domain Rating, URL Rating, referring pages, referring domains, traffic, traffic value, keywords, top keyword and word count where Ahrefs has them.

How to scrape Ahrefs data

1. Open Ahrefs Scraper in Apify Console.
2. Enter a URL or domain, a Keyword, or both. Add more in More URLs or domains and More keywords for bulk runs.
3. Pick the Keyword country and the Search scope (subdomains, domain, path prefix or exact URL).
4. Switch on the search types you need. Website authority, traffic and backlinks are on by default.
5. For a top websites list, switch on Top websites ranking and choose a category and country.
6. Click Start.
7. Download the results from the Output tab as JSON, CSV, Excel, XML or HTML, or read them through the API.

Input parameters

Parameter	Type	Required	Default	Description
url	string	No*	—	Website, domain or page, e.g. make.com
urls	array of strings	No*	—	More websites for bulk analysis
keyword	string	No*	—	Keyword, topic or brand, e.g. ai agent
keywords	array of strings	No*	—	More keywords
country	string	No	us	Keyword database country (216 countries)
mode	string	No	subdomains	subdomains, domain, prefix or exact
traffic_country	string	No	worldwide	Limit traffic top pages and keywords to one country
include_web_authority	boolean	No	true	Domain Rating and backlink totals
include_traffic	boolean	No	true	Organic traffic data
include_backlinks	boolean	No	true	Backlink totals and top backlinks
include_broken_links	boolean	No	false	Broken inbound and outbound links
include_competitors	boolean	No	false	Organic competitors (AhrefsTop sites)
include_xml_sitemap	boolean	No	false	Up to 1,000 crawled sitemap URLs
include_keywords	boolean	No	false	Keyword ideas and questions
include_keywords_difficulty	boolean	No	false	Keyword Difficulty and SERP
include_serp	boolean	No	false	Top Google results
include_keywords_ranking	boolean	No	false	Your position for each keyword
include_ai_visibility	boolean	No	false	AI citations in ChatGPT, Gemini, Perplexity, Copilot, Grok and Google AI features
include_ai_overview	boolean	No	false	Google AI Overviews mentions
include_ai_mode	boolean	No	false	Google AI Mode mentions
include_top_websites	boolean	No	false	AhrefsTop top websites ranking
category_top_websites	string	No	all	Category, e.g. business, news, shopping, health
country_top_websites	string	No	worldwide	Country, e.g. united-states, united-kingdom, germany
max_top_websites	integer	No	100	Websites to return (up to 1,000 worldwide)
proxyConfiguration	object	No	off	Not needed in most cases

* Website search types need a URL, keyword search types need a keyword, keyword ranking needs both. AI search types use the keyword, or the domain when no keyword is given. Top websites needs neither.

Output example

One row per lookup. A website authority row and a keyword difficulty row (SERP shortened):

[
  {
    "data_captured_at": "2026-10-06T13:33:11.634364",
    "type": "authority",
    "domain": "make.com",
    "url": "make.com",
    "mode": "subdomains",
    "domain_rating": 90.0,
    "backlinks": 3666513,
    "refdomains": 44105,
    "dofollow_backlinks": 95,
    "dofollow_refdomains": 83
  },
  {
    "data_captured_at": "2026-10-06T13:41:02.118204",
    "type": "keyword_difficulty",
    "keyword": "ai agent",
    "country": "us",
    "keyword_difficulty": 80,
    "referring_domains_needed": 353,
    "serp_results": [
      {
        "position": 2,
        "position_with_metrics": 1,
        "type": "organic",
        "title": "What is an AI agent?",
        "url": "https://www.cloudflare.com/learning/ai/what-is-agentic-ai/",
        "metrics": {
          "rank": 96,
          "domain_rating": 94,
          "url_rating": 8,
          "refpages": 358,
          "domains": 151,
          "traffic": 0,
          "cost": 109,
          "keywords": 2,
          "top_keyword": "agents ai",
          "top_volume": 450
        }
      }
    ],
    "serp_source": "Cache",
    "serp_last_updated": "2026-10-03T16:33:21Z"
  }
]

A traffic row (lists shortened):

{
  "type": "traffic",
  "domain": "make.com",
  "traffic_country": "worldwide",
  "organic_traffic_monthly_avg": 1017028,
  "traffic_value_monthly_avg_usd": 1320063.44,
  "traffic_history": [{ "date": "2026-09-01", "organic": 446407 }, { "date": "2026-10-01", "organic": 1021273 }],
  "top_pages": [{ "url": "https://community.make.com/t/make-com-feature-unavailable-facebook-login/96177", "traffic": 430284, "share": 98.28 }],
  "top_countries": [{ "country": "za", "share": 42.77 }],
  "top_keywords": [{ "keyword": "facebook login", "position": 2, "traffic": 427000 }],
  "listed_on_ahrefstop": true,
  "traffic_rank": [{ "scope": "Hobbies & Leisure", "rank": 24, "rank_change": 109 }],
  "latest_month_organic_traffic": 907700,
  "organic_keywords": 150400,
  "traffic_by_country": [{ "country": "IN", "traffic": 575897, "traffic_last_month": 80939, "traffic_share": 0.634 }],
  "ahrefstop_url": "https://ahrefstop.com/websites/make.com"
}

Download the dataset in JSON, CSV, Excel, XML or HTML from the Output tab.

How much does it cost to scrape Ahrefs?

Ahrefs Scraper uses pay-per-event pricing. You pay for each result row saved to the dataset. Compute and proxy costs are included in the price.

Event	Free plan	Bronze	Silver	Gold
result (one search type for one domain or keyword)	$8.99 / 1,000	$7.99 / 1,000	$6.99 / 1,000	$4.99 / 1,000

A run with one domain and the three default search types (authority, traffic, backlinks) saves 3 rows and costs about $0.027 on the Free plan. Checking authority, traffic and backlinks for 100 domains is 300 rows, about $2.70. A top websites list counts as one row, even with 1,000 websites inside. Lookups that fail are saved with an error field and are not charged. You can set a maximum cost per run in the run options, and the actor stops when it is reached.

How does Ahrefs Scraper work?

1. Reads your URLs, keywords and switches and plans one lookup per search type and target.
2. Opens a short browser session on ahrefs.com to pass Ahrefs' visitor check, then closes it.
3. Calls the same data endpoints that Ahrefs' free tools use, a few at a time.
4. Adds AhrefsTop data (long traffic history, traffic by country, competitors, rankings) for websites listed there.
5. Cleans the responses into flat rows with snake_case field names and saves them to the dataset.

FAQ

Do I need an Ahrefs account or API key? No. The actor uses Ahrefs' free tools and AhrefsTop, which work without logging in.

How is this different from the Ahrefs API? Ahrefs' official API needs a paid Ahrefs plan. This actor returns what the free tools show: top results, top backlinks, top pages and summary metrics. It's a good fit for quick DR checks, traffic snapshots, keyword difficulty checks and AI visibility across many domains or keywords, with Apify scheduling and integrations on top.

Why are competitors or the long traffic history missing for my site? Those come from AhrefsTop, which lists roughly the top websites by organic traffic. Smaller sites still get authority, traffic, backlinks and keyword data from Ahrefs' free tools. A competitors lookup for a site that isn't listed returns an uncharged row with an error field.

What do the search scope modes mean? subdomains covers the domain and all subdomains, domain covers the domain without subdomains, prefix covers every URL that starts with the path you entered, and exact covers only that URL. Use exact for a single page.

Which countries are supported? Keyword ideas, keyword difficulty, SERP and keyword ranking support 216 country databases. Top websites rankings support 170 countries plus worldwide.

How fresh is the data? It's whatever Ahrefs shows at the moment of the run. Each SERP row includes serp_last_updated, and data_captured_at marks when the row was saved.

Can I run it on a schedule? Yes. Use Apify schedules to track DR, traffic or AI citations weekly and send the results to Google Sheets, Slack or a webhook.

How do I use the Ahrefs Scraper API in Python?

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("parsebird/ahrefs-scraper").call(run_input={
    "urls": ["make.com", "zapier.com"],
    "keyword": "workflow automation",
    "include_keywords_difficulty": True,
})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item["type"], item.get("domain") or item.get("keyword"), item.get("domain_rating"))

How do I use it in JavaScript?

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_APIFY_TOKEN' });
const run = await client.actor('parsebird/ahrefs-scraper').call({
    url: 'make.com',
    keyword: 'ai agent',
    include_ai_visibility: true,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

Something is missing or broken. What should I do? Open an issue on the Issues tab. Feedback and feature requests are welcome.

Is it legal to scrape Ahrefs?

Ahrefs Scraper only collects data that Ahrefs shows publicly in its free tools and on AhrefsTop, without logging in. It doesn't collect personal data. You are responsible for how you use the data, including following Ahrefs' terms and applicable laws in your jurisdiction. If you're unsure, ask a lawyer. Read more in Apify's post on whether web scraping is legal.

Other ParseBird scrapers

Actor	What it does
Google Ads Transparency Center Scraper	Ads that any advertiser runs on Google
Website Contact Finder	Emails, phones and social links from websites
Pinterest Keywords Discovery Tool	Keyword ideas from Pinterest search
SocialBlade Scraper	Creator stats and growth for YouTube, TikTok, Instagram, Twitch, Facebook
TikTok Trends Scraper	Trending hashtags, songs, creators and videos on TikTok
Shopify Store Leads Scraper	Shopify stores with contact details