Improvement Update
- Overhauled changelog format to follow the Keep a Changelog standard for better readability and organization
- General stability improvements and optimizations
Hotfix Update
- General stability improvements and optimizations
- Fixed wrong links within documentation
Improvement Update
- Added Broken Links output view, allowing users to see broken links data in a more organized and readable format
- General stability improvements and optimizations
Improvement Update
- Added AI Overview and AI Mode search types, allowing users to gain insights into how their brand or keywords are represented in AI-generated content across Google Search
- Added XML Sitemap search type, enabling users to extract up to 1000 URLs from a domain's XML sitemap for further analysis
- General stability improvements and optimizations
Hotfix Update
- Added fallbacks for recent proxy provider outage, ensuring continued service availability and reliability for our users
- General stability improvements and optimizations
Improvement Update
- Improved documentation for better usability & readability
- General stability improvements and optimizations
Maintenance Update
- Disabled deprecated pricing events, users will no longer receive notifications about deprecated pricing events
- General stability improvements and optimizations
Maintenance Update
- General stability improvements and optimizations
- Some minor bug fixes and improvements
Hotfix Update
- General stability improvements and optimizations
- Resolved parsing issues for some fields in domain authority search including domain_rating and url_rating
Improvement Update
- Updated permissions from Full Permissions to Limited Permissions on Apify as the scraper no longer requires Full Permissions to run, this change is aimed at improving security and user trust while still providing the necessary functionality for the scraper to operate effectively
- General stability improvements and optimizations
Improvement Update
- Added new Output (Table) Views for Keyword and SERP search types, with new fields and improved formatting for better readability and usability
- General stability improvements and optimizations
Improvement Update
- Added AI visibility search type, allowing users to check how a brand or keyword is represented in AI-generated content across the web (for high traffic websites only)
- Added direct access fields to domain authority search results, allowing users to easily access key authority metrics without needing to get them from the nested object 'website_authority'. The legacy fields are still available for backward compatibility but they will be deprecated in the future, so we recommend switching to the new direct access fields as soon as possible
- Overhauled and added new Output (Table) Views with new fields and improved formatting for better readability and usability
- Improved processing performance significantly, reducing the time taken for each run by over 50% in most cases
- Reduced competitors search output fields as its dependency source has been deprecated (for high traffic websites only)
- Overhauled log messages for better readability and clarity
- General stability improvements and optimizations
- Fixed Top Website Rankings search returning incorrect data in some cases, due to changes in the upstream source
Maintenance Update
- General stability improvements and optimizations
Maintenance Update
- Reduced pricing for paid plans to make our service more accessible to a wider range of users and heavy user friendly
- General stability improvements and optimizations
Hotfix Update
- General stability improvements
- Fixed newly introduced Domain Authority URL Rating and Ahrefs Rank not always showing on Domain Authority Search for paying users
- Resolved issues with Domain Overview Search crashing runs due to some changes on the upstream source
Hotfix Update
- General stability improvements
- Resolved issues with Backlinks, Keyword, SERP & Website Traffic searches not returning any data due to upstream changes
Improvement Update
- Added URL Rating (UR) and Ahrefs Rank to Domain Authority Search for paying users
- Updated documentation
- General stability improvements
Hotfix Update
- Updated input schema to provide better clarity on URL search modes (exact vs subdomains)
- Updated documentation
- General stability improvements
- Resolved validation issues stripping URL paths early when performing URL based searches
- Resolved issues with exact URL searches returning domain data instead of URL data for search types Website Traffic, Backlinks and Broken Links
- Resolved parsing issues for Backlinks search due to changes on the upstream source
Hotfix Update
- Re-enforcing usage limits for free users to prevent abuse
Maintenance Update
- Updated documentation
- General stability improvements
- Reduced free usage max URLs from 3 to 1 to prevent recent service abuse by fake accounts
Hotfix Update
- General stability improvements
- Improved log messages for queries that returned no results
- Resolved data validation issues for serp searches. It now correctly validates no data returned cases.
Hotfix Update
- General stability improvements
- Resolved backlink data validation issues. It now correctly validates and extracts the provided backlink data.
Hotfix Update
- General stability improvements
- Resolved domain validation issues, when multiple TLDS were provided like example.co.uk. It now correctly validates and extracts the provided domain.
Hotfix Update
- General stability improvements
- Resolved domain validation issues, newer TLDs are now fully supported.
Hotfix Update
- General stability improvements
- Resolved SERP Search not returning any data in some cases due data validation issues
Maintenance Update
Hotfix Update
- Resolved several edge case parsing issues for some data fields
- General stability improvements
Maintenance Update
- Revamped Documentation to provide better readability and clarity
- General stability improvements
Issue Resolving Update
- We changed the default enabled search types to only include the most popular ones only, like Web Authority, Traffic and Backlinks Searches, others can be re-enabled by the users
- We increased the number of runs for free users from 5 to 10 runs per month again
- We limited the number of urls a free user can input to 3 URLs and the number of parallel searches to 3 per run to keep our service stable, paying users remain unaffected
- Improved validation logging for keywords and URLs
- Improved error handling for missing or invalid inputs
- Improved documentation
- Resolved issue where website stats were not being fetched correctly for some URLs
- Resolved issue when no valid url is provided leading the scraper to crash
- When users enable search types that require a keyword but dont provide it, the scraper will now disable those search types instead of stopping the scraper or using "ai developer" as a default value
Issue Resolving Update
- When users enable search types that dont have the required fields, the scraper will now disable those search types instead of stopping the scraper or using "openai.com" as a default value
- Resolved edge case where the scraper would take longer than expected to complete
Maintenance Update
- Resolved issue on automated tests
- General stability improvements
Maintenance Update
- Improved error handling
- General stability improvements
Maintenance Update
- Improved general stability and performance of our service
- We added countermeasure to prevent free account abuse, limiting free usage from 10 to 5 runs per month and restricting some data for free users
Maintenance Update
- We added the new fields to the overview output table view
- Improved general stability and performance of our service
Issue Resolving Update
- Improved general stability and performance of our service
- Resolved issues with Competitor search and Top Trending Websites not returning any data due to major changes on Ahrefs
- Resolved issues with Traffic Search and Domain / Authority Search which were also impacted by changes on Ahrefs
- Resolved issues with SERP, Keyword Ranking and Keyword Difficulty Search not returning any data in some cases due to some parsing issues
Major Improvement Update
- Added new Top 1000 / 100 Website Rankings Search, allowing users to see the top websites based on various metrics like country and website category
- Added Trending Websites, enabling users to discover the most popular websites based on traffic (available in Top Website Rankings Search)
- Added new Competitor search, allowing users to find up to 10 competitors based on a domain or URL
- Enhanced Domain Authority / Overview search data with additional fields like
domainRatingLastMonth
isNsfw
- Enhanced Website Traffic search data with additional fields like
website_overall_search_traffic
website_overall_search_traffic_last_month
website_overall_search_traffic_history going back up to 10 years in traffic data
website_overall_search_traffic_value
website_overall_search_traffic_value_last_month
website_overall_search_traffic_value_history going back up to 10 years in traffic value data
website_overall_search_traffic_by_country
website_overall_search_traffic_keywords
- Enhanced Backlinks search data with additional fields like
referal_domains_overall
referal_domains_overall_last_month
referal_domains_history going back up to 10 years in referring domains data
- Improved general stability and performance of our service
- Fixed parsing issues on some edge cases where the scraper would skip some data
Issue Resolving Update
- Resolved issue causing the scraper to crash due to a empty domain input
Issue Resolving Update
- Resolved issue causing the scraper to crash due to a missing field
Improvement Update
- Added organic monthly website traffic by top countries
- General stability improvements
Issue Resolving Update
- Small changes to the README for better clarity
- General stability improvements
- Resolved issues where valid keywords were not being validated correctly
Improvement Update
- Added bulk search options for URLs and Domains
- Improved input view with improved descriptions and new bulk section
- Improved logging for better readability
Improvement Update
- Improved Documentation for usage limits based on subscription plans
Release Version
- Initial release of Ahrefs SEO Scraper on Apify
- Supports keyword, domain, and URL-based SEO scraping
- Includes modular options for traffic, keywords, rankings, backlinks, SERPs, and more
- Multi-country support across 180+ countries
- Flexible export formats: CSV, XLSX, JSON, XML, RSS
- Designed for SEO pros, marketers, and competitive analysts
- Users are encouraged to provide feedback for further improvements
- Future updates will focus on continuing to improve and enhance searching capabilities
For any issues or suggestions, please open up an issue on the platform
This changelog entry documents the initial release of the Ahrefs Scraper actor, detailing its core features, functionalities, and initial bug fixes