# Changelog of Similarweb Scraper (`radeance/similarweb-scraper`) Actor

- **URL**: https://apify.com/radeance/similarweb-scraper/changelog.md
- **Full Actor documentation**: https://apify.com/radeance/similarweb-scraper.md

## Changelog

### \[0.0.67] - 2026-09-14

**Improvement Update**

#### Changed

- Updated documentation
- Overhauled changelog format to follow the Keep a Changelog standard for better readability and organization
- Improved performance and stability of the scraper

### \[0.0.66] - 2026-09-11

**Improvement Update**

#### Changed

- Updated documentation
- Improved performance and stability of the scraper

### \[0.0.65] - 2026-07-31

**Improvement Update**

#### Changed

- Increased the maximum concurrency limit depending on the memory limit to accommodate larger and more complex scraping tasks, ensuring better performance and stability for users with high-demand requirements. Default concurrency limit remains at 3 for up to 1GB memory limit, 6 for 2GB memory limit, 9 for 4GB and 12 for 8GB memory limit.

### \[0.0.64] - 2026-07-30

**Improvement Update**

#### Changed

- Increased the maximum memory limit to 16GB to accommodate larger and more complex scraping tasks, ensuring better performance and stability for users with high-demand requirements. Default memory limit remains at 256MB.

### \[0.0.63] - 2026-06-03

**Hotfix Update**

#### Changed

- Improved documentation sections on pricing and usage limits to clarify the changes in charging for add-on options and Similar Sites search, as well as the usage limits for free and paid users. This includes clear explanations of how the charges are applied based on the presence of data in the output and the specific limits for in-depth data and Similar Sites search for both free and paid users.

#### Fixed

- Resolved charging issues for Similar Sites search, which were not being charged correctly due to a mismatch in the field name used to check for the presence of Similar Sites data in the output. This has now been fixed, and all runs with Similar Sites enabled will be charged correctly based on the presence of the data in the output. For more information refer to our documentation at https://apify.com/radeance/similarweb-scraper#pricing-and-usage-limits

### \[0.0.62] - 2026-06-02

**Improvement Update**

#### Fixed

- Fixed documentation by readding missing indepth data output

### \[0.0.60] - 2026-05-29

**Improvement Update**

#### Added

- Added additional traffic sources data to the output, including `genAiTraffic`, `socialOrganicTraffic`, `socialPaidTraffic`, `searchOrganicTraffic`, `searchPaidTraffic`, `affiliateTraffic`, `displayAdsTraffic`
- Added `related_apps` field to Similar Sites data, which includes a list of related apps (Android & iOS) with their respective details such as app name, platform, appstore link, icon url
- Added new `marketing_channel_distribution` field to indepth search, which includes a list of top 3 marketing channels with their respective shares / sort order for a more detailed view of the website's marketing channel distribution.

#### Changed

- General stability improvements and optimizations

### \[0.0.58] - 2026-04-20

**Hotfix Update**

#### Fixed

- Resolved the issue of charging for add-on data options has been resolved. Previously, runs were not charged correctly on the aggregated output, but were charged correctly on the individual outputs. This has now been fixed, so all runs with add-on options enabled will be charged correctly, regardless of output mode.

### \[0.0.57] - 2026-04-20

**Improvement Update**

#### Added

- Added all-new in-depth search option as opt-in addon for users who need more detailed data, which includes 30+ new fields such as demographics, traffic sources, inbound and outbound, historical ranks and company data. It is available for high-traffic websites. This search can be enabled via `include_indepth_data` and is charged as an addon for every URL processed with this option enabled on top of the regular successfull result charge due to the high rate limiting and resource usage of this search.
- Added new output mode option `output_mode` to allow users to select between individual outputs for each URL or a single combined output for all URLs, which can be set to either `individual` or `aggregated`, with `aggregated` being the default. This allows users to better manage their data and choose the output format that best suits their needs.

#### Changed

- Overhauled input view with new options for better user experience and to accomodate the new in-depth data addon, users can now easily select which data they want to include in the output via simple checkboxes and select the output format they prefer.
- Overhauled output view with a new table views for in-depth and similar sites data
- Overhauled log messages for better readability and user experience
- Updated documentation to reflect all the new changes and improvements
- General stability improvements and optimizations

### \[0.0.55] - 2026-03-12

**Hotfix Update**

#### Changed

- General stability improvements and optimizations

#### Fixed

- Resolved issues with run crashes when Similar Sites is disabled

### \[0.0.53] - 2026-03-06

**Improvement Update**

#### Added

- Added Similar Sites data from Similarweb / Similarsites.com as an optional output, which includes a list of similar websites with their respective details such as URL, title, description, category rank, global rank, top country rank, total visits and thumbnail

#### Changed

- Improved output views for better readability and user experience including new table view
- We now use limited permissions on our Actor for improved security
- Updated documentation
- Increased memory limit to 4GB
- General stability improvements and optimizations

### \[0.0.52] - 2026-01-15

**Maintenance Update**

#### Added

- We changed pricing for our Similarweb Scraper to Pay-per-Event, Rental periods will be ending automatically after the rental period
- Improved documentation

#### Fixed

- General stability improvements

### \[0.0.50] - 2025-11-25

**Stability Update**

#### Added

- Preprocessing performance improvements

#### Fixed

- General stability improvements

### \[0.0.48] - 2025-11-20

**Hotfix Update**

#### Added

- Added timeout projection & better logging around timeout estimations.
- Added kill switch on timeout projections to avoid incomplete runs and encourage users to increase timeout settings.
- Strenghtened proxy infrastructure to mitigate rate limiting issues.

#### Fixed

- Mitigated occasional stability issues due to upstream api changes resulting in queries failing or taking a long time to respond.

### \[0.0.47] - 2025-11-12

**Maintenance Update**

#### Fixed

- Mitigated occasional stability issues, resulting in queries failing with no response.

### \[0.0.46] - 2025-10-31

**Maintenance Update**

#### Fixed

- Resolved minor stability issues, improving overall performance.

### \[0.0.45] - 2025-10-30

**Hotfix Update**

#### Fixed

- Mitigated issues with our backend, which caused runs to hang indefinitely in some cases.

### \[0.0.44] - 2025-10-25

**Hotfix Update**

#### Added

- Preprocessing performance improvements
- Improved documentation

#### Fixed

- General stability improvements

### \[0.0.43] - 2025-10-21

**Maintenance Update**

#### Added

- Improved documentation

#### Fixed

- General stability improvements

### \[0.0.42] - 2025-10-21

**Hotfix Update**

#### Added

- Improved documentation
- Reduced usage for free users from 15 to 10 run(s) per day

#### Fixed

- Mitigated occasional rate limiting issues due to high usage by optimizing session handling
- Significant improvements to stability when handling queries one after another
- General stability improvements

### \[0.0.41] - 2025-10-13

**Hotfix Update**

#### Added

- Improved documentation

#### Fixed

- Addressed data checks false positives causing runs to seem successful
- General stability improvements

### \[0.0.40] - 2025-09-30

**Hotfix Update**

#### Fixed

- Fixed runs crashing on runs with in-depth data enabled
- General stability improvements

### \[0.0.39] - 2025-09-24

**Improvement Update**

#### Added

- Added 3 run trial for in-depth data option for free users
- Added usage limits to in-depth data option for free users (3 URLs per run, 3 runs per day) and paid users (3 URLs per run, unlimited runs) for fair usage due to high rate limiting
- Improved Documentation on usage limits and in-depth data option

#### Fixed

- General stability improvements

### \[0.0.38] - 2025-09-23

**Improvement Update**

#### Added

- `include_indepth_data` is now opt-in (default: false) to reduce processing time for users who do not need this data
- Improved Documentation

#### Fixed

- Mitigated occasional service interruptions by improving request handling
- General stability improvements

### \[0.0.36] - 2025-09-22

**Major Improvement Update**

#### Added

- Added in-depth data with 40+ new fields including demographics, traffic sources, inbound and outbound, historical ranks and company data which can be enabled via `include_indepth_data`, it is available for high-traffic websites.
- Added `data_captured_at` field to indicate when the data was captured
- Improved Output Table View for better readability
- Improved Documentation

#### Fixed

- General stability improvements

### \[0.0.35] - 2025-08-30

**Maintenance Update**

#### Added

- Improved Documentation

#### Fixed

- Mitigated occasional 403's / 500's by improving request handling
- General stability improvements

### \[0.0.34] - 2025-08-30

**Maintenance Update**

#### Added

- Improved Documentation

#### Fixed

- General stability improvements

### \[0.0.31] - 2025-08-17

**Maintenance Update**

#### Added

- Improved logs and general error handling

#### Fixed

- General stability improvements

### \[0.0.30] - 2025-07-25

**Improvement Update**

#### Added

- Added Monthly Traffic metrics by Top Countries
- Improved general stability & availability of the service

#### Fixed

- Improved error handling

### \[0.0.29] - 2025-06-16

**Improvement Update**

#### Added

- Improved Log message readability
- Improved general stability & availability of the service

### \[0.0.25] - 2025-06-18

**Hotfix**

#### Added

- Improved general stability & availability of the service

#### Fixed

- Fixed data validation issues crashing user runs

### \[0.0.24] - 2025-04-25

**Improvement Update**

#### Added

- Actor is now strict about proxy-only use
- Improved logging messages

### \[0.0.23] - 2025-04-04

**Major Improvement Update**

#### Added

- Reduced usage of memory ressources / platform usage

#### Changed

- Users are encouraged to provide feedback for further improvements.
- Future updates will focus on continuing to improve and enhance searching capabilities.

### \[0.0.22] - 2025-04-04

**Major Improvement Update**

#### Added

- Added additional fields: monthlyVisitsDateFormat, engagement (bounceRate, pagesPerVisit, timeOnSite), snapshotDate and more

#### Changed

- Users are encouraged to provide feedback for further improvements.
- Future updates will focus on continuing to improve and enhance searching capabilities.

### \[0.0.18] - 2024-10-05

**Issue Resolving Update**

#### Changed

- Users are encouraged to provide feedback for further improvements.
- Future updates will focus on continuing to improve and enhance searching capabilities.

#### Fixed

- Fixed scraper getting blocked without proxy config by making use of apify proxies the default option.

### \[0.0.15] - 2024-09-19

**Issue Resolving Update**

#### Changed

- Users are encouraged to provide feedback for further improvements.
- Future updates will focus on continuing to improve and enhance searching capabilities.

#### Fixed

- Fixed scraper failing due to insufficient data

### \[0.0] - 2024-06-25

**Initial Release**

#### Added

- ##### 🗃️ Web Traffic, SEO Data and Meta Data Extraction
  ```
                                                                                        **Extracts key details such as**
                                                                                        • URL,
                                                                                        • Domain,
                                                                                        • Global Rank,
                                                                                        • Country,
                                                                                        • Country Rank,
                                                                                        • Category,
                                                                                        • Category Rank,
                                                                                        • Title,
                                                                                        • Description,
                                                                                        • Total Visits,
                                                                                        • Monthly Visits,
                                                                                        • Month,
                                                                                        • Visits,
                                                                                        • Social Traffic,
                                                                                        • Paid Referrals Traffic,
                                                                                        • Referral Traffic,
                                                                                        • Search Traffic,
                                                                                        • Direct Traffic,
                                                                                        • Mail Traffic,
                                                                                        • Country Share,
                                                                                        • Country,
                                                                                        • Shares
                                                                                        • and many more…
                                                                                    <br>
  ```
- **⬆ Data Output:**
  - Outputs dataset as JSON, JSONL, Excel spreadsheet, HTML table, CSV, or XML for easy integration and analysis.
  - Provides a clean and structured data output for further processing or direct use. <br>
- **🛠️ Error Handling and Logging:**
  - Comprehensive error handling to manage site-specific issues and changes.
  - Detailed logging to assist in debugging and tracking scraping activities.
- Initial release with all core features and functionalities fully tested.

#### Changed

- Users are encouraged to provide feedback for further improvements.
- Future updates will focus on continuing to improve and enhance searching capabilities.

#### Fixed

- Resolved initial bugs
