Pricing

Pay per usage

Go to Store

Broken Link Checker

Try for free

jancurn/find-broken-links

Developed by

Jan Čurn

Crawls a website and finds broken links. Unlike other similar SEO analysis tools, the actor also reports broken URL #fragments. The results are stored in a JSON and HTML report.

0.0 (0)

Pricing

Pay per usage

Monthly users

Runs succeeded

17%

Last modified

2 months ago

SEO tools Open source

Back to issues Create new issue

False Positive Broken Links

Closed

MichaelB opened this issue

Hi!

I'm receiving numerous false positive broken links in Actor's Output. Some links point to old pages with redirects, but some links are still valid.

Redirect Link: http://pearsonvue.com/tx/insurance => https://home.pearsonvue.com/tx/insurance

Valid Link: https://home.pearsonvue.com/getattachment/eae6fc22-4cd8-4a19-b98d-5a3e40d691ae/Texas%20Insurance%20Supplement%20Examination%20Content%20Outlines.aspx

I'd like to know what could be causing this and if there's a setting I might be missing in my build.

Thanks in advance for your help!

MichaelB

Hi!

I'm following up to see if anyone saw my previous message about what appear to be false positive broken links in the Broken Links Checker output.

Thanks again for your time!

Hamza Alwan (hamza.alwan)

Hi Michael Basiaga,

We are currently looking into it and we will let you know once we solve the issue.

Thank you for your patience.

MichaelB

Sounds great! Thanks for the update!

Lukáš Křivka (lukaskrivka)

Hi Michael,

We significantly updated the actor to use proxies properly, wait for the full page loads and retry more often. Now it should give more stable results but there will always be some edge case URLs.

Thank you

MichaelB

That's great to hear! I'm excited to test it out!

Thank you again for your help!

Add comment

Pricing

Pricing model

Pay per usage

This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage.

Broken Link Checker - Ensure Your Website's Integrity

dainty_screw/find-broken-links-of-your-website

Maintain your website's health and user experience with our Broken Link Checker. Easily identify and fix broken links to enhance your site's navigation, improve SEO, and keep visitors engaged.

codemaster devops

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

6.9k

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

79.3k

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.9k

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

56.2k

Similarweb Scraper

tri_angle/similarweb-scraper

A simple but powerful scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. Get data such as total visits, traffic sources, competitors, top countries, company info, etc..

Tri⟁angle

2.8k

Google Trends Scraper

emastra/google-trends-scraper

Scrape data from Google Trends by search terms or URLs. Specify locations, define time ranges, select categories to get interest by subregion and over time, related queries and topics, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Emiliano Mastragostino

4.2k

Linkedin Employees Scraper

caprolok/linkedin-employees-scraper

Effortlessly gather LinkedIn URLs and names of employees in bulk. Ideal for HR and recruitment, this tool quickly provides essential contact information, simplifying talent search and networking opportunities.

Caprolok

1.1k

Playwright Scraper

apify/playwright-scraper

Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.

Apify

1.2k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.