No credit card required

Broken Link Checker

jancurn/find-broken-links

No credit card required

Crawls a website and finds broken links. Unlike other similar SEO analysis tools, the actor also reports broken URL #fragments. The results are stored in a JSON and HTML report.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

False Positive Broken Links

Closed

MichaelB opened this issue

Hi!

I'm receiving numerous false positive broken links in Actor's Output. Some links point to old pages with redirects, but some links are still valid.

Redirect Link: http://pearsonvue.com/tx/insurance => https://home.pearsonvue.com/tx/insurance

Valid Link: https://home.pearsonvue.com/getattachment/eae6fc22-4cd8-4a19-b98d-5a3e40d691ae/Texas%20Insurance%20Supplement%20Examination%20Content%20Outlines.aspx

I'd like to know what could be causing this and if there's a setting I might be missing in my build.

Thanks in advance for your help!

MichaelB

Hi!

I'm following up to see if anyone saw my previous message about what appear to be false positive broken links in the Broken Links Checker output.

Thanks again for your time!

Hamza Alwan (hamza.alwan)

Hi Michael Basiaga,

We are currently looking into it and we will let you know once we solve the issue.

Thank you for your patience.

MichaelB

Sounds great! Thanks for the update!

Lukáš Křivka (lukaskrivka)

Hi Michael,

We significantly updated the actor to use proxies properly, wait for the full page loads and retry more often. Now it should give more stable results but there will always be some edge case URLs.

Thank you

MichaelB

That's great to hear! I'm excited to test it out!

Thank you again for your help!

Add comment

Developer

Jan Čurn

Actor Metrics

10 monthly users
14 stars
18% runs succeeded
Created in Oct 2018
Modified 6 months ago

Categories

SEO tools

Open source

Broken Link Checker - Ensure Your Website's Integrity

dainty_screw/find-broken-links-of-your-website

Maintain your website's health and user experience with our Broken Link Checker. Easily identify and fix broken links to enhance your site's navigation, improve SEO, and keep visitors engaged.

codemaster devops

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

5.8k

Traffic Generator (Youtube, Web, Etsy, Behance and many more!)

epctex/traffic-generator

Maximize your website's performance and visibility with our Traffic Generator. Drive targeted traffic, simulate page views, and stress-test against potential threats. With the power to generate millions of visits, it's the ultimate solution for boosting your online presence.

epctex

26.3k

195

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

72.7k

272

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

4.8k

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

51.2k

265

Download HTML from URLs

mtrunkat/url-list-download-html

This actor takes a list of URLs and downloads HTML of each page.

Marek Trunkát

8.2k

Google Trends Scraper

emastra/google-trends-scraper

Scrape data from Google Trends by search terms or URLs. Specify locations, define time ranges, select categories to get interest by subregion and over time, related queries and topics, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Emiliano Mastragostino

3.8k

Legacy PhantomJS Crawler

apify/legacy-phantomjs-crawler

Replacement for the legacy Apify Crawler product with a backward-compatible interface. The actor uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of front-end JavaScript code.

Apify

1.6k

Extended GPT Scraper

drobnikj/extended-gpt-scraper

Extract data from any website and feed it into GPT via the OpenAI API. Use ChatGPT to proofread content, analyze sentiment, summarize reviews, extract contact details, and much more.