HTTP Status Checker

This Apify Actor allows you to check the HTTP status codes and detect redirects for a list of URLs. It's a useful tool for SEO audits, website maintenance, and link checking.

Features

• Checks any number of URLs for their HTTP status codes
• Detects redirect responses (3xx status codes)
• Captures the redirect destination URL from the Location header
• Supports Apify Proxy to check URLs from different geolocations and avoid blocking
• Handles request failures gracefully with detailed error reporting
• Uses HttpCrawler for reliable HTTP status checking without content validation

Input

The Actor requires the following input:

• Start URLs: A list of URLs you want to check. You can enter them manually, upload a file, or point to a URL with a list of links.
• Maximum URLs to check: An optional number to limit how many URLs from the list will be processed. If empty, all URLs will be checked.
• Proxy configuration: Configure Apify Proxy or your own custom proxies to make requests from different IP addresses.

Example Input JSON:

{
  "startUrls": [
    { "url": "https://apify.com" },
    { "url": "https://apify.com/contact" },
    { "url": "http://example.com/non-existent-page" }
  ],
  "maxRequests": 100,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}

Output

The Actor stores its results in a dataset. Each item in the dataset corresponds to one of the initial URLs and contains the following fields:

• url: The original URL that was checked
• statusCode: The HTTP status code returned by the server
• isRedirect: A boolean indicating if the status code was in the 300-399 range
• redirectURL: The destination URL from the Location header (only present for redirects)
• error: A message indicating if the request failed (empty string if successful)

Example Output

[
  {
    "url": "http://apify.com",
    "statusCode": 301,
    "isRedirect": true,
    "redirectURL": "https://apify.com/",
    "error": ""
  },
  {
    "url": "https://apify.com/",
    "statusCode": 200,
    "isRedirect": false,
    "redirectURL": "",
    "error": ""
  },
  {
    "url": "https://apify.com/non-existent",
    "statusCode": 404,
    "isRedirect": false,
    "redirectURL": "",
    "error": ""
  },
  {
    "url": "https://invalid-domain.example",
    "statusCode": "",
    "isRedirect": false,
    "redirectURL": "",
    "error": "Request failed, see log for details."
  }
]

Usage

You can run this Actor from the Apify Console by providing the input in the UI, or you can call it programmatically using the Apify API.

For API usage, you will need your Apify API token. Refer to the Apify API documentation for more details.

Use Cases

• SEO Audits: Check for broken links and redirect chains on your website
• Website Migration: Verify that old URLs properly redirect to new ones
• Link Validation: Ensure external links in your content are working
• Monitoring: Regular checks of critical URLs to detect issues early

Additionals

• Will provide the following status codes: 200, 301, 302, 403, 403, 500 and more.