Http Status Codes and URL Checker avatar

Http Status Codes and URL Checker

Try for free

Pay $5.00 for 1,000 StatusCodes

Go to Store
Http Status Codes and URL Checker

Http Status Codes and URL Checker

antonio_espresso/website-status-code-crawler
Try for free

Pay $5.00 for 1,000 StatusCodes

A Http Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizing technical SEO.

Here’s a README.md for your Apify HTTPS Status Checker:


Apify HTTPS Status Checker 🚀

An Apify Actor that crawls websites and retrieves their HTTP status codes to help monitor site availability, detect broken links, and analyze redirects.


📌 Features

Crawls multiple URLs and checks their HTTP response status.
Detects broken links (404 errors) and highlights them.
Supports deep crawling with configurable max_depth.
Provides structured JSON output with status summaries.
Ideal for SEO audits, website monitoring, and performance analysis.


⚙️ Input Parameters

The actor accepts the following input in JSON format:

1{
2  "start_urls": [
3    { "url": "https://example.com" }
4  ],
5  "max_depth": 1
6}
ParameterTypeDescription
start_urlsArrayList of URLs to check (required)
max_depthIntegerHow deep the crawler should go (default: 1)

📤 Output Format

The actor returns structured JSON output with two key sections:

1️⃣ URL Details

Each scanned URL along with its status code.

1{
2  "details": [
3    { "url": "https://example.com", "status": 200 },
4    { "url": "https://example.com/missing-page", "status": 404 }
5  ]
6}

2️⃣ Status Code Summary

Aggregates occurrences of each HTTP status code.

1{
2  "overview": [
3    { "Status Code": 200, "Count": 10 },
4    { "Status Code": 404, "Count": 2 }
5  ]
6}

🚀 How to Run

Option 1: Using Apify Console

  1. Go to the Apify Actor Page.
  2. Click Run and provide the input JSON.
  3. Retrieve results from the Dataset Storage.

Option 2: API Execution (cURL)

Run the actor directly via API:

1cat > input.json <<'EOF'
2{
3  "start_urls": [
4    { "url": "https://example.com" }
5  ],
6  "max_depth": 1
7}
8EOF
9
10curl "https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs?token=$API_TOKEN" \
11  -X POST \
12  -d @input.json \
13  -H 'Content-Type: application/json'

🔍 Example Use Cases

💡 SEO Audits → Identify broken links and redirects.
💡 Website Monitoring → Track site uptime & status changes.
💡 Data Validation → Ensure external links are working.
💡 Content Management → Find outdated or broken content.


📚 Resources


🛠️ Author & Support

Created by Antonio Blago antonioblago.de🛠️
💬 Need help? Reach out via Apify Community


This README.md is structured for clarity, usability, and professional presentation. 🚀 Let me know if you'd like any modifications! 😊

Developer
Maintained by Community

Actor Metrics

  • 4 monthly users

  • 1 bookmark

  • >99% runs succeeded

  • Created in Feb 2025

  • Modified 14 days ago