Pricing

$1.00 / 1,000 statuscodes

Go to Store

HTTP Status Codes and URL Checker

Try for free

Developed by

Antonio Blago

A HTTP Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizing technical SEO.

0.0 (0)

Pricing

$1.00 / 1,000 statuscodes

Total users

Monthly users

Runs succeeded

>99%

Last modified

2 months ago

SEO tools

Automation

Apify HTTPS Status Checker 🚀

An Apify Actor that crawls websites and retrieves their HTTP status codes to help monitor site availability, detect broken links, and analyze redirects.

📌 Features

✅ Extracts URLs from sitemaps if available.
✅ Crawls websites when no sitemap is found to collect URLs.
✅ Retrieves HTTP status codes for each discovered URL.
✅ Detects broken links (404 errors) and highlights them.
✅ Provides structured JSON output with status summaries.
✅ Ideal for SEO audits, website monitoring, and performance analysis.

⚙️ Input Parameters

The actor accepts the following input in JSON format:

{
  "url": "https://example.com",
  "max_urls": 10,
  "follow_links": true,
  "mode": "auto"
}

Parameter	Type	Description
`url`	String	The target URL or domain (required)
`max_urls`	Integer	Maximum number of pages to analyze (default: 5)
`follow_links`	Boolean	Whether to follow links in the crawl (default: false)
`mode`	String	"sitemap", "crawl", or "auto" (default: "auto")

📤 Output Format

The actor returns structured JSON output with two key sections:

1️⃣ URL Details

Each scanned URL along with its status code.

{
  "details": [
    { "url": "https://example.com", "status": 200 },
    { "url": "https://example.com/missing-page", "status": 404 }
  ]
}

2️⃣ Status Code Summary

Aggregates occurrences of each HTTP status code.

{
  "overview": [
    { "Status Code": 200, "Count": 10 },
    { "Status Code": 404, "Count": 2 }
  ]
}

🚀 How to Run

Option 1: Using Apify Console

Go to the Apify Actor Page.
Click Run and provide the input JSON.
Retrieve results from the Dataset Storage.

Option 2: API Execution (cURL)

Run the actor directly via API:

cat > input.json <<'EOF'
{
  "url": "https://example.com",
  "max_urls": 10,
  "follow_links": true,
  "mode": "auto"
}
EOF

curl "https://api.apify.com/v2/acts/YOUR_ACTOR_ID/runs?token=$API_TOKEN" \
  -X POST \
  -d @input.json \
  -H 'Content-Type: application/json'

🔍 Example Use Cases

💡 SEO Audits → Identify broken links and redirects.
💡 Website Monitoring → Track site uptime & status changes.
💡 Data Validation → Ensure external links are working.
💡 Content Management → Find outdated or broken content.

📚 Resources

🛠️ Author & Support

Created by Antonio Blago antonioblago.de🛠️
💬 Need help? Reach out via Apify Community

Website Spell Checker with AI

oscardz/website-spell-checker

The Website Spell Checker with AI scans your site for spelling and grammar errors, providing detailed reports with corrections. Export results in various formats or integrate into your workflow for automated checks, ensuring your content is always polished.

Oscar Rodriguez

131

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

7.8k

4.7

HTTP/SOCKS Proxy Scraper - Country & Protocol Filter

xtech/proxy-scraper

Scrape and filter HTTP, HTTPS, and SOCKS proxies from across the web. Filter by country and protocol. Provides detailed location data (country, code, city, coordinates) and timeout values. Perfect for web scraping, bypassing geo-blocking, and enhancing online anonymity. Proxy list updated hourly.

Xtech

3.3

HTML Scraper pro

scrapingxpert/html-scraper-pro

The HTML Scraper Pro is a powerful tool designed to extract the HTML source code and metadata from websites. It uses advanced web scraping techniques to retrieve the full HTML content of web pages,page title and HTTP status code.This tool is ideal for data extraction, website analysis, and archiving

scrapingxpert

Pagespeed Insights Webpage Analyzer

baldasseva/pagespeed-insights-webpage-analyzer

Get Lighthouse Web Audits and Chrome User Experience Reports for a list of urls or for your whole website. Get a detailed report or aggregated results to monitor performance, accessibility, SEO and more. Schedule the analysis to keep track of the state of your website over time.

Eva Baldasseroni

121

Lighthouse Audit

microworlds/lighthouse-audit

Automatically test the speed of your web pages and get daily or weekly detailed performance reports using Google's Lighthouse for Chrome. Ensure your website remains fast even as you add new features and pages. Export the result in ZIP and MHTML files

Caleb David

AI Vision Scraper

zscrape/ai-vision-scraper

AI Vision Scraper automates web tasks, navigating sites, solving CAPTCHAs, and extracting data on demand using a single prompt. From competitor tracking to form submissions, it streamlines workflows and automation across industries like e-commerce, sales, and recruiting.

ZScrape Solutions

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

791

4.4

Deep Website Content Crawler

6sigmag/deep-website-content-crawler

Scrape Failed Killer! A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

317

4.1

YouTube Video Data Scraper 🎥

easyapi/youtube-video-data-scraper

A powerful YouTube video data extractor that fetches comprehensive metadata. Perfect for content analysis, research, and marketing insights. Supports batch processing with built-in rate limiting and error handling.