
HTTP Status Codes and URL Checker
Pricing
$1.00 / 1,000 statuscodes

HTTP Status Codes and URL Checker
A HTTP Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizing technical SEO.
0.0 (0)
Pricing
$1.00 / 1,000 statuscodes
2
Total users
14
Monthly users
5
Runs succeeded
>99%
Last modified
2 months ago
Follow Links
follow_links
booleanOptional
Whether to follow links from the start URLs.
Default value of this property is false
Choose Sitemap modus
sitemap_mode
stringOptional
mode: 'sitemap' (only use sitemap), 'crawl' (only crawl), or 'auto' (default: try sitemap first)
Default value of this property is "auto"
Maximum Depth
max_depth
integerOptional
The maximum depth for crawling from the start URL.
Default value of this property is 1
Max URLs to Crawl
CLOSESPIDER_PAGECOUNT
integerOptional
The maximum number of pages to crawl before stopping.
Default value of this property is 5
Concurrent Requests per Domain
CONCURRENT_REQUESTS_PER_DOMAIN
integerOptional
Number of simultaneous requests per domain.
Default value of this property is 1
User-Agent
USER_AGENT
stringOptional
The user agent string for requests.
Default value of this property is "custom-user-agent apify"