Pricing

$1.00 / 1,000 statuscodes

Go to Store

HTTP Status Codes and URL Checker

Try for free

Developed by

Antonio Blago

A HTTP Status Codes Crawler is a tool that scans a website and retrieves HTTP status codes for each page. This helps in diagnosing errors and optimizing technical SEO.

0.0 (0)

Pricing

$1.00 / 1,000 statuscodes

Total users

Monthly users

Runs succeeded

>99%

Last modified

2 months ago

SEO tools

Automation

Start URLs

start_urlsarrayRequired

List of URLs to start crawling from.

Follow Links

follow_linksbooleanOptional

Whether to follow links from the start URLs.

Default value of this property is false

Choose Sitemap modus

sitemap_modestringOptional

mode: 'sitemap' (only use sitemap), 'crawl' (only crawl), or 'auto' (default: try sitemap first)

Default value of this property is "auto"

Maximum Depth

max_depthintegerOptional

The maximum depth for crawling from the start URL.

Default value of this property is 1

Max URLs to Crawl

CLOSESPIDER_PAGECOUNTintegerOptional

The maximum number of pages to crawl before stopping.

Default value of this property is 5

Concurrent Requests per Domain

CONCURRENT_REQUESTS_PER_DOMAINintegerOptional

Number of simultaneous requests per domain.

Default value of this property is 1

User-Agent

USER_AGENTstringOptional

The user agent string for requests.

Default value of this property is "custom-user-agent apify"

Respect Robots.txt

ROBOTSTXT_OBEYbooleanOptional

Whether the crawler should obey the robots.txt rules.

Default value of this property is true

Download Delay

DOWNLOAD_DELAYintegerOptional

The time delay (in seconds) between requests.

Default value of this property is 1

Website Spell Checker with AI

oscardz/website-spell-checker

The Website Spell Checker with AI scans your site for spelling and grammar errors, providing detailed reports with corrections. Export results in various formats or integrate into your workflow for automated checks, ensuring your content is always polished.

Oscar Rodriguez

128

HTTP/SOCKS Proxy Scraper - Country & Protocol Filter

xtech/proxy-scraper

Scrape and filter HTTP, HTTPS, and SOCKS proxies from across the web. Filter by country and protocol. Provides detailed location data (country, code, city, coordinates) and timeout values. Perfect for web scraping, bypassing geo-blocking, and enhancing online anonymity. Proxy list updated hourly.

Xtech

3.3

Extract Website With URL

mrahil/extract-website-with-url

The Extract Website with URL API allows users to extract structured data from any webpage by providing a URL. It retrieves HTML, metadata, tables, and images, returning data in JSON format. Ideal for web scraping, SEO analysis, and content extraction. Use it for e-commerce data, news scraping

Mohammed Rahil

AI Website Spell Checker

louisdeconinck/ai-website-spell-checker

Discover and correct spelling errors across entire websites effortlessly with our AI-powered crawler. Start from any URL, and receive a comprehensive report detailing each error, suggested corrections, and severity levels. Enhance your site's professionalism and user experience today!

Louis Deconinck

5.0

Upcheck

apikit/upcheck

Monitor websites and APIs with this simple yet powerful availability checker. This Apify Actor checks the status of your specified endpoints, tracks their response times, and alerts you when they become unavailable

API-KIT

5.0

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

7.7k

4.7

Deep Website Content Crawler

6sigmag/deep-website-content-crawler

Scrape Failed Killer! A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

300

3.0

Pagespeed Insights Webpage Analyzer

baldasseva/pagespeed-insights-webpage-analyzer

Get Lighthouse Web Audits and Chrome User Experience Reports for a list of urls or for your whole website. Get a detailed report or aggregated results to monitor performance, accessibility, SEO and more. Schedule the analysis to keep track of the state of your website over time.

Eva Baldasseroni

119

Website Closers Scraper

louisdeconinck/website-closers-scraper

Unlock the potential of digital business acquisitions with our powerful scraper for WebsiteClosers.com. Effortlessly gather key metrics like asking price, cash flow, and more. Ideal for market research, lead generation, and building a comprehensive database of online businesses for sale.

Louis Deconinck

5.0

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

737

4.2