No credit card required

Website Checker

lukaskrivka/website-checker

Try for free

No credit card required

Check any website you plan to scrape for expected Compute unit consumption, anti-scraping software, and reliability.

API clients

API endpoints

The code examples below show how to run the Actor and get its results. To run the code, you need to have an Apify account. Replace <YOUR_API_TOKEN> in the code with your API token, which you can find under Settings > Integrations in Apify Console. Learn more

Node.js

Python

curl

1# Set API token
2API_TOKEN=<YOUR_API_TOKEN>
3
4# Prepare Actor input
5cat > input.json <<'EOF'
6{
7  "urlsToCheck": [
8    {
9      "url": "https://www.amazon.com/b?ie=UTF8&node=11392907011"
10    }
11  ],
12  "proxyConfiguration": {
13    "useApifyProxy": true,
14    "apifyProxyGroups": [
15      "SHADER",
16      "BUYPROXIES94952",
17      "RESIDENTIAL"
18    ]
19  },
20  "repeatChecksOnProvidedUrls": 10,
21  "maxNumberOfPagesCheckedPerDomain": 1000
22}
23EOF
24
25# Run the Actor using an HTTP API
26# See the full API reference at https://docs.apify.com/api/v2
27curl "https://api.apify.com/v2/acts/lukaskrivka~website-checker/runs?token=$API_TOKEN" \
28  -X POST \
29  -d @input.json \
30  -H 'Content-Type: application/json'

Developer

Lukáš Křivka

Actor metrics

5 monthly users
24 stars
100.0% runs succeeded
Created in Jan 2020
Modified about 1 month ago

Categories

Automation

Website Checker Workload

lukaskrivka/website-checker-workload

Creates reasonable workloads for analyzing any website with the Website Checker actor and combines the resulting data. This is the easiest way to analyze any website for compute unit usage and anti-scraping blocking.

Lukáš Křivka

Website Checker Runner Cheerio

lukaskrivka/website-checker-cheerio

Checks the provided website using cheerio. This is a low level runner, most likely you want to use the high level master actor - https://apify.com/lukaskrivka/website-checker

Lukáš Křivka

198

Website Checker Runner Puppeteer

lukaskrivka/website-checker-puppeteer

Checks the provided website using Puppeteer. This is a low level runner, most likely you want to use the high level master actor - https://apify.com/lukaskrivka/website-checker

Lukáš Křivka

154

Website Checker Runner Playwright

lukaskrivka/website-checker-playwright

Checks the provided website using Playwright. This is a low level runner, most likely you want to use the high level master actor - https://apify.com/lukaskrivka/website-checker

Lukáš Křivka

113

Website-checker-starter

vaclavrut/website-checker-starter

Works with lukaskrivka/website-checker. The idea is that this actor manages more URLs on the input, will start website-checker with 10 runs at a time and store all data to one datasets.

Vaclav Rut

Broken Link Checker - Ensure Your Website's Integrity

dainty_screw/find-broken-links-of-your-website

Maintain your website's health and user experience with our Broken Link Checker. Easily identify and fix broken links to enhance your site's navigation, improve SEO, and keep visitors engaged.

codemaster devops

Content Checker

jakubbalada/content-checker

Monitor a website or web page for content changes. Automatically saves before and after screenshots and sends an email notification when content changes are detected.

Jakub Balada

2.1k

Broken Link Checker

jancurn/find-broken-links

Crawls a website and finds broken links. Unlike other similar SEO analysis tools, the actor also reports broken URL #fragments. The results are stored in a JSON and HTML report.

Jan Čurn

573

Proxy Scraper

mstephen190/proxy-scraper

Free proxy scraper and checker. Search dozens of free proxy websites. Get list of 100% working public proxies in seconds. Automatically test proxies based on target URL and maximum timeout.