Pricing

$20.00 / 1,000 url diagnoseds

Smart Web Scraper — Block Diagnosis & URL Debugger

Fetches URLs with intelligent fallback strategies and honest block detection. Diagnoses Cloudflare challenges, TLS mismatches, 429s, and JS requirements. Tries direct fetch, TLS downgrade, and archive.org, then reports what worked and why.

Pricing

$20.00 / 1,000 url diagnoseds

Rating

0.0

(0)

Developer

Mack

Actor stats

Bookmarked

Total users

Monthly active users

24 days ago

Last modified

Categories

Developer tools

Automation

SEO tools

You can access the Smart Web Scraper — Block Diagnosis & URL Debugger programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "urls": [
12        "https://example.com",
13        "https://reddit.com"
14    ]
15};
16
17// Run the Actor and wait for it to finish
18const run = await client.actor("wiggly_book/smart-scraper").call(input);
19
20// Fetch and print Actor results from the run's dataset (if any)
21console.log('Results from dataset');
22console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
23const { items } = await client.dataset(run.defaultDatasetId).listItems();
24items.forEach((item) => {
25    console.dir(item);
26});
27
28// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Smart Web Scraper - Block Diagnosis & URL Debugger API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Smart Web Scraper — Block Diagnosis & URL Debugger API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Smart Web Scraper — Block Diagnosis & URL Debugger API in Python

Smart Web Scraper — Block Diagnosis & URL Debugger API through CLI

Smart Web Scraper — Block Diagnosis & URL Debugger OpenAPI definition

Smart Web Scraper — Block Diagnosis & URL Debugger API

TLS Certificate Monitor

junipr/tls-certificate-monitor

Monitor TLS certificates, expiry, chain health, issuer changes, and HTTPS readiness.

junipr

SSL/TLS Certificate Scraper

taroyamada/ssl-certificate-monitor

Scan thousands of websites for expiring TLS certs, extract fingerprint hashes, and run Google Web Risk malware checks without rendering a browser.

naoki anzai

SSL Certificate Inspector - TLS Audit & Expiry Monitor

santamaria-automations/ssl-certificate-inspector

Inspect SSL/TLS certificates for any domain: chain validation, expiry dates, cipher suites, TLS versions, subject alt names, issuer details, and security scoring. Export data, run via API, schedule and monitor runs, or integrate with other tools.

NanoScrape

Instagram Hashtag Scraper

crawlerbros/instagram-hashtag-scraper

Extract posts from Instagram hashtags with complete metadata including engagement metrics, captions, media info, and author details. Features smart pagination, anti-block strategies, and multiple scraping approaches.

Crawler Bros

5.0

Bulk SSL Certificate Checker — Expiry, Issuer & TLS

logiover/bulk-ssl-certificate-checker

Check SSL/TLS certificates for thousands of domains at once — expiry date, issuer, SANs, days remaining, TLS versions supported and chain validation. No API key. Export to CSV or JSON. Ideal for security audits, certificate monitoring and compliance.

Logiover

SSL Certificate Checker API - TLS Expiry Scanner

pink_comic/ssl-certificate-checker

Bulk SSL/TLS certificate checker API for expiry monitoring, HTTPS audits, issuer/SAN extraction, chain validation, TLS version, and cipher-suite evidence. Scan domains for expiring, expired, or misconfigured certificates before outages or compliance reviews.

Ava Torres

SSL/TLS Certificate Expiry Monitor

gp005/tls-cert-monitor

Bulk-check TLS certificates for any HTTPS hosts: days-to-expiry, expiry alerts, and issuer/SAN/fingerprint change detection. Pure protocol, no scraping.

Geo

ICD-10 Codes Scraper | Medical Diagnosis Lookup

parseforge/icd10-codes-scraper

Extract ICD-10-CM diagnosis codes with code, short and long descriptions, chapter, block, and parent hierarchy. Filter by chapter or keyword. Built for medical billing software, healthcare apps, clinical research, and AI training datasets in the health sector.