Pricing

from $0.35 / crawler traffic log report generated

Crawler Traffic Log Report

Summarizes crawler-claim traffic, current robots-policy mismatch signals, status codes, and redacted HTTP error patterns from submitted access logs.

Pricing

from $0.35 / crawler traffic log report generated

Rating

0.0

(0)

Developer

Checksmith Cats

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Categories

Developer tools

Automation

You can access the Crawler Traffic Log Report programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "logText": `203.0.113.10 - - [07/Jul/2026:10:00:00 +0000] "GET /docs HTTP/1.1" 200 123 "-" "GPTBot/1.0"
12198.51.100.2 - - [07/Jul/2026:10:00:02 +0000] "GET /missing HTTP/1.1" 404 12 "-" "Mozilla/5.0"`
13};
14
15// Run the Actor and wait for it to finish
16const run = await client.actor("checksmithcats/crawler-traffic-log-report").call(input);
17
18// Fetch and print Actor results from the run's dataset (if any)
19console.log('Results from dataset');
20console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
21const { items } = await client.dataset(run.defaultDatasetId).listItems();
22items.forEach((item) => {
23    console.dir(item);
24});
25
26// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Analyze Crawler Traffic Logs | Checksmith Cats API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Crawler Traffic Log Report API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Crawler Traffic Log Report API in Python

Crawler Traffic Log Report API through CLI

Crawler Traffic Log Report OpenAPI definition

Crawler Traffic Log Report API

YouTube Search Scraper

scraper-engine/youtube-search-scraper

YouTube Search Scraper API extracts data from any YouTube channel, including video lists, titles, views, likes, upload dates, and metadata. Great for research, competitor analysis, or content tracking. Export structured results in JSON, CSV, or Excel for seamless analysis and reporting.

Scraper Engine

5.0

(1)

Kwai Trending Videos Scraper

automation-lab/kwai-trending-videos-scraper

Export public Kwai For You videos, creators, captions, hashtags, engagement counts, posters, and available MP4 URLs without logging in.

Stas Persiianenko

Workopolis Jobs Details Scraper

soft_alexist/workopolis-jobs-details-scraper

Scrape detailed job listings from Workopolis.com, Canada's leading employment platform. Extract titles, locations, compensation, employer ratings, benefits, and 40+ fields per job — perfect for market research, HR analytics, and job aggregation platforms.

Soft Alexist

Google Ads Transparency Scraper

brilliant_gum/google-ads-transparency-scraper

Track any advertiser's Google ads: real headline, description, CTA and the landing page they send traffic to, impressions by country, and how long each ad has run. Search by brand name — no login. Flags what's new since your last run.

Yuliia Kulakova

Bol.com Buy Box Scraper

dariomory/bol-com-buy-box-scraper

Unofficial Bol.com scraper for Buy Box prices, sellers, availability, ratings, delivery estimates, and product details by EAN.

Dario Mory

Waze API — Real-Time Traffic, Alerts & Road Incidents

sian.agency/waze-traffic-scraper

Pull real-time Waze traffic data via API: accidents, hazards, police reports, road closures and live jams in any map area, plus driving directions with on-route alerts and venue search. Clean geo-coded JSON rows for logistics, routing, fleet and mobility analytics. No Waze account needed.

SIÁN OÜ

Moz [$9💰] Domain Authority, Spam Score & Keywords

memo23/moz-scraper

Get Moz Domain Authority at scale — no Moz Pro subscription. DA, PA, spam score, linking root domains, ranking keywords, top linking domains, top pages & 60-day link history. One report per domain, empty lookups never charged. Export JSON, CSV, or Excel.

Muhamed Didovic

🚀 Web Traffic Generator

scraper-engine/web-traffic-generator

Web Traffic Generator Generate realistic web traffic with customizable visits, locations, devices, browsers, referrers, and timing. Simulate user activity for website testing, analytics validation, load testing, and marketing campaign analysis. Export detailed traffic logs.

Scraper Engine

AI Crawler Log Analyzer — GPTBot, Claude & Perplexity

plenteous_humidifier/ai-crawler-log-analyzer

Analyze Nginx, Apache, Cloudflare, and JSON server logs for AI search, user-fetch, and training crawlers. Get bot traffic, errors, bandwidth, top pages, and actionable recommendations without exposing raw lines in dataset output.