Pricing

from $18.00 / 1,000 dataset items

Go to Apify Store

AI Agent Traffic Detector

Try for free

Detect AI crawler and bot traffic from access-log lines or public bot policy pages.

Pricing

from $18.00 / 1,000 dataset items

Rating

0.0

(0)

Developer

Techionik

Actor stats

Bookmarked

Total users

Monthly active users

11 days ago

Last modified

Categories

Developer tools

Start URLs

startUrls

Optional

Paste access-log or user-agent lines, or add public crawler policy pages.

Type:object[]

Log lines

logLines

Optional

Paste access-log or user-agent lines, or add public crawler policy pages.

Type:string[]

Default:

[
  "2026-07-10 10:24:18 GET /pricing 200 \"Mozilla/5.0 AppleWebKit GPTBot/1.2\"",
  "2026-07-10 10:26:11 GET /docs 200 \"ClaudeBot/1.0\"",
  "2026-07-10 10:29:04 GET /blog 200 \"PerplexityBot/1.0\""
]

Pages per URL

maxPagesPerStartUrl

Optional

How many same-domain pages to inspect from each start URL.

Type:integer

Minimum:1

Maximum:3

Default:1

Max results

maxResults

Optional

Maximum clean rows to save. Capped at 20 to keep outputs focused.

Type:integer

Minimum:1

Maximum:20

Default:20

Proxy configuration

proxyConfiguration

Optional

Optional Apify proxy settings. Most public pages work without proxy.

Type:object

Default:

{
  "useApifyProxy": false
}

Web Traffic Boots

hung.ad4gate/web-traffic-boots

Generate realistic web traffic for Google Analytics (GA) with sophisticated bot detection avoidance and human-like behavior simulation capabilities. traffic generator auto traffic generate website free traffic web traffic bot unlimited website traffic software organic traffic generator tool

Hung Dinh

853

5.0

AI Crawler Policy Auditor

junipr/ai-crawler-policy-auditor

Audit robots and AI crawler policy signals for AI crawler access, blocking, and site-readiness.

junipr

Similarweb Scraper

crawlerbros/similarweb-scraper

Get website traffic analytics, rankings, traffic sources, top keywords, and AI traffic data from SimilarWeb. Analyze any domain - no API key or authentication needed.

Crawler Bros

SimilarWeb Fast Scraper — Website Traffic, Rankings & Analytics

pro100chok/similarweb-scraper

Extract SimilarWeb data for any domain in seconds. Get traffic stats, global rankings, top keywords, traffic sources, AI traffic insights, and similar sites — all in one fast parallel run.

Raven

981

5.0

Instagram Bot Detector

louisdeconinck/instagram-bot-detector

Instantly analyze Instagram profiles to detect fake followers, bot accounts, and artificial influencers. Get a precision 0-1 Bot Score based on engagement, ratios, and behavioral signals.

Louis Deconinck

1.4K

5.0

Similarweb Scraper — Website Traffic & Competitors

trakk/similarweb-scraper

Get traffic & competitor intelligence for any website — global/country ranks, monthly visits, engagement, MoM growth, traffic sources, top keywords, top countries, AI-referral traffic, similar sites, screenshots & WHOIS. No login needed. Export to JSON, CSV or Excel.

DataForge

Similarweb Scraper - Traffic, AI Traffic & WHOIS

vortex_data/similarweb-scraper

🔍 Spy on any website in seconds: traffic, rankings, top keywords, AI traffic share (ChatGPT/Claude/Gemini), competitors, similar sites & WHOIS — all from Similarweb. No login or API key. Bulk parallel scrape, captcha-resilient. Export to JSON/CSV/Excel. SEO, lead gen, research.

VortexData

224

5.0

Similarweb Traffic Analytics Scraper

thescrappa/similarweb-traffic-analytics-scraper

Analyze website traffic, rankings, engagement metrics, traffic sources, top countries, monthly visits, and top keywords for one or more domains.

Scrappa

Website Traffic Machine

bhansalisoft/website-traffic-machine

Website Traffic Machine is unique usefull tool that is useful increase Website traffic directly using proxy ips and also search engine based traffic using keyword