Pricing

Pay per usage

Try for free

Go to Apify Store

AI Search & Agent Readiness Checker

Try for free

Scans websites the way AI search crawlers see them. Checks HTTPS, robots.txt for OAI-SearchBot/Claude-SearchBot/PerplexityBot, JSON-LD, llms.txt, content without JS, Shopify readiness, and more. Outputs a score, pass/fail checks, and fix hints.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Enoch SaasBusiness

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

What it checks

Check	Why it matters
HTTPS	AI tools and browsers need a valid secure site
AI search bots in robots.txt	Only OAI-SearchBot, Claude-SearchBot, and PerplexityBot control visibility in AI search. Blocking GPTBot / ClaudeBot only affects training data, not ChatGPT or Claude search
Readable without JavaScript	Most AI crawlers do not run JS
Business JSON-LD	Lets AI tools identify who you are
Title, meta, H1	How the site is summarized in AI answers
llms.txt, sitemap, canonical, Open Graph	Discovery and previews
Placeholder / template text	AI may quote leftover "Lorem ipsum" as fact
Shopify policies & product data	Needed for AI shopping when the store is on Shopify

Bot-wall pages are flagged as may be invisible (confirm by hand).

Input

{
  "urls": [
    "https://example.com",
    "https://wikipedia.org"
  ]
}

Or use Apify startUrls.

Example output (one dataset item)

{
  "url": "https://example.com",
  "host": "example.com",
  "score": 62,
  "invisible_to_ai_search": false,
  "blocked_search_bots": [],
  "blocked_training_bots": [],
  "checks": [
    {
      "id": "https",
      "label": "Site loads over HTTPS with a valid certificate",
      "pass": true,
      "weight": 15,
      "detail": "Final URL https://example.com/",
      "fix": ""
    },
    {
      "id": "schema_business",
      "label": "Business identity code (Organization/LocalBusiness JSON-LD)",
      "pass": false,
      "weight": 20,
      "detail": "JSON-LD types found: none",
      "fix": "Add the JSON-LD block from the Fix Pack to the homepage <head>."
    }
  ],
  "failed_checks": "schema_business, title, meta, h1, ...",
  "fix_hints": [
    { "id": "schema_business", "fix": "Add the JSON-LD block..." }
  ]
}

Use cases

Agencies auditing client sites for ChatGPT / Perplexity visibility
Shopify stores preparing for AI shopping
Bulk monitoring: feed a sitemap or lead list, get scores + fix hints
Free funnel hook: "Is your site ready for AI agents?"

Pricing

Pay per result — roughly $0.01–0.02 per URL (one dataset row = one URL). Compute is cheap (HTTP fetch + HTML parse, no browser).

Accuracy note

GPTBot / ClaudeBot / Google-Extended = training crawlers only.
A site is only reported as invisible to AI search when robots.txt blocks OAI-SearchBot, Claude-SearchBot, or PerplexityBot (or those bots fail live fetches in a deeper test).
Always phrase results as findings from this scan ("in this test").

Local run

npm install
npm run test-local -- https://example.com https://wikipedia.org https://github.com

Author

Built for the Fix Shop / AgentReady checker. Not affiliated with OpenAI, Anthropic, or Perplexity.

TikTok Profile Scraper

clockworks/tiktok-profile-scraper

Extract data from TikTok profiles and videos they post. Get TikTok profile data, URLs, numbers of shares, followers, comments, hearts, video and music metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

55K

4.7

(73)

Instagram Scraper

apify/instagram-scraper

Extract Instagram posts, reels, profiles, places, hashtags, carousels, and comments. Get data from Instagram using one or more Instagram URLs or search queries: content, context, metrics, metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

435K

4.7

(602)

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract posts, videos, and engagement metrics from Facebook pages. Get text captions, reactions, video transcripts, images, external links, collaborators, and more from Facebook pages and profiles. Export ad data, schedule runs via API, and integrate with other tools or AI workflows.

Apify

126K

4.7

(236)

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape or download Instagram reels. Just add Instagram profile or reel URL, and get caption, timestamp, transcript, hashtags, mentions, tagged users, comments, likes, shares, views, duration, and downloaded video. Export scraped data, schedule via API, and integrate with other tools or AI workflows.

Apify

167K

4.4

(103)

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

345K

4.7

(370)

Tweet Scraper V2 - X Scraper / Twitter Scraper / X.com Scraper

apidojo/tweet-scraper

Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

110K

3.9

(196)

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add Instagram usernames, IDs or URLs and extract name, join date, number of followers, location, bio, website, related profiles, video&post count, latest posts. Export scraped data, schedule scraper via API, and integrate with other tools or AI workflows.

Apify

254K

4.7

(175)

LinkedIn Profile Scraper + Email (No Cookies)

harvestapi/linkedin-profile-scraper

Extract detailed information from LinkedIn profiles in bulk, including complete work experience, education history, skills and more. No cookies or account required.

HarvestAPI

82K

4.6

(93)

YouTube Shorts Scraper

streamers/youtube-shorts-scraper

Extract YouTube Shorts data from one or multiple YouTube channels. Get video URL, caption, timestamp, likes, dislikes, views and comments count, basic channel info, and more. This alternative YouTube API has no limits or quotas. Download the data in JSON, CSV, and Excel.

Streamers

68K

4.4

(22)

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including caption, metrics, images, mentions, coauthors, recent comments, sponsored status, video duration, views. Export scraped data, schedule scraper via API, integrate with other tools or AI workflows.

Apify

143K

4.3

(138)