Pricing

Pay per event

Try for free

Go to Apify Store

SEO + AI Search Readiness Site Audit

Try for free

Crawl any website and get a score and issue list for every page, broken links, duplicate titles, and an AI-search check (llms.txt, AI crawler access in robots.txt, structured data), all ranked into one prioritized fix list.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Kapil sarma

Actor stats

Bookmarked

Total users

Monthly active users

2 hours ago

Last modified

What it checks

On every page (each gets a score out of 100):

HTTP errors and noindex
Title and meta description: missing, too short or too long
h1 headings: missing or more than one
Canonical link, lang attribute, viewport tag (mobile)
Open Graph tags for link previews
schema.org structured data (JSON-LD), including broken JSON
Images without alt text
Thin content (word count)
Server response time and HTML size

Across the site:

Broken internal links, with the pages that link to them
Duplicate titles and descriptions
HTTPS
Sitemap found, and how many URLs it lists
AI search readiness: whether llms.txt exists, whether robots.txt blocks each AI crawler (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, CCBot, Applebot-Extended, Bytespider, meta-externalagent), and how many pages have structured data

A prioritized fix list: every problem found, ranked high, medium or low, with how many pages it affects and how to fix it.

Input

Field	Example
Websites to audit	`https://example.com`
Max pages per site	`100`
Start from the sitemap	on
Respect robots.txt	on

Output

A page row:

{
  "type": "page",
  "url": "https://example.com/pricing",
  "status": 200,
  "score": 77,
  "title": "Pricing",
  "titleLength": 7,
  "descriptionLength": 0,
  "h1Count": 1,
  "wordCount": 412,
  "schemaTypes": [],
  "issues": [
    { "severity": "medium", "code": "title_too_short", "message": "Title is 7 characters; aim for 30 to 60." },
    { "severity": "medium", "code": "missing_description", "message": "Missing meta description." }
  ]
}

The site summary ("type": "summary") has averageScore, fixes, aiReadiness, brokenLinks, duplicateTitles, duplicateDescriptions and worstPages. Use the "Pages" and "Site summary" views in the Output tab.

Pricing

You pay per page audited, plus a small fee per site summary.

Good to know

This reads the HTML the server sends. Content that only appears after JavaScript runs is not seen, which is also how many AI crawlers see your site.
Response time is measured from the crawler, not from a browser, so treat it as a server check rather than a full page-speed test.
Only pages on the same domain are crawled. Links to other sites are counted but not checked.

Instagram Scraper

apify/instagram-scraper

Extract Instagram posts, reels, profiles, places, hashtags, carousels, and comments. Get data from Instagram using one or more Instagram URLs or search queries: content, context, metrics, metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

435K

4.7

(602)

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

341K

4.7

(370)

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add Instagram usernames, IDs or URLs and extract name, join date, number of followers, location, bio, website, related profiles, video&post count, latest posts. Export scraped data, schedule scraper via API, and integrate with other tools or AI workflows.

Apify

253K

4.7

(175)

Google Maps Scraper

compass/crawler-google-places

Extract data from thousands of Google Maps locations and businesses, including reviews, reviewer details, images, contact info, including full name, email, and job title, opening hours, prices & more. Export data, run via API, schedule and monitor runs, or integrate with other tools.

Compass

654K

4.7

(1,818)

LinkedIn Profile Scraper + Email (No Cookies)

harvestapi/linkedin-profile-scraper

Extract detailed information from LinkedIn profiles in bulk, including complete work experience, education history, skills and more. No cookies or account required.

HarvestAPI

81K

4.6

(93)

Instagram Hashtag Scraper

apify/instagram-hashtag-scraper

Scrape Instagram posts and reels by hashtags. Just add one or more hashtags and extract captions, locations, likes, plays, shares, comments count, images, timestamps, audio, and other hashtags. Export scraped hashtags, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

132K

3.5

(91)

Instagram Reel Scraper

apify/instagram-reel-scraper

Scrape or download Instagram reels. Just add Instagram profile or reel URL, and get caption, timestamp, transcript, hashtags, mentions, tagged users, comments, likes, shares, views, duration, and downloaded video. Export scraped data, schedule via API, and integrate with other tools or AI workflows.

Apify

167K

4.4

(103)

RAG Web Browser

apify/rag-web-browser

Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.

Apify

196K

4.7

(35)

Google Maps Reviews Scraper

compass/Google-Maps-Reviews-Scraper

Extract all reviews of Google Maps places using place URLs. Get review text, published date, response from owner, review URL, and reviewer's details. Download scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Compass

63K

4.9

(198)