Go to example tasks
Audit a website for SEO issues and broken links
Crawl a website and audit every page for technical SEO issues: missing or duplicate titles and meta descriptions, headings, canonical and noindex tags, hreflang, structured data and broken internal links, plus which AI crawlers robots.txt blocks and whether llms.txt exists. Each page gets a 0-100 score and fix hints; a site summary row lists the top issues.
SEO Audit Crawler: Broken Links, llms.txt & AI Bot Checklindenwerk/seo-audit-crawler
Row
URL
HTTP
Score
+4 fieldsTextNumberBooleanListObject
Input
Websites(required):https://crawlee.dev
Max pages per site:20
Check links:internal
Add site summary row:true
Output fields
Row
URL
HTTP
Score
#
Issues
Title
Indexable
Sign up on Apify01
Create your Apify account to access the SEO Audit Crawler: Broken Links, llms.txt & AI Bot Check.
Start the run02
The Actor will start running based on the input automatically.
Receive the output03
Monitor the progress in real-time. You will be notified as soon as your dataset is complete and ready for review.
Integrate into your workflow04
The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow.
