Pricing

from $0.01 / 1,000 results

Website Content Crawler

Crawl websites for SEO audits. Extracts HTML, title, meta tags, headings, links, & text content from pages. Automatic sitemap detection & parsing Extracts metadata (title, description, OG tags) Heading structure (H1, H2, H3) Internal & external link analysis Image extraction w/alt text Word count

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

The Howlers

Actor stats

Bookmarked

Total users

Monthly active users

42 days

Issues response

10 days ago

Last modified

Website Crawler - SEO Audit Crawler with Markdown Extraction

Fast, reliable website crawler built for SEO audits and AI/LLM content analysis. Auto-discovers sitemaps, extracts metadata, headings, and LLM-ready markdown content from every page.

BYOK (Bring Your Own Key) -- you provide your own API credentials.

Before You Start

This actor requires your own API credentials to fetch real data.

Where to get your key: Your Firecrawl API key for web crawling. When provided, Firecrawl is used as the primary crawler (faster, handles JS rendering). Falls back to Playwright if not provided or if Firecrawl fails.

You can test with Demo Mode first (free, no key needed) to see the output format before committing.

Quick Start

Test with Demo Mode (free, no API key needed)

{
  "demoMode": true,
  "startUrls": "https://example.com"
}

Run with real data

{
  "demoMode": false,
  "startUrls": "https://example.com",
  "maxCrawlPages": 25,
  "maxCrawlDepth": 2,
  "crawlSitemap": true,
  "firecrawlApiKey": "YOUR_API_KEY_HERE",
  "useFirecrawl": true
}

Input Parameters

Parameter	Type	Default	Required	Description
`startUrls`	array	-	No	URLs to start crawling from
`maxCrawlPages`	integer	`25`	No	Maximum number of pages to crawl
`maxCrawlDepth`	integer	`2`	No	Maximum link depth to follow
`crawlSitemap`	boolean	`true`	No	Try to find and use sitemap for URL discovery
`firecrawlApiKey`	string	-	Yes*	Your Firecrawl API key for web crawling. When provided, Firecrawl is used as the primary crawler (faster, handles JS rendering). Falls back to Playwright if not provided or if Firecrawl fails.
`useFirecrawl`	boolean	`true`	No	Use Firecrawl as the primary crawling method. Requires Firecrawl API key. Falls back to Playwright if disabled or if Firecrawl fails.
`demoMode`	boolean	`false`	No	Run in demo mode without real credentials. Returns mock success response for testing.
`webhookUrl`	string	-	No	URL to POST results when scraping completes (Zapier, Make, n8n, custom endpoint)

*Required when Demo Mode is off.

Pricing

This actor uses pay-per-event billing:

Event	Description	Price
Page Crawled	Per page crawled with full HTML, text, and markdown extraction	$0.05
Sitemap Discovered	Per sitemap discovered and parsed for URL extraction	$0.05

Demo mode is free -- no charges for sample data.

Troubleshooting

"API key is required"

You have Demo Mode turned off but didn't provide an API key. Either:

Turn Demo Mode on to test with sample data
Add your API key in the input

"API error 403" or "Unauthorized"

Your API key is invalid, expired, or doesn't have access to this specific API endpoint. Double-check your key and account permissions.

"API error 429" or "Rate limit"

Too many requests. Wait a minute and try again, or reduce the number of items per run.

No results or empty dataset

Check the run log for error messages. Common causes:

Invalid input format (check the examples above)
API key without proper permissions
The target data doesn't exist or is too small to track

How do I test without an API key?

Enable Demo Mode in the input. This returns realistic sample data so you can verify the output format works for your workflow.

Built by John Rippy | Actor Arsenal

Website Analyzer Crawler

quarterly_lettuce/website-analyzer-crawler

A powerful web crawler that analyzes websites and extracts comprehensive SEO data including meta tags, headings structure, word count, internal/external links, and images.

Abhishek Kumar Giri

Universal Website Content Scraper

techionik9993/universal-website-content-scraper

Extract structured page titles, meta descriptions, H1, H2, H3 headings, clean main content, and structured page text from websites with smart noise removal. Ideal for SEO audits, AI preprocessing, research, and automation

Techionik

5.0

Universal Website Meta Scraper — SEO & Links Analysis

scrapepilot/universal-website-meta-scraper----seo-links-analysis

Extract meta data from any website instantly. Get title, description, headings, links, images, OG tags & status code. Perfect for SEO analysis, lead gen, and auditing. No coding required.

Scrape Pilot

Meta Tags Extractor

krawlify/meta-tags-extractor

Extract SEO meta tags, Open Graph, Twitter Cards, JSON-LD structured data, and headings from any website. Perfect for SEO analysis, competitor research, and content audits.

Krawlify Krawlify

Heading Structure Checker

automation-lab/heading-structure-checker

This actor analyzes the heading structure (H1-H6) of web pages. It extracts all headings in document order, checks for missing H1, multiple H1s, skipped heading levels, heading order jumps, empty headings, and overly long headings. Essential for SEO and accessibility.

Stas Persiianenko

Website Title & Heading Quality Checker

gr_59017/website-title-heading-quality-checker

Analyzes website title tags and heading structure (H1–H6) to evaluate SEO quality, content hierarchy, and best practices. Detects issues like missing or multiple H1s, improper heading order, and suboptimal title length, and returns a quality score with suggestions.

Gautam Rana

5.0

Facebook Page SEO Scraper ⚡ | Open Graph & Meta Tags

premiumscraper/facebook-page-seo-scraper-open-graph-meta-tags

Extract full SEO and meta tag data from Facebook Pages and Profiles. Output includes: og:title, og:description, og:image, og:url, twitter:card, app store links, canonical URL, follower count, page category, and bio text. One structured row per page ✨ Facebook Page SEO Scraper⚡

Premium Scraper

Website text scraper

spark_actors/website-text-scraper

Extracts key content from any website URL you provide. It fetches the page’s title, meta description, all headings (H1 to H6), paragraphs, links, and tables — delivering structured data for easy use. Ideal for quick insights, SEO analysis, or data extraction without complex setup.

muhammad ubaid

SEO Audit & Analysis

mbeato/apimesh-seo-audit

On-page SEO analysis with scoring — title, meta descriptions, headings, images, links, OG tags, JSON-LD. Returns 0-100 score with actionable recommendations.

Maximus Beato

DataForSeo On-page SEO

alizarin_refrigerator-owner/dataforseo-onpage

This actor performs in-depth on-page SEO audits using the DataForSEO On-Page API. Page titles, meta descriptions, headings, content, technical SEO factors w/actionable recommendations. Technical SEO, Content Analysis, Meta Tags, Heading Structure, Image Optimization, Link Analysis & Core Web Vitals