Website Content Crawler

Pricing

from $0.01 / 1,000 results

Website Content Crawler

Crawl websites for SEO audits. Extracts HTML, title, meta tags, headings, links, & text content from pages. Automatic sitemap detection & parsing Extracts metadata (title, description, OG tags) Heading structure (H1, H2, H3) Internal & external link analysis Image extraction w/alt text Word count

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

John Rippy

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Features

Automatic sitemap detection and parsing
Extracts metadata (title, description, OG tags)
Heading structure (H1, H2, H3)
Internal and external link analysis
Image extraction with alt text
Word count and load time metrics

Input

{
  "startUrls": [{ "url": "https://example.com" }],
  "maxCrawlPages": 25,
  "maxCrawlDepth": 2,
  "crawlSitemap": true
}

Output

Each page returns:

{
  "url": "https://example.com/page",
  "title": "Page Title",
  "html": "<html>...</html>",
  "text": "Page text content...",
  "statusCode": 200,
  "loadTimeMs": 1234,
  "metadata": {
    "description": "Meta description",
    "ogTitle": "Open Graph Title",
    "canonical": "https://example.com/page"
  },
  "headings": {
    "h1": ["Main Heading"],
    "h2": ["Subheading 1", "Subheading 2"],
    "h3": []
  },
  "links": {
    "internal": ["https://example.com/other"],
    "external": ["https://external.com"]
  },
  "images": [
    { "src": "https://example.com/image.jpg", "alt": "Alt text" }
  ],
  "wordCount": 1500
}

Use Cases

SEO audits
Content analysis
Site structure mapping
Broken link detection
Meta tag analysis

Pricing

This actor uses pay-per-event pricing:

Event	Description	Price
`page_crawled`	Per page crawled	$0.01

Example costs:

Crawl 25 pages: 25 × $0.01 = $0.25
Crawl 100 pages: 100 × $0.01 = $1.00

Author

Built by John Rippy | johnrippy.link

Keywords

website crawler, web scraper, site crawler, seo crawler, content extraction, website data extraction

Website Analyzer Crawler

quarterly_lettuce/website-analyzer-crawler

A powerful web crawler that analyzes websites and extracts comprehensive SEO data including meta tags, headings structure, word count, internal/external links, and images.

Abhishek Kumar Giri

DataForSeo On-page SEO

alizarin_refrigerator-owner/dataforseo-onpage

This actor performs in-depth on-page SEO audits using the DataForSEO On-Page API. Page titles, meta descriptions, headings, content, technical SEO factors w/actionable recommendations. Technical SEO, Content Analysis, Meta Tags, Heading Structure, Image Optimization, Link Analysis & Core Web Vitals

John Rippy

Website Title & Heading Quality Checker

gr_59017/website-title-heading-quality-checker

Analyzes website title tags and heading structure (H1–H6) to evaluate SEO quality, content hierarchy, and best practices. Detects issues like missing or multiple H1s, improper heading order, and suboptimal title length, and returns a quality score with suggestions.

Gautam Rana

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Powerful Bachelor

Website text scraper

spark_actors/website-text-scraper

Extracts key content from any website URL you provide. It fetches the page’s title, meta description, all headings (H1 to H6), paragraphs, links, and tables — delivering structured data for easy use. Ideal for quick insights, SEO analysis, or data extraction without complex setup.

muhammad ubaid

No-BS Content Crawler 🖕

successful_nonagon/no-bs-content-crawler

Fast web crawler that extracts clean text from websites. Returns readable content, headings, and links. Perfect for content aggregation, SEO research, and data collection.

hafsah nuzhat

5.0

Website Metadata Extractor(sitemap, socialLinks, robotsTxt)

codescraper/website-metadata-extractor

A very fast metadata extractor to get all meta tags, robots.txt, sitemaps, social links, H1s, word count, and JSON-LD data. Also provides technology detection for a full analysis. Get your data fast for just $3/month.

CodeScraper

5.0

SEO Data Extractor

nocodeventure/seo-data-extractor

Extract comprehensive SEO metadata, headings, links, images, Open Graph tags, Twitter Cards, and technical data from websites. Perfect for SEO audits, competitor analysis, and content optimization. Runs on Apify platform with structured JSON output.

No-Code Venture

Meta Tags Scraper

rl1987/meta-tags-scraper

Web page metadata scraper.

R.L.

Competitor-Based Keyword Recommendations for On-Page SEO

antonio_espresso/keyword-competitor-recommendation

This actor takes a keyword, language, and Google engine, then returns structured SEO insights: ideal word count, title/content terms with usage ranges, relevant questions (H1–H3, PAA), and competitor data including URLs, rankings, titles, and content scores.