Website Content Extractor

Extract clean, structured content from any website — titles, meta descriptions, headings, and main text — without writing a single line of code.

What does Website Content Extractor do?

This Actor takes one or more website URLs and returns structured content from each page. It fetches the raw HTML, parses it, and extracts:

• Page title — from the <title> tag
• Meta description — from the <meta name="description"> tag
• All headings (H1, H2, H3) — with their level and text
• Main body text — up to 10,000 characters of readable content

The output is delivered as a clean dataset, ready for analysis, export, or integration with other tools.

Who is it for?

• Content researchers who need to analyze website copy at scale
• SEO specialists auditing titles, meta descriptions, and heading structure
• Data scientists collecting text data for AI model training
• Marketers monitoring competitor messaging and content strategy
• Developers who need a lightweight, Cheerio-based scraper without browser overhead

How much does it cost?

This Actor uses pay-per-result pricing. You pay $0.01 per extracted page (1 cent per dataset item). There is no monthly subscription.

For example, extracting content from 100 pages costs approximately $1.00. The Actor also charges a negligible platform usage fee per run, typically under $0.001.

How to use it

1. Click Start in the Apify Console.
2. Enter the URL(s) you want to extract content from.
3. Set the Max Requests per Crawl to control how many pages to visit.
4. Click Run.
5. Download the results as JSON, CSV, or Excel from the Storage tab.

Input

Field	Type	Description	Default
Website URLs	Array	The pages to extract content from. Add one or more URLs.	https://example.com
Max Requests per Crawl	Integer	Maximum number of pages to crawl. Use 1 for a single page.	1

Output

The Actor returns a dataset with one row per page:

{
  "url": "https://example.com/",
  "title": "Example Domain",
  "metaDescription": "",
  "headings": [
    { "level": "h1", "text": "Example Domain" }
  ],
  "bodyTextPreview": "Example Domain This domain is for use in documentation examples...",
  "extractedAt": "2026-09-16T19:36:11.179Z"
}

## Use cases

### SEO auditing
Run the Actor on your own site to audit titles, meta descriptions, and heading structure across all pages.

### Content research
Extract article text and headings from competitor blogs or news sites. Analyze tone, structure, and topics at scale.

### AI training data
Collect clean text content from documentation sites, wikis, or knowledge bases to build custom datasets for fine-tuning or RAG pipelines.

### Competitive intelligence
Monitor competitor messaging, product descriptions, and landing page copy. Track changes over time by scheduling regular runs.

Technical details

• Built with Crawlee and Cheerio — no browser, no Playwright, no Puppeteer
• Fast and lightweight: approximately 74ms per page
• Uses Apify Proxy automatically in the cloud to avoid IP blocks
• Respects maxRequestsPerCrawl to prevent runaway crawling

FAQ

Can I extract content from JavaScript-rendered pages? This Actor uses Cheerio, which parses static HTML. If a page requires JavaScript to render its content, this Actor will not see that content. For JS-rendered pages, use a Playwright-based Actor instead.

Can I crawl an entire website? Yes. Set Max Requests per Crawl to a higher number and the Actor will follow internal links on the same domain.

How do I export the data? After a run, go to the Storage tab in the Apify Console, open the dataset, and click Export. You can download as JSON, CSV, Excel, or XML.

Do I need to provide proxy credentials? No. When running on Apify's platform, proxy access is provided automatically.

Support

If you encounter issues or have feature requests, please use the Issues tab on this Actor's page in the Apify Store.