Wordpress Site Posts Scraper

WordPress Site Posts Scraper — Extract Posts from Any WordPress Website

Collect published posts from WordPress websites into a structured dataset. Enter one or more website URLs, configure your search term and result limit, and collect post dates, links, titles, excerpts, author IDs, and categories. Export your results as JSON, CSV, or Excel.

Overview

WordPress Site Posts Scraper helps you gather publicly available blog and news posts from WordPress-powered websites.

Provide website URLs and the actor collects matching posts, processing multiple pages until it reaches your configured item limit or the available results are exhausted.

Features

• Multiple websites: Collect posts from one or more WordPress websites.
• Post search: Filter posts using a search term.
• Post details: Extract titles, excerpts, publication dates, and canonical links.
• Author information: Collect author IDs associated with posts.
• Categories: Retrieve category identifiers for each post.
• Pagination: Automatically process multiple pages of posts.
• Result limits: Control the maximum number of posts collected.
• Structured exports: Download results as JSON, CSV, Excel, and other supported formats.

Use Cases

• Content research: Discover and organize articles from WordPress websites.
• Competitor analysis: Review published content, titles, and publication dates.
• Content monitoring: Build datasets of posts from selected websites.
• SEO research: Collect post titles, excerpts, and category information.
• Data analysis: Organize blog and news content for further processing.
• Content management: Create searchable archives of publicly available posts.

Input Parameters

Parameter	Type	Description
mode	String	Collection mode. Use posts.
siteUrls	Array	WordPress website URLs to collect posts from.
search	String	Optional search term to filter posts. Leave empty to collect posts without a search filter.
maxItems	Integer	Maximum number of posts to collect.
requestDelaySecs	Number	Delay between requests in seconds.

Example Input

{
  "mode": "posts",
  "siteUrls": [
    "https://techcrunch.com"
  ],
  "search": "",
  "maxItems": 50,
  "requestDelaySecs": 1
}

What Data Does This Actor Extract?

Each dataset row represents one WordPress post.

Field	Description
postId	Unique post identifier
date	Post publication date and time
link	Canonical URL of the post
postTitle	Post title object containing rendered title text
excerpt	Post excerpt object containing rendered excerpt text and protection status
author	Author identifier
categories	List of category identifiers
scrapedAt	Date and time the record was collected

Example Output

{
  "postId": 3151020,
  "date": "2026-10-11T17:59:01",
  "link": "https://techcrunch.com/2026/10/11/the-founders-guide-to-techcrunch-disrupt-2026-everything-you-need-to-know/",
  "postTitle": {
    "rendered": "The founder’s guide to TechCrunch Disrupt 2026: Everything you need to know"
  },
  "excerpt": {
    "rendered": "<p>TechCrunch Disrupt 2026 is built around one question: How do you build an enduring company in the AI era?</p>",
    "protected": false
  },
  "author": 133574599,
  "categories": [
    20429
  ],
  "scrapedAt": "2026-10-26T00:00:00+00:00"
}

Working with Your Dataset

After the run finishes, open the dataset in Apify Console to review your collected posts.

You can:

• Export results as JSON, CSV, or Excel.
• Sort posts by publication date.
• Search and filter records by title or category.
• Open post links to view the original articles.
• Import the dataset into spreadsheets, databases, or content analysis workflows.
• Combine results from multiple websites for comparative research.

FAQ

Who is this actor for?

It is designed for researchers, marketers, content creators, SEO specialists, and developers who need structured post information from WordPress websites.

What can I export?

You can export JSON, CSV, Excel, and other supported Apify dataset formats.

Can I run it on a schedule?

Yes. You can configure an Apify schedule to collect updated posts at your preferred intervals.

Does the search field filter posts?

Yes. When you provide a search term, the actor uses it to filter matching posts.

What happens if a website cannot be processed?

The actor can continue processing other submitted websites when an individual website cannot be accessed or processed.

Does it collect full article content?

The output includes post titles and excerpts, along with publication and category information. It does not represent a full article archive.

Disclaimer

This actor is an independent tool and is not affiliated with, endorsed by, sponsored by, or officially associated with WordPress or its owners. It collects information made publicly available through the websites being processed. Users are responsible for ensuring that their data collection and use comply with applicable laws and relevant terms.

Is Web Scraping Legal?

Collecting information that is already public is generally legal. There is no single law that bans all forms of web scraping. The limits are the usual ones: do not break into accounts, do not take private or confidential data, and be careful with personal data and copyrighted works. A site's terms can also restrict how you access it. Facts such as a public name, price, or rating are not the same thing as republishing someone's article or photo.

This actor collects information from public pages. It does not log in and it does not bypass access controls.

For a longer explanation, see Apify's article Is web scraping legal?.