# Wordpress Site Posts Scraper (`real-estate-api/wordpress-site-posts-scraper`) Actor

WordPress Site Posts Scraper is a Python tool designed to extract article titles, publication dates, author metadata, full body content, categories, and tags via WordPress REST APIs or RSS feeds. It exports structured publishing datasets into clean CSV or JSON format

- **URL**: https://apify.com/real-estate-api/wordpress-site-posts-scraper.md
- **Developed by:** [real-estate-api](https://apify.com/real-estate-api) (community)
- **Security:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.99 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

### WordPress Site Posts Scraper — Extract Posts from Any WordPress Website

![WordPress Site Posts Scraper cover](https://images.bigibyte.com/cdn-cgi/image/width=1260,height=540,fit=cover,format=webp/apify-actors-covers/wordpress-site-posts-scraper-cover.png)

Collect published posts from WordPress websites into a structured dataset. Enter one or more website URLs, configure your search term and result limit, and collect post dates, links, titles, excerpts, author IDs, and categories. Export your results as JSON, CSV, or Excel.

### Overview

WordPress Site Posts Scraper helps you gather publicly available blog and news posts from WordPress-powered websites.

Provide website URLs and the actor collects matching posts, processing multiple pages until it reaches your configured item limit or the available results are exhausted.

### Features

- **Multiple websites:** Collect posts from one or more WordPress websites.
- **Post search:** Filter posts using a search term.
- **Post details:** Extract titles, excerpts, publication dates, and canonical links.
- **Author information:** Collect author IDs associated with posts.
- **Categories:** Retrieve category identifiers for each post.
- **Pagination:** Automatically process multiple pages of posts.
- **Result limits:** Control the maximum number of posts collected.
- **Structured exports:** Download results as JSON, CSV, Excel, and other supported formats.

### Use Cases

- **Content research:** Discover and organize articles from WordPress websites.
- **Competitor analysis:** Review published content, titles, and publication dates.
- **Content monitoring:** Build datasets of posts from selected websites.
- **SEO research:** Collect post titles, excerpts, and category information.
- **Data analysis:** Organize blog and news content for further processing.
- **Content management:** Create searchable archives of publicly available posts.

### Input Parameters

| Parameter | Type | Description |
|---|---|---|
| `mode` | String | Collection mode. Use `posts`. |
| `siteUrls` | Array | WordPress website URLs to collect posts from. |
| `search` | String | Optional search term to filter posts. Leave empty to collect posts without a search filter. |
| `maxItems` | Integer | Maximum number of posts to collect. |
| `requestDelaySecs` | Number | Delay between requests in seconds. |

### Example Input

```json id="w8k3pd"
{
  "mode": "posts",
  "siteUrls": [
    "https://techcrunch.com"
  ],
  "search": "",
  "maxItems": 50,
  "requestDelaySecs": 1
}
```

### What Data Does This Actor Extract?

Each dataset row represents one WordPress post.

| Field | Description |
|---|---|
| `postId` | Unique post identifier |
| `date` | Post publication date and time |
| `link` | Canonical URL of the post |
| `postTitle` | Post title object containing rendered title text |
| `excerpt` | Post excerpt object containing rendered excerpt text and protection status |
| `author` | Author identifier |
| `categories` | List of category identifiers |
| `scrapedAt` | Date and time the record was collected |

### Example Output

```json id="f5n2qx"
{
  "postId": 3151020,
  "date": "2026-10-11T17:59:01",
  "link": "https://techcrunch.com/2026/10/11/the-founders-guide-to-techcrunch-disrupt-2026-everything-you-need-to-know/",
  "postTitle": {
    "rendered": "The founder’s guide to TechCrunch Disrupt 2026: Everything you need to know"
  },
  "excerpt": {
    "rendered": "<p>TechCrunch Disrupt 2026 is built around one question: How do you build an enduring company in the AI era?</p>",
    "protected": false
  },
  "author": 133574599,
  "categories": [
    20429
  ],
  "scrapedAt": "2026-10-26T00:00:00+00:00"
}
```

### Working with Your Dataset

After the run finishes, open the dataset in Apify Console to review your collected posts.

You can:

- Export results as JSON, CSV, or Excel.
- Sort posts by publication date.
- Search and filter records by title or category.
- Open post links to view the original articles.
- Import the dataset into spreadsheets, databases, or content analysis workflows.
- Combine results from multiple websites for comparative research.

### FAQ

**Who is this actor for?**

It is designed for researchers, marketers, content creators, SEO specialists, and developers who need structured post information from WordPress websites.

**What can I export?**

You can export JSON, CSV, Excel, and other supported Apify dataset formats.

**Can I run it on a schedule?**

Yes. You can configure an Apify schedule to collect updated posts at your preferred intervals.

**Does the search field filter posts?**

Yes. When you provide a search term, the actor uses it to filter matching posts.

**What happens if a website cannot be processed?**

The actor can continue processing other submitted websites when an individual website cannot be accessed or processed.

**Does it collect full article content?**

The output includes post titles and excerpts, along with publication and category information. It does not represent a full article archive.

### Disclaimer

This actor is an independent tool and is not affiliated with, endorsed by, sponsored by, or officially associated with WordPress or its owners. It collects information made publicly available through the websites being processed. Users are responsible for ensuring that their data collection and use comply with applicable laws and relevant terms.

### Is Web Scraping Legal?

Collecting information that is already public is generally legal. There is no single law that bans all forms of web scraping. The limits are the usual ones: do not break into accounts, do not take private or confidential data, and be careful with personal data and copyrighted works. A site's terms can also restrict how you access it. Facts such as a public name, price, or rating are not the same thing as republishing someone's article or photo.

This actor collects information from public pages. It does not log in and it does not bypass access controls.

For a longer explanation, see Apify's article [Is web scraping legal?](https://blog.apify.com/is-web-scraping-legal/).

# Actor input Schema

## `mode` (type: `string`):

What to scrape.

## `siteUrls` (type: `array`):

WordPress site base URLs. One URL per line.

## `search` (type: `string`):

Optional search term passed to the WordPress posts endpoint.

## `maxItems` (type: `integer`):

Stop after this many successful rows. Hard max is 1000.

## `requestDelaySecs` (type: `number`):

Seconds to wait between requests.

## `userAgent` (type: `string`):

User-Agent header sent with each request.

## `timeoutSecs` (type: `integer`):

Overall run budget in seconds.

## `requestTimeoutSecs` (type: `integer`):

Per-request timeout in seconds.

## `proxyConfiguration` (type: `object`):

Optional proxy. Leave off unless you need it.

## Actor input object example

```json
{
  "mode": "posts",
  "siteUrls": [
    "https://techcrunch.com"
  ],
  "search": "",
  "maxItems": 100,
  "requestDelaySecs": 1,
  "userAgent": "ActorResearch/1.0",
  "timeoutSecs": 300,
  "requestTimeoutSecs": 30,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `overview` (type: `string`):

Dataset rows in the overview table.

## `dataset` (type: `string`):

Full dataset for this run.

## `items` (type: `string`):

Dataset items as JSON.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "siteUrls": [
        "https://techcrunch.com"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("real-estate-api/wordpress-site-posts-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "siteUrls": ["https://techcrunch.com"] }

# Run the Actor and wait for it to finish
run = client.actor("real-estate-api/wordpress-site-posts-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "siteUrls": [
    "https://techcrunch.com"
  ]
}' |
apify call real-estate-api/wordpress-site-posts-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,real-estate-api/wordpress-site-posts-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/6DLsec0kXCEwCNEtR/builds/BJPPrN959P7HWokWj/openapi.json