Wordpress Plugins Scraper | Reviews & Contact

Slug: fatihtahta/wordpress-plugins-scraper

2) Overview

Wordpress Plugins Scraper collects structured plugin directory data from WordPress.org, including plugin metadata, ratings, review summaries, links, release details, taxonomy tags, and optional review & developer enrichment records. It supports discovery from search URLs, browse/category/tag pages, plugin detail pages, and keyword queries, so teams can build consistent datasets across multiple collection strategies.

The source directory at https://wordpress.org/plugins/ is one of the most widely used public indexes for WordPress ecosystem research, making it valuable for trend analysis, competitive mapping, and plugin intelligence. Instead of manually collecting and normalizing records, the actor automates recurring data collection into analysis-ready JSON output. This helps teams save time, reduce inconsistencies, and keep reporting pipelines current.

3) Why Use This Actor

• Market research & analytics teams: Track plugin category movement, ratings shifts, install momentum, and review volume to identify demand patterns and market opportunities.
• Product & content teams: Build evidence-based comparisons, content briefs, and editorial calendars using fresh plugin metadata, tags, release context, and user feedback signals.
• Developers & data engineering teams: Feed standardized records into BI dashboards, ETL jobs, and internal data products without manual cleanup or one-off exports.
• Lead generation & enrichment teams: Enrich plugin-focused prospect lists with plugin profile context, related links, and optional contributor/developer details.
• Monitoring & competitive tracking teams: Run periodic collections to detect changes in competitor positioning, review sentiment trends, and plugin portfolio updates over time.

4) Input Parameters

Provide any combination of URLs, queries, and filters to control dataset scope and depth.

Parameter	Type	Description	Default
startUrls	array<string>	One or more WordPress plugin URLs to scrape directly. Supports search result URLs, browse/category pages, tag pages, and individual plugin detail pages. You can mix page types in one run.	–
queries	array<string>	Keyword queries for discovering plugins in the WordPress Plugins Directory when you do not want to provide URLs manually (for example: seo, backups, ecommerce).	–
getReviews	boolean	When true, collects review records in addition to plugin records. Allowed values: true, false.	false
getDevelopers	boolean	When true, enriches author/contributor records with additional profile-level details. Allowed values: true, false.	true
limit	integer	Maximum number of plugin records to save per query. Minimum: 10. Review records are not counted against this plugin limit.	50000
maxReviews	integer	Maximum number of reviews to collect per plugin when review collection is enabled. Minimum: 1.	50000

5) Example Input

{
  "startUrls": [
    "https://wordpress.org/plugins/search/seo/",
    "https://wordpress.org/plugins/tag/security/"
  ],
  "queries": ["smtp", "backup"],
  "getReviews": true,
  "getDevelopers": true,
  "limit": 500,
  "maxReviews": 50
}

6) Output

6.1 Output destination

The actor writes results to an Apify dataset as JSON records. And the dataset is designed for direct consumption by analytics tools, ETL pipelines, and downstream APIs without post-processing.

6.2 Record envelope (all items)

Every record includes these stable identifiers:

• type (string, required)
• id (number, required)
• url (string, required)

Recommended idempotency key: type + ":" + id. Use this key for deduplication and upserts so repeated runs update existing entities instead of creating duplicates.

6.3 Examples

Example: plugin (type = "plugin")

{
  "type": "plugin",
  "id": 193,
  "url": "https://wordpress.org/plugins/wp-mail-smtp/",
  "title": "WP Mail SMTP by WPForms – The Most Popular SMTP and Email Log Plugin",
  "source": {
    "sourceUrl": "https://wordpress.org/plugins/search/email/",
    "seedType": "query",
    "seedValue": "email"
  },
  "ratings": {
    "average": "4.8",
    "count": 5046
  },
  "links": {
    "supportUrl": "https://wordpress.org/support/plugin/wp-mail-smtp/",
    "reviewsUrl": "https://wordpress.org/support/plugin/wp-mail-smtp/reviews/"
  },
  "author": {
    "name": "Syed Balkhi",
    "profileUrl": "https://profiles.wordpress.org/smub/"
  }
}

Example: review (type = "review")

{
  "type": "review",
  "id": 7918836,
  "url": "https://wordpress.org/support/topic/eine-sorgen-weniger-die-wordpress-seite-virenfrei-zu-halten/",
  "title": "Eine Sorgen weniger die WordPress Seite Virenfrei zu halten.",
  "source": {
    "sourceUrl": "https://wordpress.org/support/plugin/antivirus/reviews/",
    "seedType": "query",
    "seedValue": "email verifier"
  },
  "plugin": {
    "id": 349,
    "title": "AntiVirus",
    "url": "https://wordpress.org/plugins/antivirus/"
  },
  "author": {
    "name": "BirgerKlaus",
    "profileUrl": "https://wordpress.org/support/users/birgerklaus/"
  },
  "content": {
    "reviewText": "Eine Sorgen weniger die WordPress Seite Virenfrei zu halten.",
    "publishedAt": "January 10, 2015 at 12:42 pm"
  }
}

7) Field reference

Plugin records (type = "plugin")

• type (string, required): Record type identifier (plugin).
• id (number, required): Stable plugin identifier.
• url (string, required): Canonical plugin page URL.
• title (string, optional): Plugin title.
• source.sourceUrl (string, optional): Source page used to discover the plugin.
• source.seedType (string, optional): Seed origin type (for example query or URL-based seed).
• source.seedValue (string, optional): Query text or source seed value.
• ratings.average (string, optional): Average rating value/text.
• ratings.count (number, optional): Number of ratings.
• ratings.breakdown (object, optional): Distribution by star level.
• links.supportUrl (string, optional): Plugin support page URL.
• links.downloadUrl (string, optional): Plugin download URL.
• links.reviewsUrl (string, optional): Plugin reviews listing URL.
• media.iconUrl (string, optional): Plugin icon URL.
• media.bannerUrl (string, optional): Plugin banner URL.
• media.screenshots (array