# RapidAPI Hub Scraper (`magnesia/rapidapi-hub-scraper`) Actor

Scrape RapidAPI Hub API listings by keyword or category: popularity, latency, success rate, subscribers, rating, full pricing plans with quotas and overage, endpoints and website. HTTP-only, no login.

- **URL**: https://apify.com/magnesia/rapidapi-hub-scraper.md
- **Developed by:** [Magnesia LLC](https://apify.com/magnesia) (community)
- **Categories:** Developer tools, Lead generation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.80 / 1,000 api scraped (full details)s

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## RapidAPI Hub Scraper

**Magnesia LLC** · Apify Store Actor

Scrape the **RapidAPI Hub** API marketplace and export API listings as clean JSON, CSV or Excel: **popularity, latency, service level, success rate, subscribers, rating, every pricing plan with quotas, overage and rate limits, endpoint lists and provider websites**. Search by keyword, browse a whole category, or look up specific API pages. Fast, HTTP-only (no browser, no login).

### Use cases

- **API market research:** which APIs in a niche have the most subscribers, and what they charge
- **Pricing benchmarks** for API providers: compare free quotas, paid tiers, overage and rate limits
- **Competitor tracking:** watch a category for newly updated or newly launched APIs (`sortBy: updated`)
- **Vendor selection:** shortlist APIs by success rate, latency and rating before integrating
- **Lead lists** of API providers with their websites
- **AI agents** that need to discover an API for a task

### What you get

| Field | Description |
| --- | --- |
| `title`, `description`, `url`, `slug`, `apiId` | API identity and RapidAPI Hub link |
| `owner`, `ownerName`, `ownerType`, `websiteUrl` | Provider username, display name and website |
| `category`, `pricing`, `tags` | Hub category and pricing model (`FREE`, `FREEMIUM`, `PAID`) |
| `popularityScore`, `avgLatencyMs`, `avgServiceLevel`, `avgSuccessRate` | Hub health metrics |
| `subscribers`, `rating`, `ratingVotes`, `qualityScore` | Adoption and reputation (full details) |
| `plans[]` | Every public plan: `name`, `priceUsd`, `period`, `quotas[]` (amount, hard/soft limit, overage price), `rateLimit`, `recommended` |
| `hasFreePlan`, `cheapestPaidPlanUsd` | Quick pricing summary |
| `endpointCount`, `endpoints[]` | Number of endpoints plus method, route and name (capped by `maxEndpointsPerApi`) |
| `longDescription`, `createdAt`, `updatedAt`, `status`, `apiType`, `thumbnailUrl` | Page details |
| `query`, `position`, `detailLevel`, `scrapedAt` | Search context and rank |

### Input

```json
{
  "searchQueries": ["weather", "email validation"],
  "category": "",
  "sortBy": "relevance",
  "pricingFilter": "all",
  "maxItemsPerQuery": 20,
  "includeDetails": true,
  "maxEndpointsPerApi": 50,
  "apiUrls": ["https://rapidapi.com/meteostat/api/meteostat"]
}
```

- **Category:** exact hub category name, e.g. `Weather`, `Finance`, `Data`, `Sports`, `Email`, `Artificial Intelligence/Machine Learning`. Leave `searchQueries` empty to browse the whole category.
- **Sort:** `relevance` (hub default), `updated` (recently updated first) or `alphabetical`.
- **Pricing model:** `all`, `free`, `freemium` or `paid`.
- **Include full details:** on by default. Turn it off for a fast, cheaper listing-only export.
- **API URLs:** look up specific APIs (always full details).
- The hub returns up to about 1,000 results per search; split big categories into several keywords. Duplicates across queries are returned once.

### Sample output

```json
{
  "title": "Open Weather",
  "url": "https://rapidapi.com/worldapi/api/open-weather13",
  "ownerName": "Quantum APIs",
  "websiteUrl": "http://openweather.site/",
  "category": "Weather",
  "pricing": "FREEMIUM",
  "popularityScore": 9.9,
  "avgLatencyMs": 328,
  "avgSuccessRate": 100,
  "subscribers": 30684,
  "rating": 3.3,
  "ratingVotes": 44,
  "endpointCount": 3,
  "endpoints": [{ "method": "GET", "route": "/latlon", "name": "V2 - Current Weatherby Latitude & Longitude" }],
  "plans": [
    {
      "name": "ULTRA",
      "pricing": "PAID",
      "priceUsd": 4.99,
      "period": "MONTHLY",
      "quotas": [{ "item": "Requests", "amount": 200000, "limitType": "hard", "overagePriceUsd": 0 }],
      "rateLimit": "50 req / 1 s"
    }
  ],
  "hasFreePlan": true,
  "cheapestPaidPlanUsd": 2.99
}
```

### Pricing (pay per event)

Platform usage (compute, storage) is **included**. You only pay the event prices below.

| Event | What it bills | Price |
| --- | --- | --- |
| `apify-actor-start` | Actor start (one event per GB of memory, min. 1; default 512 MB = 1 event) | **$0.0005** |
| `api-listing` | Each API pushed with listing data only (`includeDetails: false`) | **$0.0003** |
| `api-detailed` | Each API pushed with full details (plans, subscribers, endpoints) | **$0.0008** |

1,000 fully detailed APIs cost about **$0.80**; 1,000 listing-only rows about **$0.30**. **Max cost per run** is respected exactly: the Actor stops gracefully at your limit, so every delivered row is a charged row.

### Why this Actor

- **Full pricing plans** with quotas, overage and rate limits, not just the pricing label
- **Subscriber counts and ratings** for real adoption signals
- Keyword, category, pricing-model and recently-updated filters
- **HTTP-only**, fast and cheap, polite retries; ready-made table views

### Legal

Uses only publicly visible RapidAPI Hub listing data, without login. Respect RapidAPI's Terms of Service and applicable law, and don't use the data to spam API providers.

### Support

Built by **Magnesia LLC** (Wyoming, US). Issues and feature requests are welcome on the Actor's Issues tab.

# Actor input Schema

## `searchQueries` (type: `array`):

Keywords to search on RapidAPI Hub (one search per keyword), e.g. "weather" or "email validation". Leave empty and set a category to browse the whole category.

## `category` (type: `string`):

Exact RapidAPI Hub category name to filter by, e.g. Weather, Finance, Data, Sports, Artificial Intelligence/Machine Learning, Email, Translation, News, Media.

## `sortBy` (type: `string`):

Order of search results.

## `pricingFilter` (type: `string`):

Keep only APIs with this pricing model.

## `maxItemsPerQuery` (type: `integer`):

Maximum APIs to return per search query.

## `includeDetails` (type: `boolean`):

Fetch each API's page data: subscriber count, rating, all pricing plans with quotas / overage / rate limits, endpoint list, website and long description. Off = fast listing data only (cheaper event).

## `maxEndpointsPerApi` (type: `integer`):

Cap the endpoint list per API (endpointCount always shows the full number). 0 = don't list endpoints.

## `apiUrls` (type: `array`):

Look up specific APIs, e.g. https://rapidapi.com/meteostat/api/meteostat (always returns full details).

## Actor input object example

```json
{
  "searchQueries": [
    "weather",
    "email validation"
  ],
  "sortBy": "relevance",
  "pricingFilter": "all",
  "maxItemsPerQuery": 20,
  "includeDetails": true,
  "maxEndpointsPerApi": 50,
  "apiUrls": [
    "https://rapidapi.com/meteostat/api/meteostat"
  ]
}
```

# Actor output Schema

## `apis` (type: `string`):

Dataset of scraped RapidAPI Hub APIs (one item per API).

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchQueries": [
        "weather",
        "email validation"
    ],
    "maxItemsPerQuery": 20
};

// Run the Actor and wait for it to finish
const run = await client.actor("magnesia/rapidapi-hub-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "searchQueries": [
        "weather",
        "email validation",
    ],
    "maxItemsPerQuery": 20,
}

# Run the Actor and wait for it to finish
run = client.actor("magnesia/rapidapi-hub-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchQueries": [
    "weather",
    "email validation"
  ],
  "maxItemsPerQuery": 20
}' |
apify call magnesia/rapidapi-hub-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,magnesia/rapidapi-hub-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/tD8bDEhNv0CDqiJDA/builds/UjesX0oAQa00l22MS/openapi.json
