# Claude Prompt Library Scraper (`bornoo/claude-prompt-library-scraper`) Actor

Scrape prompts from the Claude Prompt Library with this Apify actor. Extract titles, categories, descriptions, prompt content, tags, authors, URLs, and metadata. Supports pagination, keyword filtering, category filtering, deduplication, and exports clean data to JSON, CSV, and Excel.

- **URL**: https://apify.com/bornoo/claude-prompt-library-scraper.md
- **Developed by:** [Biddut Hossain](https://apify.com/bornoo) (community)
- **Categories:** AI, Agents, Automation
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.01 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Claude Prompt Library Scraper

An Apify Actor that automatically scrapes Claude Prompt Library data and converts it into a clean structured dataset.

This scraper extracts AI prompt information including titles, descriptions, categories, tags, authors, prompt content, examples, and source URLs.

### Features

✅ Scrape Claude prompt libraries automatically  
✅ Extract complete prompt information  
✅ Collect titles and descriptions  
✅ Extract categories and tags  
✅ Capture author information  
✅ Extract update dates  
✅ Collect prompt examples  
✅ Keyword filtering  
✅ Category filtering  
✅ Maximum item limit  
✅ Duplicate URL removal  
✅ Export data to JSON, CSV, Excel, and other Apify formats  

---

## Input Configuration

The Actor accepts the following inputs:

### startUrls

List of Claude Prompt Library pages to scrape.

Example:

```json
[
  {
    "url": "https://example.com/prompts"
  }
]
````

***

### maxItems

Maximum number of prompts to scrape.

Example:

```json
100
```

***

### category

Filter prompts by category.

Example:

```text
Marketing
```

***

### keyword

Search prompts containing specific keywords.

Example:

```text
SEO
```

***

### includeContent

Enable or disable full prompt extraction.

Example:

```json
true
```

***

### includeTags

Enable or disable tag extraction.

Example:

```json
true
```

***

### proxyConfiguration

Configure Apify Proxy for reliable scraping.

Example:

```json
{
  "useApifyProxy": true
}
```

***

## Output Dataset

Each scraped item contains:

```json
{
  "title": "AI Marketing Assistant",
  "category": "Marketing",
  "description": "Create marketing strategies using AI",
  "prompt": "Act as a marketing expert...",
  "tags": [
    "marketing",
    "ai"
  ],
  "author": "Author Name",
  "updatedDate": "2026-01-01",
  "example": "Example output",
  "url": "https://example.com/prompt"
}
```

***

## How It Works

```
Start Actor

↓

Read Input

↓

Load Start URL

↓

Download Web Page

↓

Find Prompt Links

↓

Open Each Prompt

↓

Extract Data

↓

Apply Filters

↓

Save Dataset

↓

Finish
```

***

## Use Cases

### AI Researchers

Collect and analyze thousands of AI prompts.

### Prompt Engineers

Build custom prompt databases.

### Developers

Create AI applications using structured prompt data.

### Marketers

Research AI-generated content workflows.

### Businesses

Build internal AI knowledge libraries.

***

## Installation

Install dependencies:

```bash
pip install -r requirements.txt
```

***

## Run Locally

Login to Apify:

```bash
apify login
```

Run the Actor:

```bash
apify push
```

***

## Dataset Export

Apify automatically supports:

- JSON
- CSV
- Excel
- XML
- RSS

***

## Technology Stack

- Python
- Apify SDK
- HTTPX
- BeautifulSoup
- LXML

***

## Project Structure

```
claude-prompt-library-scraper/

├── .actor/
│   └── actor.json

├── src/
│   ├── main.py
│   ├── scraper.py
│   └── __init__.py

├── INPUT_SCHEMA.json
├── dataset_schema.json
├── requirements.txt
├── Dockerfile
└── README.md
```

***

## Support

For issues, improvements, or feature requests, update the Actor source code or contact the developer.

***

## License

MIT License

# Actor input Schema

## `startUrls` (type: `array`):

URLs of Claude Prompt Library pages to scrape.

## `maxItems` (type: `integer`):

Maximum number of prompts to scrape.

## `category` (type: `string`):

Scrape prompts from a specific category.

## `keyword` (type: `string`):

Filter prompts containing specific keywords.

## `includeContent` (type: `boolean`):

Extract the complete prompt text.

## `includeTags` (type: `boolean`):

Extract prompt tags.

## `proxyConfiguration` (type: `object`):

Proxy settings for requests.

## Actor input object example

```json
{
  "startUrls": [
    {
      "url": "https://platform.claude.com/docs/en/resources/prompt-library/library"
    }
  ],
  "maxItems": 100,
  "category": "",
  "keyword": "",
  "includeContent": true,
  "includeTags": true,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("bornoo/claude-prompt-library-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("bornoo/claude-prompt-library-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call bornoo/claude-prompt-library-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=bornoo/claude-prompt-library-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Claude Prompt Library Scraper",
        "description": "Scrape prompts from the Claude Prompt Library with this Apify actor. Extract titles, categories, descriptions, prompt content, tags, authors, URLs, and metadata. Supports pagination, keyword filtering, category filtering, deduplication, and exports clean data to JSON, CSV, and Excel.",
        "version": "0.0",
        "x-build-id": "4bRvUA3mqO5hyOR5a"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/bornoo~claude-prompt-library-scraper/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-bornoo-claude-prompt-library-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/bornoo~claude-prompt-library-scraper/runs": {
            "post": {
                "operationId": "runs-sync-bornoo-claude-prompt-library-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/bornoo~claude-prompt-library-scraper/run-sync": {
            "post": {
                "operationId": "run-sync-bornoo-claude-prompt-library-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "required": [
                    "startUrls"
                ],
                "properties": {
                    "startUrls": {
                        "title": "Start URLs",
                        "type": "array",
                        "description": "URLs of Claude Prompt Library pages to scrape.",
                        "default": [
                            {
                                "url": "https://platform.claude.com/docs/en/resources/prompt-library/library"
                            }
                        ],
                        "items": {
                            "type": "object",
                            "required": [
                                "url"
                            ],
                            "properties": {
                                "url": {
                                    "type": "string",
                                    "title": "URL of a web page",
                                    "format": "uri"
                                }
                            }
                        }
                    },
                    "maxItems": {
                        "title": "Maximum Items",
                        "minimum": 1,
                        "type": "integer",
                        "description": "Maximum number of prompts to scrape.",
                        "default": 100
                    },
                    "category": {
                        "title": "Category Filter",
                        "type": "string",
                        "description": "Scrape prompts from a specific category.",
                        "default": ""
                    },
                    "keyword": {
                        "title": "Keyword Filter",
                        "type": "string",
                        "description": "Filter prompts containing specific keywords.",
                        "default": ""
                    },
                    "includeContent": {
                        "title": "Include Prompt Content",
                        "type": "boolean",
                        "description": "Extract the complete prompt text.",
                        "default": true
                    },
                    "includeTags": {
                        "title": "Include Tags",
                        "type": "boolean",
                        "description": "Extract prompt tags.",
                        "default": true
                    },
                    "proxyConfiguration": {
                        "title": "Proxy Configuration",
                        "type": "object",
                        "description": "Proxy settings for requests.",
                        "default": {
                            "useApifyProxy": true
                        }
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```