# Perplexity Scraper - Threads, Answers, Sources & Discover (`scrapersdelight/perplexity-search-scraper`) Actor

Scrape public Perplexity threads and Discover stories: every answer, its cited sources (title, URL, snippet, date), related questions, the searches Perplexity ran, model and mode, plus Discover articles with full text and sources. Brand-mention tracking and monitor mode. No login, no browser.

- **URL**: https://apify.com/scrapersdelight/perplexity-search-scraper.md
- **Developed by:** [Scrapers Delight](https://apify.com/scrapersdelight) (community)
- **Categories:** AI, SEO tools, News
- **Features:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

$4.50 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

### What does Perplexity Scraper do?

**Perplexity Scraper** turns public Perplexity answers into clean rows. Give it the link of any public (shared) Perplexity thread and you get every answer in it: the question, the full answer, every cited source with its title, URL, snippet and date, the related questions Perplexity suggested, the web searches it ran to write the answer, the model and the mode. Pick Perplexity Discover topics and you get each Discover story with its summary, key points, full article text and every source behind it.

Also known as: Perplexity thread scraper, Perplexity Discover scraper, Perplexity AI answers scraper, Perplexity Pages scraper.

- **Every answer in a thread** - the first question and every follow-up, one row each, with the thread's views and forks.
- **Sources the way Perplexity cites them** - `sources[n-1]` is the `[n]` marker in the answer, plus `citationUrls` (only the sources the text actually cites) and `citedDomains`.
- **The searches behind the answer** - `searchQueries` lists the web searches Perplexity ran (Pro search), a view no other Perplexity actor gives.
- **Discover in full** - all six topics (Top, Tech & Science, Business, Arts & Culture, Sports, Entertainment), about 350-500 stories each, with article text and an average of 22 sources per story.
- **Brand tracking for GEO / AEO** - name your brands; every row says how often each one is mentioned and whether its own site is a cited source.
- **Monitor mode** - schedule it and get only new or updated stories and answers.
- **No login, no cookies, no browser, no API key.** Exports to JSON, CSV, Excel, or straight into your app through the Apify API.

### What data can you get from Perplexity?

| | | |
|---|---|---|
| ❓ Question `query` | 💬 Answer `answer` (markdown) / `answerText` | 🔗 Sources `sources` (title, URL, domain, snippet, date) |
| 🔢 `sourceCount` / `citedSourceCount` | 🌐 `citedDomains` / `citationUrls` | 💡 `relatedQuestions` |
| 🔎 `searchQueries` (searches Perplexity ran) | 🤖 `model` / `modelLabel` / `mode` | 🧵 `threadTitle` / `entryIndex` / `isFollowUp` |
| 👤 `authorUsername` / `authorName` | 👀 `viewCount` / `forkCount` | 🕒 `createdAt` / `updatedAt` |
| 📰 Discover `title` / `shortTitle` / `summary` | 📌 `bulletSummary` (key points) | 📄 `content` / `sections` (full article) |
| 🏷️ `category` / `matchedCategories` | 🖼️ `imageUrl` / `thumbnailUrl` / `imageName` | 📅 `publishedAt` / `firstPublishedAt` |
| 📚 `sourceArticles` (card previews) | ⏱️ `readTimeMinutes` / `wordCount` | 🏢 `brandMentions` (per brand) |

### How to scrape Perplexity with Perplexity Scraper

1. [Create a free Apify account](https://console.apify.com/sign-up) - it comes with monthly free credit.
2. Open **Perplexity Scraper** and paste public Perplexity links into **Perplexity URLs**, or pick **Discover topics**.
3. Optionally add keyword filters, a minimum number of sources, a date window or brands to track.
4. Click **Start**. The 10-row demo finishes in well under 20 seconds.
5. Download the results as JSON, CSV or Excel, or read them over the API.

### ⬇️ Input

| Parameter | Type | Description |
|---|---|---|
| **🔍 What to scrape** | | |
| `urls` | array | Public thread URLs (`perplexity.ai/search/...`), Discover story or Page URLs (`perplexity.ai/discover/tech/...`, `perplexity.ai/page/...`), Discover topic URLs, or bare slugs. Optional. |
| `discoverTopics` | array | `top`, `tech`, `finance`, `arts`, `sports`, `entertainment`. Optional; with no URLs and no topics the Top feed is read. |
| `includeFollowUps` | boolean | One row per answer in a thread (default `true`), or only the first answer. |
| **✂️ Refine results** (applied before anything is charged) | | |
| `sortBy` | string | `feedOrder` (default), `newest`, `oldest`, `mostSources`. Any order other than the feed's own reads the whole feed first. |
| `includeKeywords` / `excludeKeywords` | array | Keep / drop results that mention any of the words. Threads: question + answer. Discover: title, summary, description, key points. |
| `minSourceCount` | integer | Minimum number of cited sources. Default `0`. |
| `publishedAfter` / `publishedBefore` | date | Date window on the story's publish date or the answer's creation date. |
| **➕ Extra data** | | |
| `includeArticleText` | boolean | Discover: read each story's article for the full text, sections and every source. Default `true`, same price. |
| `checkBrands` | array | Brand names to track in every row (`brandMentions`). |
| **🔁 Monitoring** | | |
| `monitorMode` | boolean | Only results not delivered by an earlier run with the same input (or updated since). Default `false`. |
| `monitorKey` | string | Optional name for the monitor's memory. |
| **📦 Output** | | |
| `maxResults` | integer | Most rows in the run. Default `50`, `0` = no limit. |
| `maxResultsPerTopic` | integer | Cap per Discover topic. Default `0` = a fair share of `maxResults` per topic. |
| `compact` | boolean | Core fields only, for AI / MCP pipelines. Default `false`. |
| **⚙️ Advanced** | | |
| `proxyConfiguration` | object | Not needed (direct first, residential fallback included in the price). Your own proxy URLs are used first if you add them. |
| `maxConcurrency` | integer | Parallel requests, default `5`. |

#### Input JSON

```json
{
    "urls": ["https://www.perplexity.ai/search/europe-has-more-heat-deaths-pe-BDS6xdorS4.4x2WrCC9mAQ"],
    "discoverTopics": ["top", "tech"],
    "includeKeywords": ["AI", "Nvidia"],
    "checkBrands": ["OpenAI", "Nvidia"],
    "maxResults": 100
}
```

#### Paste thread links, not search links

A thread link looks like `https://www.perplexity.ai/search/<title>-<id>` and works when its owner shared it (Share → public link). A `perplexity.ai/search/new?q=...` link has no saved answer, and a private, deleted or expired thread cannot be read - those inputs are listed in the run summary and never charged.

#### Mixing several Discover topics

With several topics and no per-topic cap, each topic gets a fair share of `maxResults` and the rows come interleaved (1st of each topic, then 2nd...). A story that sits in two picked feeds is delivered once, with both topics in `matchedCategories`.

#### Keyword filters match the card on Discover

For Discover stories, keywords are matched against the title, summary, description and key points before the article is read - nothing filtered out is read or charged.

### ⬆️ Output

One row per thread answer (`resultType: "threadAnswer"`) or per Discover story (`resultType: "discoverStory"`). Real rows from a run on 2026-10-16, shortened:

```json
{
  "resultType": "threadAnswer",
  "threadUrl": "https://www.perplexity.ai/search/europe-has-more-heat-deaths-pe-BDS6xdorS4.4x2WrCC9mAQ",
  "entryIndex": 1,
  "query": "Europe has more heat deaths per year than the United States loses to gun deaths.",
  "answerText": "Europe Heat Deaths vs. US Gun Deaths: Annual Comparison\nKey Statistics\n\n- Europe: More than 175,000 people die from heat...",
  "sources": [{ "position": 1, "title": "Heat claims more than 175,000 lives annually in Europe, latest data ...", "url": "https://news.un.org/en/story/2024/08/1152766", "domain": "news.un.org", "publishedDate": "2024-08-02T00:00:00" }],
  "sourceCount": 20,
  "citedSourceCount": 8,
  "relatedQuestions": ["How do Europe's annual heat deaths compare to US gun-related fatalities"],
  "searchQueries": ["Europe heat deaths per year", "United States gun deaths per year", "comparison heat deaths Europe vs gun deaths US"],
  "model": "pplx_pro",
  "mode": "COPILOT",
  "createdAt": "2025-07-16T17:58:15.652003+00:00",
  "viewCount": 25816,
  "forkCount": 738,
  "brandMentions": { "Wikipedia": { "mentionCount": 0, "mentionedInAnswer": false, "citedAsSource": true, "sourcePositions": [16] } }
}
```

```json
{
  "resultType": "discoverStory",
  "title": "Anthropic leases first Canadian data center in Nova Scotia",
  "summary": "Anthropic will lease the first phase of EverWind's C$10 billion Point Tupper campus for 20 years, with operations slated for late 2027.",
  "url": "https://www.perplexity.ai/page/anthropic-leases-first-canadia-1FJVKTWQTCiTyUhPAZrH0A",
  "category": "Tech & Science",
  "publishedAt": "2026-10-16T22:53:25.712443",
  "bulletSummary": ["Anthropic, which makes the Claude chatbot, signed a 20-year lease for a data center in Point Tupper, Nova Scotia, its first in Canada, according to Bloomberg Law."],
  "sourceCount": 20,
  "sourceDomains": ["theglobeandmail.com", "news.bloomberglaw.com", "everwindfuels.com", "cbc.ca", "globalnews.ca"],
  "sources": [{ "position": 1, "title": "Anthropic signs onto $10-billion Nova Scotia data centre project", "url": "https://www.theglobeandmail.com/business/article-anthropic-signs-onto-10-billion-nova-scotia-data-centre-project/", "domain": "theglobeandmail.com", "publishedDate": "2026-10-16T22:13:12" }],
  "content": "Anthropic has signed its first data centre lease in Canada, taking capacity at a new campus in Point Tupper, Nova Scotia...",
  "wordCount": 417,
  "sectionCount": 3,
  "readTimeMinutes": 2
}
```

#### Fields and measured fill

Measured on 2026-10-16: 239 answers from 27 public threads, and 1,000 Discover stories (6 topics, article text on).

| Field | Thread answers | Discover stories |
|---|---|---|
| `query` / `title`, `answer` / `content`, `model`, `mode`, `createdAt` / `publishedAt` | 100% | 100% |
| `sources` (at least one) | 39% (answers written without a web search have none) | 100% (22 per story on average) |
| source `title` / `url` / `domain` | 100% | 100% |
| source `snippet` | 84% | 27-74% |
| source `publishedDate` | 81% | 95-96% |
| `relatedQuestions` | 65% | - |
| `searchQueries` | 33% (Pro search answers) | - |
| `modelLabel` | 98% | - |
| `viewCount` / `forkCount` | 100% | - |
| `authorName` | 93% | - |
| `bulletSummary`, `summary`, `description`, `imageUrl`, `sourceDomains` | - | 100% |
| `imageWidth` / `imageHeight` | - | 57% |
| `authorImageUrl` | 92% | 94% |

Not shipped, with the reason: likes (Perplexity reports 0 on every answer measured), Discover view/fork counts (0 on every story), and `queryCount` / `totalThreads` / `articleNumber` (the same constant or page index on every card).

### Use cases

- 📈 **GEO / AEO teams** - see which domains Perplexity cites for the questions in your market and whether your brand is one of them.
- 🧪 **AI researchers** - collect real Perplexity answers with their sources and search steps to study grounding, citation quality and model choice.
- 📰 **Media monitoring** - follow Perplexity Discover by topic and get every story with its sources, daily, with monitor mode.
- 🗂️ **Knowledge teams** - archive shared threads your team relies on, follow-ups included, as searchable rows.
- 🔍 **SEO and content teams** - mine `relatedQuestions` and `searchQueries` for the questions people and Perplexity actually ask.

### How much does it cost to scrape Perplexity?

Pay per result, no start fee: **$0.0045 per result** ($4.50 per 1,000) - one thread answer or one Discover story with its article text. Private, deleted, filtered, duplicate and unchanged (monitor) results are never charged.

| Run | Results | Cost |
|---|---|---|
| Demo (prefill) | 10 | $0.045 |
| One Discover topic, default cap | 50 | $0.225 |
| Typical | 100 | $0.45 |
| Every topic, deep | 1,000 | $4.50 |

Apify's free monthly credit covers about a thousand results.

### Integrations, API, scheduling & MCP

- **Schedule** a daily run with `monitorMode` on to receive only new Discover stories or new follow-ups.
- **Webhooks** start your own workflow when a run finishes; **Make, Zapier, n8n, Google Sheets and Slack** integrations work out of the box.
- **API**: run Perplexity Scraper from [Python](https://apify.com/scrapersdelight/perplexity-search-scraper/api/python) or [JavaScript](https://apify.com/scrapersdelight/perplexity-search-scraper/api/javascript) with the Apify client.
- **MCP**: connect it to Claude, ChatGPT or any MCP client from the [MCP tab](https://apify.com/scrapersdelight/perplexity-search-scraper/api/mcp); `compact` keeps rows small for AI agents.

### More search and news scrapers

- [Google SERP Scraper](https://apify.com/scrapersdelight/google-serp-scraper) - use it when you need Google's organic results for the same questions.
- [Bing Search Scraper](https://apify.com/topapi/bing-search-scraper) - Bing and DuckDuckGo results, ads, People Also Ask, news, images and videos.
- [Google News Scraper](https://apify.com/scrapersdelight/google-news-scraper) - news articles with decoded publisher URLs, any edition.
- [Google Trends Trending Now Scraper](https://apify.com/scrapersdelight/google-trends-trending-now-scraper) - what people search right now, by country.

### Limits & empty runs

- **Existing answers only.** Perplexity Scraper reads answers that already exist (public threads, Discover). Perplexity answers every signed-out client's NEW question with "Sign up and repeat your request.", so this actor does not ask new questions.
- **Thread links must be public.** In a sample of 340 thread links found on the web, 209 were readable; the rest were private (52), not found (40), expired (16), deleted (7) or malformed (16) - all listed in `RUN_SUMMARY`, none charged.
- **Discover depth.** Each topic feed holds about 350-500 stories at a time (Top: 352, Tech: 498 on 2026-10-16). The feed edition follows the connection's region.
- **Speed.** 100 Discover stories with article text in about 15-20 seconds; 1,000 in about 1.5-2 minutes.
- An empty run (only private or deleted links, or filters that match nothing) is never charged.

### ❓ FAQ

#### How much does Perplexity Scraper cost?

$0.0045 per delivered result, no start fee. A 100-result run is $0.45. Filtered, private, deleted and unchanged results cost nothing.

#### Can Perplexity Scraper ask Perplexity a new question?

No. Perplexity only answers new questions for signed-in or browser-verified visitors. Perplexity Scraper reads public answers that already exist: shared threads and Discover.

#### How many results can Perplexity Scraper return per run?

As many as you ask for: every answer of every public thread you paste, and up to about 350-500 stories per Discover topic.

#### Does Perplexity Scraper return follow-up questions in a thread?

Yes. Each follow-up answer is its own row with `entryIndex`, `entryCount` and `isFollowUp`; switch `includeFollowUps` off for the first answer only.

#### Can I track my brand's visibility in Perplexity with Perplexity Scraper?

Yes. Put your brand and competitors in `checkBrands`; each row reports `mentionCount`, `mentionedInAnswer`, `firstMentionAtChar`, `citedAsSource` and the `sourcePositions` of your own site.

#### Can I schedule Perplexity Scraper to monitor Perplexity Discover?

Yes. Turn on `monitorMode` and schedule the run; it delivers only stories (or thread answers) that earlier runs did not deliver, or that were updated since.

#### Can I use Perplexity Scraper with the Apify API or an MCP server?

Yes - call it from any language through the Apify API, or add it to your AI assistant from the MCP tab.

#### Do I need a Perplexity account, cookies or an API key?

No. Perplexity Scraper reads public pages without a login and needs no Perplexity API key.

#### Why did my Perplexity Scraper run return fewer results than I asked for?

A thread link may be private, deleted or expired (see `RUN_SUMMARY`), your filters may have dropped results, or a Discover topic may hold fewer matching stories than `maxResults`.

#### Your feedback

Found a bug or missing a field? Open an issue on the [Issues tab](https://apify.com/scrapersdelight/perplexity-search-scraper/issues/open) and we will fix it.

# Actor input Schema

## `urls` (type: `array`):

Public thread URLs (perplexity.ai/search/...), Discover story or Page URLs (perplexity.ai/discover/tech/..., perplexity.ai/page/...), Discover topic URLs, or bare slugs. Private or deleted threads are skipped and never charged.

## `discoverTopics` (type: `array`):

Perplexity Discover feeds to read, newest stories first. Leave empty to read only the URLs above (with no URLs either, the Top feed is read).

## `includeFollowUps` (type: `boolean`):

On: one row per answer in a thread (the first question and every follow-up). Off: only the thread's first answer.

## `sortBy` (type: `string`):

Order of Discover stories. Any order other than the feed's own reads the whole feed window first (up to 1,000 stories per topic).

## `includeKeywords` (type: `array`):

Keep only results that mention at least one of these words (case-insensitive). Threads: the question and answer. Discover: title, summary, description and key points. e.g. "AI", "Nvidia".

## `excludeKeywords` (type: `array`):

Drop results that mention any of these words (case-insensitive), checked on the same text as above. e.g. "rumor".

## `minSourceCount` (type: `integer`):

Keep only answers / stories that cite at least this many sources. 0 = no minimum.

## `publishedAfter` (type: `string`):

Keep only stories published (answers created) on or after this date, e.g. 2026-10-01. Pairs well with a daily schedule.

## `publishedBefore` (type: `string`):

Keep only stories published (answers created) on or before this date, e.g. 2026-10-31.

## `includeArticleText` (type: `boolean`):

Discover stories: read each story's article page for the full text, every section and every cited source. Same price per story; turn off for cards only (faster).

## `checkBrands` (type: `array`):

Brand or product names to look for. Each row gets mention count, whether the answer names it, the first mention position and whether a cited source is the brand's own site. e.g. "HubSpot", "Salesforce".

## `monitorMode` (type: `boolean`):

Deliver only stories / answers not delivered by an earlier run with the same input (or updated since). Pairs with a daily schedule; unchanged results are never charged.

## `monitorKey` (type: `string`):

Optional name for the monitor's memory, so several schedules with different inputs keep separate histories. Empty = derived from the input.

## `maxResults` (type: `integer`):

Most rows delivered in this run (thread answers + Discover stories). Each Discover topic holds about 350-500+ stories. 0 = no limit.

## `maxResultsPerTopic` (type: `integer`):

Cap per Discover topic when several are picked. 0 = no per-topic cap.

## `compact` (type: `boolean`):

Core fields only (question/title, answer or article text, source titles and URLs, related questions) - trimmed for AI / MCP pipelines.

## `proxyConfiguration` (type: `object`):

Not needed: the actor connects directly and falls back to a residential proxy on its own (included in the price). Your own proxy URLs are used first if you add them.

## `maxConcurrency` (type: `integer`):

How many threads / articles are read at the same time.

## Actor input object example

```json
{
  "urls": [
    "https://www.perplexity.ai/search/europe-has-more-heat-deaths-pe-BDS6xdorS4.4x2WrCC9mAQ"
  ],
  "discoverTopics": [
    "top"
  ],
  "includeFollowUps": true,
  "sortBy": "feedOrder",
  "minSourceCount": 0,
  "includeArticleText": true,
  "monitorMode": false,
  "maxResults": 10,
  "maxResultsPerTopic": 0,
  "compact": false,
  "proxyConfiguration": {
    "useApifyProxy": false
  },
  "maxConcurrency": 5
}
```

# Actor output Schema

## `results` (type: `string`):

One item per thread answer (question, answer, sources, related questions, search steps, model) or per Discover story (card, article text, sources).

## `summary` (type: `string`):

Per-input status (delivered, private, not found, deleted), Discover pages read, filtered and unchanged counts, and transport stats.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "urls": [
        "https://www.perplexity.ai/search/europe-has-more-heat-deaths-pe-BDS6xdorS4.4x2WrCC9mAQ"
    ],
    "discoverTopics": [
        "top"
    ],
    "maxResults": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("scrapersdelight/perplexity-search-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "urls": ["https://www.perplexity.ai/search/europe-has-more-heat-deaths-pe-BDS6xdorS4.4x2WrCC9mAQ"],
    "discoverTopics": ["top"],
    "maxResults": 10,
}

# Run the Actor and wait for it to finish
run = client.actor("scrapersdelight/perplexity-search-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "urls": [
    "https://www.perplexity.ai/search/europe-has-more-heat-deaths-pe-BDS6xdorS4.4x2WrCC9mAQ"
  ],
  "discoverTopics": [
    "top"
  ],
  "maxResults": 10
}' |
apify call scrapersdelight/perplexity-search-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,scrapersdelight/perplexity-search-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/CN1Pco4qWxvzPaAMe/builds/v73yLII26FB4qxv6q/openapi.json
