Stack Overflow Scraper - Questions, Answers, Vote Count avatar

Stack Overflow Scraper - Questions, Answers, Vote Count

Pricing

from $1.10 / 1,000 questions

Go to Apify Store
Stack Overflow Scraper - Questions, Answers, Vote Count

Stack Overflow Scraper - Questions, Answers, Vote Count

Stack Overflow scraper for every Stack Exchange site: search by text or tag, fetch questions by id, sort by date, votes or activity, add the answers. Up to 2,500 per search. Official Stack Exchange API, so it never breaks. $2 per 1,000 questions.

Pricing

from $1.10 / 1,000 questions

Rating

0.0

(0)

Developer

Khandji Omar

Khandji Omar

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a day ago

Last modified

Share

Stack Overflow Scraper — Questions, Answers, Vote Count

Search Stack Overflow (or any Stack Exchange site) by keyword or tag and get every matching question with title, link, score, answer count, tags, author and date, plus the answers if you want them. Built on the official Stack Exchange API, so it does not break when the site changes.

Price: $2 per 1,000 questions ($0.002 per question). The first 10 results of every run are free.

The form is prefilled: press Start to see real rows in seconds.

Free tier — 10 results free on every run

The first 10 results of every run are free, on every run you ever make — not a one-off trial. Run it on your own subjects and see the real output before you are billed for a single result.

One guard: the free allowance never covers more than half of a run, so a run returning 6 results gets 3 free. That keeps the offer sustainable.

What it does

Run it once and get the full, current data as clean rows you can export to JSON, CSV or Excel, or pull through the API. Need only fresh data? Turn on monitorEnabled and schedule it: every later run returns only what is new or changed since the previous one, so you never re-download or re-pay for the same rows.

Why this scraper

  1. Try before you pay. The first 10 results of every run are free, on every run.
  2. Pay only for data delivered. Failed sources and failed inputs are never billed.
  3. Hard cost cap. Set maxTotalChargeUsd and a run can never cost more than you allow.
  4. Only-new mode. With monitorEnabled on a schedule, you get just the new or changed rows, plus a spike signal when volume suddenly jumps.
  5. Clean, normalized rows with the same field names every run, plus a RUN_SUMMARY.json — ready for spreadsheets, databases, n8n/Make/Zapier and AI agents (MCP).

Example input

{
"tags": [
"your-product",
"react"
],
"maxTotalChargeUsd": 1.0
}

This returns the full current data right away. To receive only what is new on a schedule, add "monitorEnabled": true: the first monitored run stores a free baseline, later runs return only new or changed rows. Pin a monitorId to keep separate targets from sharing state.

All input fields

Beyond tags, these fields are optional:

FieldWhat it does
searchTermsFull-text searches, e.g. pandas merge.
questionIdsSpecific questions, by number or link.
siteAny Stack Exchange site: stackoverflow (default), superuser, serverfault, askubuntu, math...
sortBynewest (default), votes, activity or relevance.
maxItemsQuestions per search, 1 to 2,500. Default 100.
includeAnswersAdd each question's answers (score, accepted flag, body, author). No extra charge.
dateFrom / dateToDate range, YYYY-MM-DD.
minScore / answeredOnlyQuality filters.
apiKeyOptional: your own free Stack Apps key, for very large runs (10,000 calls a day instead of about 300).

A single word in tags is read as a tag (python); a phrase is read as a text search.

Output

Each row is a normalized record: record_id, query_id, title, url, author, published_at, score, text. A RUN_SUMMARY.json accompanies every run with the aggregated signal (counts, velocity spikes, trend).

Each row also keeps the fields the source itself returns (for example extra details, counts and links), so you get everything the source shows plus the normalized columns above.

How you're charged

  • Question — $0.002 per question ($2 per 1,000), billed for each question delivered to your dataset. With scheduled monitoring on, only questions that are new since the last check are delivered and billed.
  • Scheduled monitoring check ($0.002) — only when you turn on scheduled monitoring (monitorEnabled), once per target per run, and only when the source responded. One-off runs never pay it: you pay only per result.
  • A quiet monitored run bills only the source check ($0.002), never the result price.

How to use it in 3 steps

  1. Click Try for free and fill in Stack Overflow tags (tags).
  2. Optional: adjust the other fields; every one has a description and a sensible default.
  3. Click Start and download the results as JSON, CSV or Excel, or read them from the API.

Use cases

  • Developer research
  • Docs gaps
  • Community insight

Use it from code (API)

Every Apify Actor is an API. Start a run and read the results with one call.

Python

from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("om_kh/stack-overflow-scraper").call(run_input={"tags": ["your-product", "react"]})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)

JavaScript

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: '<YOUR_APIFY_TOKEN>' });
const run = await client.actor('om_kh/stack-overflow-scraper').call({
"tags": [
"your-product",
"react"
]
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

One HTTP call (cURL) — runs the Actor and returns the dataset in the same response:

curl -X POST "https://api.apify.com/v2/acts/om_kh~stack-overflow-scraper/run-sync-get-dataset-items?token=<YOUR_APIFY_TOKEN>" \
-H "Content-Type: application/json" \
-d '{"tags": ["your-product", "react"]}'

Integrations: n8n, Make, Zapier, Google Sheets

  • n8n — the official Apify node, operation Run Actor and get dataset, Actor om_kh/stack-overflow-scraper.
  • Make — Apify › Run an Actor, then Apify › Get Dataset Items.
  • Zapier — Apify › Run Actor; map the dataset items into your next step.
  • Google Sheets, webhooks, Slack — add an integration from the Integrations tab of this Actor.
  • Schedules — run it every hour or day from Schedules in Apify Console.

Use it from an AI agent (MCP and x402)

Connect Claude Desktop, Cursor, VS Code or any MCP client to Apify's MCP server at https://mcp.apify.com and add this Actor, om_kh/stack-overflow-scraper, as a tool — the agent passes the same JSON as the run input and gets the dataset back.

AI agents that pay with x402 can run it too, without an Apify account: the Actor charges only per result delivered, so an agent pays exactly for what it gets.

FAQ

Is it legal to scrape Stack Overflow? This Actor collects only publicly available Stack Overflow data and never logs in. You are responsible for how you use it; check Stack Overflow's terms and your local law (GDPR, CCPA) if you store personal data, and ask a lawyer if unsure.

Do I need an account, cookies or an API key? No. You only need an Apify account to run it.

What data do I get? Questions with title, score, answers count, tags and link. Download it as JSON, CSV, Excel, HTML or XML, or read it from the API.

Am I charged when something fails? No. An input that fails is listed with its reason in the run summary and is never charged.

Can I run it on a schedule? Yes. Create a schedule in Apify Console (hourly, daily, weekly) and connect webhooks, Google Sheets, Slack, n8n, Make or Zapier.

Can I use it from Python, JavaScript or an AI agent? Yes: see the code samples above, or connect AI agents through MCP with the stackoverflow_search tool.

Your feedback

Did this Actor save you time? A short review on the Reviews tab helps other people find it, and every review is read. Something missing or broken? Open an issue on the Issues tab: it is answered and fixed fast.

More Actors from the same author

Support

Found a bug or have a feature request? Use the Issues tab on this Actor's Apify Store page, or message the author (om_kh) directly through Apify — every report gets a reply.