Quora Questions & Answers Scraper
Pricing
Pay per event
Scrape Quora question pages by URL, topic, or keyword. Get question text, topic tags, and answer bodies with author, upvotes, and timestamps. Public pages only, no login or Quora+ required.
Pricing
Pay per event
Rating
0.0
(0)
Developer
DevilScrapes
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
a day ago
Last modified
Categories
Share
Cloud QA on build 0.2.2 reached SUCCEEDED with 3 real rows (run
5A12dw3zifEfsU6R5) — the first genuinely working cloud run — but
eyeballing the dataset found two silent data-quality bugs the parser
tests hadn't caught because the earlier fixture's structure was
simplified in a way that hid them:
![Quora: Questions, Answers & Topics by Search or URL [No Login] avatar](https://images.apifyusercontent.com/jcmeEFEdl2d_w5gWshcbtupsNp8tn7V6V5nKFiD1Dr0/rs:fill:76:76/cb:1/aHR0cHM6Ly9hcGlmeS1pbWFnZS11cGxvYWRzLXByb2QuczMudXMtZWFzdC0xLmFtYXpvbmF3cy5jb20vbmduOHZSRVNUa3NleVdFNnAtYWN0b3ItU2xsNnBCY0JIbEZuaG9QUmgtdjR0enRsajEyNi1RdW9yYS1Mb2dvLVJlZC1JY29uLVNvY2lhbC1NZWRpYS1QbGF0Zm9ybS03Njh4NzY4LndlYnA.webp){kind=avatar}
answer_author_name shipped as "" on every row. Each answer card
actually carries TWO a[href*="/profile/"] links — a document-order-
first avatar-only link with empty text, then the name-bearing link.
css_first always grabbed the avatar. New _author_link_with_name
prefers whichever profile link actually has visible text.answer_upvotes was None on every row. The upvote button does
NOT live inside the same ancestor as the profile link — it sits TWO
levels further out. _answer_card_ancestor required only a profile
link, so it returned a scope too small to ever contain the upvote
button. It now requires BOTH a profile link and the upvote button
before accepting an ancestor as the answer's card.tests/fixtures/question_page.real_structure.html rebuilt to actually
reproduce both structural facts (two profile links, upvote button two
levels out) instead of the simplified single-level card the previous
fixture used — which is exactly why these two bugs passed local tests
but failed on real data. New assertions lock in the real author name
and upvote count. 67 tests green, ruff clean, pyright clean.Root cause of the 0/0 rows that closed out 2026-08-30's investigation:
0.1.3's cloud run (P4dbLhqPt6uFChk1l) confirmed Camoufox clears
Quora's Cloudflare challenge, but the JSON-LD-primary parser design in
design.md turned out to be a wrong guess — it just failed silently
instead of loudly (question parsed via H1, suggestedAnswer empty, 0
answer rows, run correctly failed loud on REQ-6 rather than reporting a
hollow success).
Ground-truthed against a REAL page this time (src/recon_capture.py,
a one-off Camoufox cloud capture persisted to KVS — see
docs/specs/quora-questions-scraper/notes.md):
__NEXT_DATA__, no usable data island exists on the
real render. window.ansFrontendGlobals only carries page config,
never question/answer content. The question and every answer are
plain DOM.puppeteer_test_* classes are the stable target —
test hooks the site ships for its own end-to-end tests, present on
the question title (puppeteer_test_question_title) and every answer
body (puppeteer_test_answer_content), unlike the surrounding
CSS-in-JS classes (s1e38h8g etc.) which are hashed and unusable.
src/parser.py's extraction priority is now: test-id CSS (primary,
ground-truthed) → JSON-LD (secondary, kept for resilience) → bare H1
_split_truncated now prefers the text after the marker, and
only falls back to "before + truncated=True" when nothing follows
(the genuinely login-gated case, still covered by the existing
question_page_gated.synthetic.html fixture).visibility--hidden ghost span (a width placeholder) plus the real
visible span, both inside the same button. Reading all <span>
text concatenated them into a garbled number (9953 instead of the
real 53, confirmed against the recon capture). _extract_upvotes
now skips the hidden span.ANSWER_CARD_SEARCH_DEPTH = 6)
that links to an author profile. An unbounded walk on the real recon
page mis-attributed a "related answers" section's author to an
unrelated answer further up the page; bounding the search means that
case now correctly returns None for those fields while still
emitting the real answer text — a partial row, never a dropped one.tests/fixtures/question_page.real_structure.html models
the real recon structure (not a byte-for-byte copy — trimmed for repo
size) and 3 new tests in tests/test_parser.py cover the primary path,
the full-text-after-marker behaviour, and the bounded-ancestor-search
fault isolation. 66 tests green (was 63), ruff clean, pyright clean..actor/pay_per_event.json (actor-start: $0.20, result-scraped: $0.002Second bug, found by cloud QA on build 0.2.1 (run JeBdVCVejlO6YWFvC,
FAILED): Camoufox cleared the Cloudflare challenge (status=200) but the
parser STILL found no title — a genuine hydration race, not a selector bug.
page.content() was captured right after wait_until="domcontentloaded" +
a fixed 1.5s sleep; Quora's Relay app (10+ webpack chunks) doesn't always
finish rendering the question/answer DOM in that window, even though the
same wait pattern happened to work during the manual recon capture.
src/browser.py::fetch_page now waits (best-effort, h1 marker, 8s cap,
never raises) for the page to actually hydrate before reading content() —
_wait_for_hydration. A timeout just means proceed with whatever DOM
exists; the parser layer still decides whether that's enough. 1 new test
(test_fetch_page_swallows_hydration_timeout_and_still_returns_html,
67 total). Pushed as build 0.2.2.
Root cause of all 12/12 cloud FAILED runs, found by reading the actual
platform run logs (P4oObkxiIk9z7OdHw, then a fresh reproduction on build
0.0.2 — run ncnbKI3rjyndmAav5) instead of trusting the 2026-08-27
UNPROVEN writeup:
main but the account was over its usage cap
from 2026-08-27 through 2026-08-29, so apify push never ran — every
cloud run still executed the OLD build (0.0.1, datacenter proxy, no
Camoufox path). Re-pushed as build 0.0.2 now that the cap is lifted
($80 ceiling, $41.37 used).ncnbKI3rjyndmAav5 showed curl-cffi rotate through 4 browser
profiles: 3 hit Cloudflare's managed challenge (cf-mitigated: challenge
/ "Just a moment"), but the 4th (safari180) got a bare 200 that
triggers neither the challenge nor geo-splash marker — confirmed by local
reproduction (RESIDENTIAL, US-pinned) that Quora served an un-hydrated
React/Relay shell (<noscript>Please enable Javascript..., an og:title
present but no server-rendered H1 or JSON-LD). Because the escalation to
Camoufox only fired on ChallengeExhaustedError, that "successful" shell
response never reached the browser engine, and the run died on a raw
parse error instead of ever trying the engine that executes JS.
src/main.py's _fetch_html now returns (html, used_browser);
_process_question routes a curl-cffi parse failure through one
Camoufox retry (_retry_parse_via_browser) before giving up. A parse
failure on browser-rendered HTML still fails outright — the content
genuinely isn't there at that point. 3 new/updated tests in
tests/test_main.py.Ignored attempt to charge for an event — the Actor does not use the pay-per-event pricing.actor/pay_per_event.json + Actor.charge() calls in src/main.py)
is already correct and unchanged; activating PPE on the Apify Console
Monetization tab is a publish-time action out of this fix's scope..actor/actor.json version bumped 0.0 → 0.1 to match this
CHANGELOG's numbering (the 0.1.0 entry never actually bumped it).docs/specs/quora-questions-scraper/notes.md for the full
Camoufox-vs-Cloudflare probe results (local + cloud, run IDs and
billing-confirmed PROXY_RESIDENTIAL_TRANSFER_GBYTES).Prepared on a day the Apify account is over its monthly usage hard limit; every fix below is local-green but not yet verified against the live target or the platform. Two defects, both real:
.actor/pay_per_event.json set actor-start to $0.02
against the fleet standard of $0.20 (set 2026-08-20). The Actor was never
published, so this changes freely — README + scaffold.json synced to the
new effective rate, $2.20 / 1,000 results (result-scraped unchanged
at $0.002).auto (datacenter); Quora's Cloudflare
managed challenge does not clear on it (confirmed by run
P4oObkxiIk9z7OdHw: challenge detected on attempt 0). proxyConfiguration
now defaults to apifyProxyGroups: ["RESIDENTIAL"] in both
.actor/input_schema.json (prefill + default) and src/models.py.
proxyCountryCode also gained a prefill (was default-only).cf-mitigated: challenge + a
"Just a moment" body. Added a Camoufox escalation path
(src/browser.py + src/browser_fetch.py) that main.py reaches for
only after curl-cffi's QuoraSession exhausts retries against a real
challenge — curl-cffi stays the cheap default for everything else.src/client.py now tallies every retry attempt's
outcome instead of just the last one, and raises a new
NetworkExhaustedError distinct from ChallengeExhaustedError — run
P4oObkxiIk9z7OdHw mixed 2 real 30s connect timeouts among 3 challenge
hits, and the old code's final exception erased that mix.parser.py
(behavior-preserving) while getting to local-green..actor/Dockerfile → apify/actor-python-playwright:3.11 +
python -m camoufox fetch. actor.json memory 512→2048 default (min
1024, max 4096). pyproject.toml adds camoufox[geoip] + playwright.apify push — forbidden today by the usage cap. See notes.md for the
exact replay sequence for cap-lift day..actor/ (actor.json, input/output/dataset schemas,
pay_per_event.json, Dockerfile), src/__init__.py + src/__main__.py,
tests/conftest.py + tests/fixtures/input.qa.json, pyproject.toml,
.actorignore, scaffold.json, and a generated README.md
(10 canonical H2 sections, ≥3 KB, no forbidden voice phrases).icon.svg deferred to the actor-icon-designer agent (not authored
here per hard rule).src/models.py, src/client.py, src/parser.py, src/discovery.py,
src/main.py, src/scraper.py, src/recon_cloud.py are not yet
implemented — see docs/specs/quora-questions-scraper/tasks.md
T02-T09. python -m src will fail with ModuleNotFoundError until
T09 lands src/main.py; this is the intended task boundary, not a
scaffolding defect.