Quora Search Results Scraper and/or Question-Answers Scraper avatar

Quora Search Results Scraper and/or Question-Answers Scraper

Try for free

1 day trial then $19.00/month - No credit card required now

Go to Store
Quora Search Results Scraper and/or Question-Answers Scraper

Quora Search Results Scraper and/or Question-Answers Scraper

memo23/quora-scraper-with-optional-login
Try for free

1 day trial then $19.00/month - No credit card required now

Unlock the power of Quora! This scraper dives deep into search results, extracting questions, answers, and vital engagement metrics. Gain invaluable insights, save research time, and tap into the collective knowledge of experts and enthusiasts across countless topics.

FV

No answers scraped..

Closed

fascinated_vault opened this issue
3 months ago

With this configuration, I wanted to scrap all answers of all the questions (the list of the URLs). But after trying lots of times and waiting forever, no thing returned...

memo23 avatar

hey, I'll check what is going, can you try with only one link?

FV

fascinated_vault

3 months ago

Hi, thanks for yr prompt response. I have tried multiple times for both one and many links. Only one time with one link worked. It seems the concurrency is not the main problem here. 🤯

memo23 avatar

hey, I made some changes try to give fewer links when you run it, otherwise, quora can block you or sing you out when you have over 100 links or so...

FV

fascinated_vault

3 months ago

hey, thank you for the update. I tried again for 50 URLs. The log shows "PuppeteerCrawler: Crawled 8/50 pages, 0 failed requests, desired concurrency 1.", but there is 0 result for the crawled 8 pages. Seem still something wrong..

memo23 avatar

it is browser automation based so it needs time to grab some information for future request, try only 5 links for start...

OA

orange_arpeggio

3 months ago

Thanks! I have tried to reduce it to 20 links for each time, and it worked. I would suggest you to modify the code to directly limit the concurrency to around 20.

memo23 avatar

nice, I'll see to upgrade it

memo23 avatar

hey mate, made some changes, when you have time give it a test

Developer
Maintained by Community

Actor Metrics

  • 8 monthly users

  • 5 stars

  • >99% runs succeeded

  • 8.3 hours response time

  • Created in Jan 2024

  • Modified a month ago