Quora Search Results Scraper and/or Question-Answers Scraper
Pricing
$19.00/month + usage
Quora Search Results Scraper and/or Question-Answers Scraper
Unlock the power of Quora! This scraper dives deep into search results, extracting questions, answers, and vital engagement metrics. Gain invaluable insights, save research time, and tap into the collective knowledge of experts and enthusiasts across countless topics.
0.0 (0)
Pricing
$19.00/month + usage
7
Total users
86
Monthly users
10
Runs succeeded
>99%
Response time
3.9 hours
Last modified
3 months ago
No answers scraped..
Closed
With this configuration, I wanted to scrap all answers of all the questions (the list of the URLs). But after trying lots of times and waiting forever, no thing returned...
hey, I'll check what is going, can you try with only one link?
fascinated_vault
Hi, thanks for yr prompt response. I have tried multiple times for both one and many links. Only one time with one link worked. It seems the concurrency is not the main problem here. 🤯
hey, I made some changes try to give fewer links when you run it, otherwise, quora can block you or sing you out when you have over 100 links or so...
fascinated_vault
hey, thank you for the update. I tried again for 50 URLs. The log shows "PuppeteerCrawler: Crawled 8/50 pages, 0 failed requests, desired concurrency 1.", but there is 0 result for the crawled 8 pages. Seem still something wrong..
it is browser automation based so it needs time to grab some information for future request, try only 5 links for start...
orange_arpeggio
Thanks! I have tried to reduce it to 20 links for each time, and it worked. I would suggest you to modify the code to directly limit the concurrency to around 20.
nice, I'll see to upgrade it
hey mate, made some changes, when you have time give it a test
