Quora Search Results Scraper and/or Question-Answers Scraper
1 day trial then $19.00/month - No credit card required now
Quora Search Results Scraper and/or Question-Answers Scraper
1 day trial then $19.00/month - No credit card required now
Unlock the power of Quora! This scraper dives deep into search results, extracting questions, answers, and vital engagement metrics. Gain invaluable insights, save research time, and tap into the collective knowledge of experts and enthusiasts across countless topics.
No answers scraped..
Closed
With this configuration, I wanted to scrap all answers of all the questions (the list of the URLs). But after trying lots of times and waiting forever, no thing returned...
hey, I'll check what is going, can you try with only one link?
fascinated_vault
Hi, thanks for yr prompt response. I have tried multiple times for both one and many links. Only one time with one link worked. It seems the concurrency is not the main problem here. 🤯
hey, I made some changes try to give fewer links when you run it, otherwise, quora can block you or sing you out when you have over 100 links or so...
fascinated_vault
hey, thank you for the update. I tried again for 50 URLs. The log shows "PuppeteerCrawler: Crawled 8/50 pages, 0 failed requests, desired concurrency 1.", but there is 0 result for the crawled 8 pages. Seem still something wrong..
it is browser automation based so it needs time to grab some information for future request, try only 5 links for start...
orange_arpeggio
Thanks! I have tried to reduce it to 20 links for each time, and it worked. I would suggest you to modify the code to directly limit the concurrency to around 20.
nice, I'll see to upgrade it
hey mate, made some changes, when you have time give it a test
Muhamed DidovicActor Metrics
6 monthly users
-
7 stars
>99% runs succeeded
Created in Jan 2024
Modified 18 days ago
