Ultimate Crunchbase Search Scraper
Pricing
$30.00/month + usage
Ultimate Crunchbase Search Scraper
Scrape Crunchbase companies, people, investors, acquisitions, etc from Crunchbase search results. Has 99% success rate
2.6 (2)
Pricing
$30.00/month + usage
28
Monthly users
205
Runs succeeded
88%
Response time
3.7 hours
Last modified
2 months ago
Having problems with input
Closed
Hello, I would like to scrape about 1000 companies, but I was not able to input more than 100 values for one run. Im getting strange error:
2022-12-12T17:46:00.825Z INFO PlaywrightCrawler: Starting the crawl 2022-12-12T17:46:04.765Z INFO CRAWLER: -- Checking organizations: Gofore,Great Interactive Sp. z o.o.,Alameda Electrical Distributors & California Service Tool,moebel.de Einrichten & Wohnen GmbH,Bruce,Körber Pharma Software GmbH,NYM`... [line-too-long] 2022-12-12T17:46:04.767Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. SyntaxError: Unexpected token U in JSON at position 0 2022-12-12T17:46:04.769Z at JSON.parse () 2022-12-12T17:46:04.770Z at file:///home/myuser/src/routes.js:16:31 2022-12-12T17:46:04.771Z at func (/home/myuser/node_modules/@crawlee/core/router.js:155:44) 2022-12-12T17:46:04.774Z at PlaywrightCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:58:15) 2022-12-12T17:46:04.776Z at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:52:21) {"id":"nlRDPgVZukrAl7r","url":"https://www.crunchbase.com/robots.txt","retryCount":1} 2022-12-12T17:46:05.801Z ACTOR: The actor run was aborted by the user.
When I limit the input to 100 items, the scraper will start but takes only about 25 items. There are issues with Crunchbase bot detection indeed, but does not seem to be fatal. However, the run will take up to 25 items. NOTE Im on trial period a... [trimmed]
tugkan
Hey apftest!
Thank you very much for sending the issue. If possible, can you please give us a RunID so that we can investigate the details of the problem?
Best
apf_test
Hello, sure:
FAILED UjOs62L8VQPMNHUCx u7ow0BwtPToz1ROx3 Ovlgqyw7hqO28KBOI
SUCCESS, but limited yakRcbzqKAjQVu50z
tugkan
Hey Apftest!
Sorry for the late response, unfortunately, our investigation took more time than we expected. After our analysis, we found out that the number of characters in the search keywords you are providing is exceeding the standard HTTP URI limitation on the APIs. Meaning that if you can provide fewer keywords (10-15 per each search) the actor will work well.
Please let us know if there is anything that we can do about the current problem. Best
apf_test
Thanks for reply.
I have entered characters (keywords) by form (values separated by line-break), not by API. I have about 1-4 keywords per organization (just the name), and thousands of organizations.
How should I enter the values correctly?
tugkan
Hey apftest,
It would be better to split your search into multiple chunks preferably by organization. However, if you think that splitting your search keywords into multiple chunks automatically by the actor works - we can implement that change as well.
Please let us know what you think, Best
apf_test
Hello, can I contact you directly? Thx...
tugkan
Pricing
Pricing model
RentalTo use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.
Free trial
1 day
Price
$30.00
