Ultimate Crunchbase Search Scraper
Pricing
$30.00/month + usage
Ultimate Crunchbase Search Scraper
Scrape Crunchbase companies, people, investors, acquisitions, etc from Crunchbase search results. Has 99% success rate
3.6 (3)
Pricing
$30.00/month + usage
34
Total users
1.8k
Monthly users
247
Runs succeeded
90%
Issue response
4.8 hours
Last modified
3 months ago
Recursive scraping?
Closed
I am only able to retrieve about 25 results.
I would like to recursively crawl to some depth.
Optionally, it would be nice to restrict only to URLs that have "organization" somewhere in the url.
e.g. https://www.crunchbase.com/search/organizations/field/organizations/categories/artificial-intelligence https://www.crunchbase.com/organization/builderai
tugkan_epctex
Hey Mackie,
Thank you very much for reaching out and sorry for the late response. I was checking your use case and it seems you got blocked by Crunchbase itself. Whenever you search multiple terms through Crunchbase "search", it puts them sequentially and tries to search all of them at once. However, the public usage of Crunchbase only allows 25 items per single search. My suggestion is for you to split your runs into 4 and add only one keyword for each.
About the organization filtering, I will talk with the Engineering team and let you know about the updates for future development. We just added it to our roadmap.
Best
bravura
Thanks. I'm happy to do 4 runs. But what I really need is organization crawls recursively, since the search results don't return much.
tugkan_epctex
Hey there,
Thank you very much for your request. Actually, the actor first gets the search result and then hits for organization information recursively. So the data you are retrieving is the recursive version of the data retrieval. The log that says: "Fetching organization: " only shows up on the recursive crawls.
The information you are seeking might not enough for you but since we are retrieving the data directly from their API, that is all we can take from their public website.
Best
