Ultimate Crunchbase Search Scraper avatar
Ultimate Crunchbase Search Scraper
Try for free

1 day trial then $30.00/month - No credit card required now

View all Actors
Ultimate Crunchbase Search Scraper

Ultimate Crunchbase Search Scraper

curious_coder/crunchbase-scraper
Try for free

1 day trial then $30.00/month - No credit card required now

Scrape Crunchbase companies, people, investors, acquisitions, etc from Crunchbase search results. Has 99% success rate

FL

Finishes with scrape "SUCCEEDED" but it's not

Closed

flash01694 opened this issue
4 months ago

I am running a crunchbase scrape with 70k+ records, but after 10k records it finishes the run and restarting actor doesn't help because it says :

Error: Actor run has already finished with status "SUCCEEDED".

how do I fix this?

curious_coder avatar

Thanks for opening the issue, Let me check and get back to you

FL

flash01694

4 months ago

Any luck? if I enter Cruncbase from the GUI it prompts me with a sort of captcha. If I solve it sometimes the scraper starts working again but just for a couple of thousands more companies and that's it. Above 10k results it just doesn't work

FL

flash01694

4 months ago

If I check my CB profile after the scraping stops, my auth cookie is no longer valid and I need to log back in again and provide a new cookie to start scraping again. But since I cannot change the auth cookie in the previous run, I need to start a new run which starts again from scratch (the Start from cursor option doesn't work, it still starts from scratch)

curious_coder avatar

You don't get more than 1k results from crunchbase. anything above that is not guaranteed

FL

flash01694

4 months ago

I understand, however it is very difficult to debug it if it says "Succeded" when it is not. Do you have any workarounds to scrape big search results? like 10k +

I tried using the start from cursor option by inputing the following parameter from a previous run: Storage >> State >> cursor . e.g. 0d34d483-c7e8-1c49-7014-028c9acf6c5f

but it still starts from scratch, any thoughts?

curious_coder avatar

Not yet, Will send email if there are any updates.

Developer
Maintained by Community
Actor metrics
  • 92 monthly users
  • 4 stars
  • 33.6% runs succeeded
  • 6.2 days response time
  • Created in Jun 2023
  • Modified 5 days ago