🔥 Linkedin Companies & Profiles Bulk Scraper
2 days trial then $29.00/month - No credit card required now
🔥 Linkedin Companies & Profiles Bulk Scraper
2 days trial then $29.00/month - No credit card required now
Companies & Profiles Linkedin scraper. Get comprehensive profiles of individuals and companies based on your keywords and filters. Unleash the power of data! 🌐🔍
I am lanching the linkedin scrapper api using Python code. When I export the results (csv), I only have the outputs of the scrapper , not the input keywords. I need to link the outputs to the keywords given in input (to know which outputs corresponds to each of the input keys). How can I do that?
def get_input_paramters_for_run(self, actor_run_id): actor_run_details = self.client.run(actor_run_id).get() default_key_value_store_id = actor_run_details.get('defaultKeyValueStoreId') # actor_id = actor_run_details.get('actId')
1if default_key_value_store_id: 2 # Use the default key-value store ID to retrieve the input 3 input_record = self.client.key_value_store(default_key_value_store_id).get_record('INPUT') 4 input_parameters = input_record.get('value') 5 6 print('Input parameters:', input_parameters) 7 return input_parameters 8 else: 9 print('No default key-value store ID found for this actor run.') 10 return []
had the same issue, i retrieved the input URLs via above method and matched them my self. if the crawler doesnt have any mistakes, entries are in the same order. in case there are errors you have to manually match input/output. i am basically using the log as a basis for that.
log = self.client.log(actor_run_id).get() error_pattern = re.compile(r"ERROR.*identifier (\S+)")
besides everything it would be a highly appreciated feature, to include the input URL into the record @bebity
Okay, we've just added it to the to-do list. We will comment here once it's done.
Regards
Actor Metrics
473 monthly users
-
80 stars
>99% runs succeeded
23 days response time
Created in Jul 2023
Modified 4 days ago