2 days trial then $29.00/month - No credit card required now
🔥 Linkedin Companies & Profiles Bulk Scraper
2 days trial then $29.00/month - No credit card required now
Companies & Profiles Linkedin scraper. Get comprehensive profiles of individuals and companies based on your keywords and filters. Unleash the power of data! 🌐🔍
Get keywords in output
Open
I am lanching the linkedin scrapper api using Python code. When I export the results (csv), I only have the outputs of the scrapper , not the input keywords. I need to link the outputs to the keywords given in input (to know which outputs corresponds to each of the input keys). How can I do that?
changeable_jigsaw
def get_input_paramters_for_run(self, actor_run_id): actor_run_details = self.client.run(actor_run_id).get() default_key_value_store_id = actor_run_details.get('defaultKeyValueStoreId') # actor_id = actor_run_details.get('actId')
1if default_key_value_store_id: 2 # Use the default key-value store ID to retrieve the input 3 input_record = self.client.key_value_store(default_key_value_store_id).get_record('INPUT') 4 input_parameters = input_record.get('value') 5 6 print('Input parameters:', input_parameters) 7 return input_parameters 8 else: 9 print('No default key-value store ID found for this actor run.') 10 return []
changeable_jigsaw
had the same issue, i retrieved the input URLs via above method and matched them my self. if the crawler doesnt have any mistakes, entries are in the same order. in case there are errors you have to manually match input/output. i am basically using the log as a basis for that.
log = self.client.log(actor_run_id).get() error_pattern = re.compile(r"ERROR.*identifier (\S+)")
changeable_jigsaw
besides everything it would be a highly appreciated feature, to include the input URL into the record @bebity
Okay, we've just added it to the to-do list. We will comment here once it's done.
Regards
Bebity- 240 monthly users
- 98.2% runs succeeded
- 27 days response time
- Created in Jul 2023
- Modified 9 days ago
