3 days trial then $30.00/month - No credit card required now

Linkedin post scraper

curious_coder/linkedin-post-search-scraper

3 days trial then $30.00/month - No credit card required now

Scrape linkedin posts or updates from linkedin post search results. Supports advanced linkedin search filters. Extract posts from any linkedin member

Back to issues Create new issue

"Issue with LinkedIn Scraper: Handling Cookies and Authentication in Local VSCode Environment"

Closed

likedinscraper opened this issue

I successfully ran the LinkedIn scraper in the Apify environment, and it returned the correct JSON data. However, I am having trouble replicating the same results in my local VSCode environment.

In the Apify environment, everything worked fine, but when I try to execute the script locally, I am unsure where to place my authentication token (or which token is required). Specifically, I’m unclear on how to pass the necessary cookies and authentication data into the request when running the scraper locally.

I’ve reviewed the documentation, but I wasn’t able to figure out how to handle the cookies and token integration in the local environment. Could you please provide guidance on what token to use, where it should be placed, and how to handle the authentication for LinkedIn scraping?

here is my code:

from apify_client import ApifyClient

Replace '<YOUR_API_TOKEN>' with your Apify API token

client = ApifyClient("<YOUR_API_TOKEN>")

Prepare the input for the Actor, with your LinkedIn URLs

run_input = { "urls": [ "https://www.linkedin.com/in/ginoolivares/recent-activity/all/", # Add more URLs for posts or profiles as needed ], "minDelay": 2, "maxDelay": 5, "proxy": { "useApifyProxy": True, "apifyProxyCountry": "BR", # Or adjust the country as needed }, # Here I tried to pass the cookies exported from the extension "cookies": [ { "name": "bcookie", "value": "<your_bc... [trimmed]

likedinscraper

I have already used the "Copy Cookies" extension, and it works perfectly when I paste the exported cookies into the Apify front-end. However, when I try to run the scraper locally in VSCode, I am not sure which of the cookies should be used and how exactly they should be passed in the code.

Could someone help me with the correct structure for the code to run the scraper locally?

Curious Coder (curious_coder)

You can switch to JSON tab on Apify actor input page to get correct payload for your API

Add comment

Developer

Curious Coder

Actor Metrics

479 monthly users
79 stars
93% runs succeeded
4.5 days response time
Created in Jun 2023
Modified 24 days ago

Categories

Social media

Other

Linkedin company scraper

curious_coder/linkedin-company-scraper

This linkedin company extractor program gives you all available information several companies in bulk including name, address, phone numbers, website, employee count, etc

Curious Coder

737

Instagram Scraper - All in one

curious_coder/instagram-scraper

Scrape instragram profiles, followers, posts, comments and get valuable information like email addresses, websites, post engagement insights, commented users, etc

Curious Coder

2.5k

Linkedin Posts Informations Scraper

saswave/linkedin-posts-informations-parser

Scrape linkedin posts from linkedin post search results, url post, company url or people url. Supports advanced linkedin search filters. Extract posts from any linkedin member. Linkedin scraper at scale.

SASWAVE

425

Linkedin post reactions scraper

curious_coder/linkedin-post-reactions-scraper

Scrape reactions or likes from linkedin post

Curious Coder

268

Linkedin Posts Reactions Scraper

saswave/linkedin-posts-interactions-parser

Extract people who comments, mentions and likes from linkedin post or article. Allows you to extract all interactions / reactions from a url. Input can be a /posts url or article url. Also provide a /company or /in url and it will parse multiple posts from the source (organic and promoted LinkedIn)

SASWAVE

146

LinkedIn Post Like Scraper (fullName, headline, urls etc...)

meetmagnet-owner/linkedin-post-like-scraper

Extract Likes with the following details from a LinkedIn post url : • FullName • Headline • LinkedIn URL • Content URL

MeetMagnet

Linkedin Post Creation Date Scraper

saswave/linkedin-post-creation-date-scraper

Quickly get at scale the creation date of any linkedin url post

SASWAVE

Linkedin Sales Navigator Scraper

curious_coder/linkedin-sales-navigator-search-scraper

Scrape Linkedin sales navigator search results, lists, new results, profiles to extract email, social media urls, company website, positions.

Curious Coder

1.9k

Linkedin comment scraper

curious_coder/linkedin-comment-scraper

Scrape comments from any linkedin post with following details: Comment text, Comment author details, Total Likes, Total replies, etc

Curious Coder

323

Bluesky Posts Scraper

lexis-solutions/bluesky-posts-scraper

The Apify Bluesky Posts Scraper allows a programmatic search for posts on Bluesky and the option to export to CSV, JSON, Excel, or integration with Zapier, Make, or any custom workflow.