Linkedin Posts Informations Scraper avatar

Linkedin Posts Informations Scraper

Try for free

3 days trial then $30.00/month - No credit card required now

View all Actors
Linkedin Posts Informations Scraper

Linkedin Posts Informations Scraper

saswave/linkedin-posts-informations-parser
Try for free

3 days trial then $30.00/month - No credit card required now

Scrape linkedin posts from linkedin post search results, url post, company url or people url. Supports advanced linkedin search filters. Extract posts from any linkedin member. Linkedin scraper at scale.

QP

Issue with the links

Closed

quiescent_picnic opened this issue
6 months ago

url ('https://www.linkedin.com/feed/update/urn:li:activity:7072119256607252480/', 'post') 2024-06-04T12:02:09.774Z internal error

The machine put an extra ' at the end of the urls which leads to error when opening it. but I tried to put a ?utm=device at the end to resolve it. It works when I open it manually but still there is internal error without any result.

QP

quiescent_picnic

6 months ago

Actually the ' at the end is to separate the URL but when it opens the RL it considers the ' at the end as a part of the URL.

saswave avatar

SASWAVE (saswave)

6 months ago

don't click on links from the logs page, the commas ' comes from apify interface or you can select with your mousse between '

QP

quiescent_picnic

6 months ago

Thank you for your quick reply yes, the problem seems not to be the ' at the end. there is something strange that the machine can't open https://www.linkedin.com/feed/update/urn:li:activity:7072119256607252480/ but if I put a complete LinkedIn post URL like "https://www.linkedin.com/posts/rayanbannai_create-presentations-with-ai-in-3-steps-activity-7072119256607252480-B6AA?utm_source=share&utm_medium=member_desktop" it works. It might be because of the time that the link takes to be opened. Is there any way the crawler waits 1 second for each link before scraping?

saswave avatar

SASWAVE (saswave)

6 months ago

can you share the url of the run, normaly that kind of particular linkedin post url should be handled

saswave avatar

SASWAVE (saswave)

6 months ago

Actor has been updated accordingly, thank you for reporting the issue !

QP

quiescent_picnic

6 months ago

Thank you for the support, That's ok but it seems there are still some problems. You can check the log in the attached image.

https://console.apify.com/actors/KK6nmEdcpNWR1GRAB/runs/RbkCvPBABUjFoeXqt#log

saswave avatar

SASWAVE (saswave)

6 months ago

you can abort the run, i will look into why it worked for one but not others

QP

quiescent_picnic

6 months ago

I aborted it.

saswave avatar

SASWAVE (saswave)

6 months ago

I run the actor with first 4 of your url input and got results for the 4 (with my cookie session or yours, both worked)

On your failed run, you got 3 results and the 4th failed

Not sure why when you run it does not behave the same as me (i even tested with your own cookies)

QP

quiescent_picnic

6 months ago

I just changed the order of links and it's ok now. but I think It would be great if you could make it in a way that if it fails or is aborted we can have the scraped result until where it's gone. or if it fails with 1 link it can continue from the next one. for now mine is going well I hope it can finish the list.

saswave avatar

SASWAVE (saswave)

6 months ago

I removed a typo that prevented the actor to continue, that's why you had to abort. Now should be back to normal (ignoring fails and continuing running the list, and saving the success)

QP

quiescent_picnic

6 months ago

perfect, Thank you!

Developer
Maintained by Community

Actor Metrics

  • 53 monthly users

  • 18 stars

  • 90% runs succeeded

  • 7.1 hours response time

  • Created in Oct 2023

  • Modified 2 days ago