LinkedIn Jobs & Company Scraper
Pricing
$19.99/month + usage
LinkedIn Jobs & Company Scraper
Actively Maintained - Cheap Rental & Run Cost - LinkedIn Jobs Scraper + Companies - to extract job listings worldwide. Export results for analysis, connect via API, & integrate with other apps. Please note that LinkedIn may block some requests leading their being to fewer results than expected.
1.2 (4)
Pricing
$19.99/month + usage
31
Total users
556
Monthly users
92
Runs succeeded
>99%
Issues response
4.8 days
Last modified
23 days ago
Crawled results don't match LinkedIn page search results
Open
Please watch this very brief video - https://www.loom.com/share/1a2282f3733a427b82f77338cf8b5f2c
Hi Zack, Thank you for raising this and for the video explanation. The reason that different results are returned is because the scrapper is using a logged out session. LinkedIn customise the results when users for the user when users are logged in, and this customisation isn't captured in the url string. If you paste the url into a logged out session you should see the same results as returned by the scrapper. What I can advise is to use more key words in the search e.g. instead of 'sales engineer' try 'sales engineer technical presales AI', this way the results will be narrowed down and the linkedin customisation of the search results will have less effect. This is the first time I have noticed the behaviour. I hope this helps. In the mean time I will think about other possible work arounds. Many thanks, FetchClub
zgall1
Realistically, I don't think your solution is going to work for me because it is not possible to customize the number of searches I would have at the level you suggested.
I'm assuming that this behaviour is an anti-scraping one so I'm a bit surprised that nobody has raised it before. Wouldn't everyone using the scraper end up wasting a lot of their billing credits given the poor match between the search string and the results?
This maybe something new. I am looking into this further in addition to experimenting the ability to add login cookies which may mean the results match. I will post an update here if successful.
zgall1
Were you able to make any progress on this?
Hi,
After looking into this, a viable solution is to use a logged out session to search for LinkedIn jobs then provide this url to the scrapper. To do this go to https://www.linkedin.com/jobs/search using an incognito window (a logged-out session). We hope this can work for your use case. We will not be able to add logged in search capabilities as this complicates the scrapping process.
Best of luck, FetchClub
zgall1
That is not a reasonable solution. The logged out search results do not match the actual search query. In this screenshot - https://www.evernote.com/shard/s395/sh/8f27c89a-1247-4e6b-b652-78348fc94a98/NTigAevVUjANy81YiTRfQw1vDLBqA0eo9sWpIeC7fYUldCXmVmUAkvbn9w - you can see that even the first three search results (which would you assume would be a perfect match for the search term) don't even contain the search term. If this is your best solution, you are going to get a lot of customer complaints.
