LinkedIn Job Posting Scraper

Overview

The LinkedIn Job Postings Scraper has the following features:

• Scrape valuable data: Extract job titles, companies, locations, and more from LinkedIn.
• Handle infinite scrolling: Efficiently navigate through dynamically loaded content.
• Parse HTML with Beautiful Soup: Leverage a popular library to extract data from webpages.
• Export to any format, e.g.: JSON, CSV, HTML, Table: Save scraped data in a clean, structured format for further analysis.

Prerequisites

To use the LinkedIn Job Posting Scraper, provide the following information as input on the input tab:

• Keywords (required): e.g. Software developer
• Location (required): e.g. United States
• Total scroll in px for a page (optional): e.g. 20000
• li_at_cookie (required): e.g. AQEDAVQuXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
• GEO Id (optional): e.g. 03644278

Retrieving Cookie

Browser-Independent

• Navigate to LinkedIn.com and log in
• Open up the browser developer tools (Ctrl-Shift-I or right click -> inspect element)

Chrome

• Select the Application tab
• Under the Storage header on the left-hand menu, click the Cookies dropdown and select <www.linkedin.com>
• Find the li_at cookie, and double-click the value to select it before copying

Firefox

• Select Storage tab
• Click the Cookies dropdown and select <www.linkedin.com>
• Find and copy the li_at value

What's the output format

The results will be wrapped into a dataset found in the Storage tab. Here's an excerpt from the dataset you'd get if you apply the input parameters above:

After the run, you can get the job postings dataset in your desired format (JSON, CSV, XML, Excel, HTML Table, RSS, JSONL), in the dataset, you will find:

1[
2    {
3        "title": "software Engineer I",
4        "company": "The Walt Disney Company",
5        "job_url": "https: //www.linkedin.com/jobs/view/software-engineer-i-at-the-walt-disney-company-3970118620?trk=public_jobs_topcard-title",
6        "logo": "https: //media.licdn.com/dms/image/D560BAQGmPH1QqmCzkg/company-logo_100_100/0/1688494223337/fieldguide_inc_logo?e=2147483647&v=beta&t=KqO_GS4C7oH3nVoyvtDCXbbhAvj2OeLbfty0yJYZCbc",
7        "date_posted": "4 days ago",
8        "pay_range": "$98,000.00/yr - $131,300.00/yr",
9        "location": "seattle, WA",
10        "organization": "The Walt Disney Company",
11        "number_of_applicants": "Be among the first 25 applicants",
12        "job_description": "On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.\n\n\n\nYou will be working on the Developer Experience team under the Consumer Software Engineering organization to build out efficiency tools that bring benefits across developer, QA, product and UX teams. Your contribution will have a broad impact, and it will not only save engineers time and allow them to deliver product features faster, but also help the company save a lot of financial resources. At the same time, you will enjoy fast personal growth while solving exciting and ambitious technical problems!\n\n\n\nYou will have the opportunity to work closely with client developers to build industry leading solutions to enable engineers to remotely access and control streaming devices. You will also build an innovative tool for managing and automating streaming hardware and for creating device labs for Disney engineering teams. Your day to day involves gathering feature requests from users, developing and testing your solutions, and deploying them into production.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nBachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience\n\nThe hiring range for this position in Seattle, WA and NY, NY is $98,000 to $131,300 per year based on a 40 hour work week. The amount of hours scheduled per week may vary based on business needs. The base pay actually offered will take intoaccount internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonusand/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits,dependent on the level and position offered.",
13        "seniority_level": "Mid-Senior level",
14        "employment_type": "Full-time",
15        "job_function": "Information Technology",
16        "industries": "Entertainment Providers"
17    },
18    {
19        "title": "software Engineer",
20        "company": "Fieldguide",
21        "job_url": "https: //www.linkedin.com/jobs/view/software-engineer-at-fieldguide-3961092714?trk=public_jobs_topcard-title",
22        "logo": "https: //media.licdn.com/dms/image/D560BAQGmPH1QqmCzkg/company-logo_100_100/0/1688494223337/fieldguide_inc_logo?e=2147483647&v=beta&t=KqO_GS4C7oH3nVoyvtDCXbbhAvj2OeLbfty0yJYZCbc",
23        "date_posted": "2 weeks ago",
24        "pay_range": "$125,000.00/yr - $167,000.00/yr",
25        "location": "san Francisco, CA",
26        "organization": "Fieldguide",
27        "number_of_applicants": "Be among the first 25 applicants",
28        "job_description": "About Us:\n\nFieldguide is establishing a new state of trust for global commerce and capital markets through automating and streamlining the work of assurance and audit practitioners specifically within cybersecurity, privacy, and ESG (Environmental, Social, Governance). Put simply, we build software for the people who enable trust between businesses.\n\nWe’re based in San Francisco, CA, but built as a remote-first company that enables you to do your best work from anywhere. We\"re backed by top investors including Bessemer Venture Partners, 8VC, Floodgate, Y Combinator, DNX Ventures, Global Founders Capital, Justin Kan, Elad Gil, and more.\n\nWe value diversity — in backgrounds and in experiences. We need people from all backgrounds and walks of life to help build the future of audit and advisory. Fieldguide’s team is inclusive, driven, humble and supportive. We are deliberate and self-reflective about the kind of team and culture that we are building, seeking teammates that are not only strong in their own aptitudes but care deeply about supporting each other\"s growth.\n\nAs an early stage start-up employee, you’ll have the opportunity to build out the future of business trust. We make audit practitioners’ lives easier by eliminating up to 50% of their work and giving them better work-life balance. If you share our values and enthusiasm for building a great culture and product, you will find a home at Fieldguide.\n\n\n\nAs a Software Engineer at Fieldguide, you’ll be an early member of the team, taking a front-row seat as we build both the company and the engineering organization to tackle the massive and archaic audit and advisory industry.\n\n\n\n\n\n\n\n\n\n\n\nFieldguide is a values-based company. Our values are:\n\n\n\n\n\n\n\nCompensation Range: $125K - $167K",
29        "seniority_level": "Entry level",
30        "employment_type": "Full-time",
31        "job_function": "Engineering and Information Technology",
32        "industries": "software Development"
33    },
34    {
35        "title": "software Engineer I",
36        "company": "The Walt Disney Company",
37        "job_url": "https: //www.linkedin.com/jobs/view/software-engineer-i-at-the-walt-disney-company-3970118620?trk=public_jobs_topcard-title",
38        "logo": "https: //media.licdn.com/dms/image/D560BAQGmPH1QqmCzkg/company-logo_100_100/0/1688494223337/fieldguide_inc_logo?e=2147483647&v=beta&t=KqO_GS4C7oH3nVoyvtDCXbbhAvj2OeLbfty0yJYZCbc",
39        "date_posted": "4 days ago",
40        "pay_range": "None",
41        "location": "seattle, WA",
42        "organization": "The Walt Disney Company",
43        "number_of_applicants": "Be among the first 25 applicants",
44        "job_description": "On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.\n\n\n\nYou will be working on the Developer Experience team under the Consumer Software Engineering organization to build out efficiency tools that bring benefits across developer, QA, product and UX teams. Your contribution will have a broad impact, and it will not only save engineers time and allow them to deliver product features faster, but also help the company save a lot of financial resources. At the same time, you will enjoy fast personal growth while solving exciting and ambitious technical problems!\n\n\n\nYou will have the opportunity to work closely with client developers to build industry leading solutions to enable engineers to remotely access and control streaming devices. You will also build an innovative tool for managing and automating streaming hardware and for creating device labs for Disney engineering teams. Your day to day involves gathering feature requests from users, developing and testing your solutions, and deploying them into production.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nBachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience\n\nThe hiring range for this position in Seattle, WA and NY, NY is $98, 000 to $131, 300 per year based on a 40 hour work week. The amount of hours scheduled per week may vary based on business needs. The base pay actually offered will take in account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bon and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefit dependent on the level and position offered.",
45        "seniority_level": "Mid-Senior level",
46        "employment_type": "Full-time",
47        "job_function": "Information Technology",
48        "industries": "Entertainment Providers"
49    },
50    {
51        "title": "software Engineer (L4) - CKG",
52        "company": "Netflix",
53        "job_url": "https: //www.linkedin.com/jobs/view/software-engineer-l4-ckg-at-netflix-3973735452?trk=public_jobs_topcard-title",
54        "logo": "https: //media.licdn.com/dms/image/D560BAQGmPH1QqmCzkg/company-logo_100_100/0/1688494223337/fieldguide_inc_logo?e=2147483647&v=beta&t=KqO_GS4C7oH3nVoyvtDCXbbhAvj2OeLbfty0yJYZCbc",
55        "date_posted": "1 day ago",
56        "pay_range": "$170,000.00/yr - $720,000.00/yr",
57        "location": "Los Angeles, CA",
58        "organization": "Netflix",
59        "number_of_applicants": "Be among the first 25 applicants",
60        "job_description": "Netflix is the world\"s leading internet streaming service with over 250 million members in 190 countries. Our members enjoy a wide variety of streamed videos per day, using over 1000 types of devices, generating more than a third of downstream Internet traffic in North America. The Content Knowledge Graph team within Data Science & Engineering equips scientists, engineers, and business executives with a global understanding of the entertainment industry “on & off-service”. Our flagship product, Netflix KG (“Hitch”), a data and analytics foundational layer, is a data pillar for 100s of diverse use cases across Netflix: from enabling content and marketing business executives to make better data-driven decisions to equipping AI/ML scientists with signals that power billions of daily predictions, to providing key inputs to engineering teams building business-critical applications. Hitch is a foundation for innovation that is helping to fuel Netflix’s long-term growth.\n\nWe are looking for a Full Stack Software Engineer to own and scale our online data systems while supporting high-visibility data pipelines and products. As part of this team, you will work on a diverse tech stack to build insightful tools, apps, services, and libraries that describe the entities, interactions, and usage patterns across the Netflix Knowledge Graph. You will collaborate closely with other Data Engineers, Machine Learning Engineers, Scientists, and business analysts to build scalable access patterns for them.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nNetflix offers amazing co-workers, new technology, fascinating analytical and technical challenges, and a Freedom & Responsibility Culture that\"s truly outstanding. It’s worth learning more: http://jobs.netflix.com/culture\n\nOur compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $170,000 - $720,000\n\nNetflix provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. See more detail about our Benefits here.\n\nNetflix is a unique culture and environment. Learn more here.\n\nWe are an equal-opportunity employer and celebrate diversity, recognizing that diversity of thought and background builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.",
61        "seniority_level": "Not Applicable",
62        "employment_type": "Full-time",
63        "job_function": "Engineering and Information Technology",
64        "industries": "Entertainment Providers, Technology, Information and Internet, and Movies, Videos, and Sound"
65    },
66    {
67        "title": "software Engineer, Training",
68        "company": "Rover.com",
69        "job_url": "https: //www.linkedin.com/jobs/view/software-engineer-training-at-rover-com-3962971185?trk=public_jobs_topcard-title",
70        "logo": "https: //media.licdn.com/dms/image/D560BAQGmPH1QqmCzkg/company-logo_100_100/0/1688494223337/fieldguide_inc_logo?e=2147483647&v=beta&t=KqO_GS4C7oH3nVoyvtDCXbbhAvj2OeLbfty0yJYZCbc",
71        "date_posted": "1 week ago",
72        "pay_range": "None",
73        "location": "Boston, MA",
74        "organization": "Rover.com",
75        "number_of_applicants": "Be among the first 25 applicants",
76        "job_description": "Who we are:\n\nWant to make an impact? Join our pack and come work (and play!) with us.\n\nWe believe everyone deserves the unconditional love of a pet—and at Rover, our mission is to make it easier to experience that love. Founded in 2011, the Rover app and website connect dog and cat parents with loving pet sitters and dog walkers in neighborhoods across the US, Canada, and Europe. We empower our community of trusted pet sitters and dog walkers to run their own pet care businesses on Rover with the tools and security of a global company to back them.\n\nHeadquartered in Seattle, Washington, we work closely with our teams in Barcelona, San Antonio, Spokane, and remote locations. We’ve got a reputation for being a great place to work, having been named among the 100 Best Companies to Work For in Seattle Business Magazine and Washington’s Best Workplaces in the Puget Sound Business Journal. We\"re an agile, fast-growing company, and our leadership comes from some of the world\"s most respected tech companies.\n\nAt Rover, our furry coworkers are just as important as our human ones—and we wouldn’t have it any other way. Along with making the joys of pet parenthood more accessible, we’re committed to fostering a diverse, inclusive, and welcoming community of pet people—and that starts with our employees.\n\n\n\n\nMeet the Training team:\n\nWe are a passionate ambitious team rapidly building a new dog training product line within the Rover marketplace.\n\nWe\"re Looking for Engineers Who:\n\n\n\n\nYour Qualifications:\n\n\n\n\nOur Style:\n\n\n\n\nBenefits of Working at Rover\n\n\n\n\nRover is an equal opportunity employer committed to promoting a diverse, inclusive and inventive environment with the best employees. We’re driven by seeing our people succeed and grow, and we work to ensure everyone contributes to their fullest potential. We consider all qualified applicants without regard to age, race, color, ancestry, national origin, religion, disability, protected veteran status, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable laws, regulations and ordinances.\n\nWe are committed to work with you to look for reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.",
77        "seniority_level": "Not Applicable",
78        "employment_type": "Full-time",
79        "job_function": "Engineering and Information Technology",
80        "industries": "Consumer Services"
81    },
82    {
83        "title": "Junior Full Stack Developer",
84        "company": "supportable",
85        "job_url": "https: //www.linkedin.com/jobs/view/junior-full-stack-developer-at-supportable-3972536541?trk=public_jobs_topcard-title",
86        "logo": "https: //media.licdn.com/dms/image/D560BAQGmPH1QqmCzkg/company-logo_100_100/0/1688494223337/fieldguide_inc_logo?e=2147483647&v=beta&t=KqO_GS4C7oH3nVoyvtDCXbbhAvj2OeLbfty0yJYZCbc",
87        "date_posted": "3 days ago",
88        "pay_range": "$75,000.00/yr - $80,000.00/yr",
89        "location": "Burnsville, MN",
90        "organization": "supportable",
91        "number_of_applicants": "Be among the first 25 applicants",
92        "job_description": "supportable began from an idea to improve how Human and Social Services businesses operate. After 30+ years of experience providing services to individuals in the Mental Health, Behavioral Health, Human Services, Assisted Living, and Substance Use industry, we kept searching for but never found an existing solution to help us organize our admissions & intake operations. So we created our own!\n\nAs an extension of a larger company, we expanded and developed the software that would solve this problem.\n\nWe have an exciting role available at Supportable for a This is a full time position, with the opportunity to work at home. There will be times when the Developer will need to attend on-site meetings in Burnsville, MN, so local candidates are required.\n\nThe role of the Junior Full-Stack Developer is to build high-quality, innovative, and fully performing software that complies with modern coding standards and technical design. This position executes the full lifecycle of software development, from gathering and organizing requirements to proper quality assurance testing and deployment. The Junior Full-Stack Developer executes projects to fulfill the company strategic plan and product roadmap as well as address product defects. This position is responsible for staying informed of technological trends and changes to maintain technical standards of existing software and ensure Supportable products remain modern and competitive.\n\nWant to see what Supportable is all about? Take a look at our website at https: //www.supportableapp.com/\n\nSalary: $75,000 -80,000 annually, DOQ\n\n\n\n\n\n\n\nPlanning and executing the annual, quarterly, and bi-weekly development goals for Supportable. Review upcoming project deadlines and plan work activities around those dates and other obligations throughout an average work schedule. Duties may include, but are not limited to:\n\n\n\n\n\nEnsure the continued quality of existing Supportable products and services. Duties may include, but are not limited to:\n\n\n\n\n\n\n\nThe Junior Full Stack Developer must possess technical skills and interpersonal skills and effectively communicate with team members to test and debug software through to deployment. To excel in this role, one must be inquisitive, curious, and have excellent problem-solving and analytical skills. This position also requires the following knowledge and skills:\n\n\n\n\n\n\n\n\n\n\n\nExperience with version control systems like Microsoft Azure DevOps.\n\nStrong problem-solving skills and attention to detail.\n\nExcellent communication and teamwork abilities.\n\nAbility to work autonomously, including the ability to identify and solve issues independently.\n\n\n\n\n\n\n\n\n\nSupportable will conduct a Minnesota Department of Human Services Background Study on all new employees. Employees in driving positions will also be subject to a Motor Vehicle Background check. Continued employment will be contingent on a cleared background study and a satisfactory MVR.",
93        "seniority_level": "Entry level",
94        "employment_type": "Full-time",
95        "job_function": "Engineering and Information Technology",
96        "industries": "Technology, Information and Internet"
97    },
98    {
99        "title": "Entry Level Software Engineer (Remote)",
100        "company": "Engtal",
101        "job_url": "https: //www.linkedin.com/jobs/view/entry-level-software-engineer-remote-at-engtal-3970475704?trk=public_jobs_topcard-title",
102        "logo": "https: //media.licdn.com/dms/image/D560BAQGmPH1QqmCzkg/company-logo_100_100/0/1688494223337/fieldguide_inc_logo?e=2147483647&v=beta&t=KqO_GS4C7oH3nVoyvtDCXbbhAvj2OeLbfty0yJYZCbc",
103        "date_posted": "1 day ago",
104        "pay_range": "$90,000.00/yr - $145,000.00/yr",
105        "location": "United States",
106        "organization": "Engtal",
107        "number_of_applicants": "Over 200 applicants",
108        "job_description": "Please note: If you\"re interested in this position, please only apply via LinkedIn and do not reach out to our team directly as this can slow down our hiring process.\n\nWe are seeking a highly motivated and technically skilled Entry-Level Software Engineer to join our dynamic team. As a Software Engineer, you will be involved in the design, development, testing, and maintenance of software applications. This is an exciting opportunity for a recent graduate or an individual with foundational programming skills to grow within a collaborative and innovative work environment.",
109        "seniority_level": "Entry level",
110        "employment_type": "Full-time",
111        "job_function": "Engineering",
112        "industries": "Financial Services"
113    },
114    {
115        "title": "software Engineer",
116        "company": "Fay",
117        "job_url": "https: //www.linkedin.com/jobs/view/software-engineer-at-fay-3958004670?trk=public_jobs_topcard-title",
118        "logo": "https: //media.licdn.com/dms/image/D560BAQGmPH1QqmCzkg/company-logo_100_100/0/1688494223337/fieldguide_inc_logo?e=2147483647&v=beta&t=KqO_GS4C7oH3nVoyvtDCXbbhAvj2OeLbfty0yJYZCbc",
119        "date_posted": "2 weeks ago",
120        "pay_range": "None",
121        "location": "san Francisco, CA",
122        "organization": "Fay",
123        "number_of_applicants": "Be among the first 25 applicants",
124        "job_description": "Can you help us build out a digital private practice for medical professionals that powers high quality care while handling complex payments and insurance billing behind the scenes?\n\nOur platform is already supporting a thriving business, but we need help keeping up with the rapid pace of growth and building features that will drive better care for some of the most common chronic conditions in the U.S.\n\nWe\"re looking for a generalist full stack engineer who thrives in an early-stage startup environment and is willing to learn whatever it takes to get the job done.\n\n\n\n\n\nThe best companies are made of the best people. There\"s no shortage of work ahead, but we stay balanced and look forward to celebrating our wins as a team.\n\nSee our careers page here to learn more about working on our our team.",
125        "seniority_level": "Entry level",
126        "employment_type": "Full-time",
127        "job_function": "Engineering and Information Technology",
128        "industries": "Technology, Information and Internet"
129    }
130]

FAQs

Is it legal to scrape LinkedIn?

While web scraping itself is generally considered legal, there might be specific regulations you need to follow depending on your location. For instance, rules set by GDPR (Europe)or CCPA (California) could come into play.

Also, while LinkedIn scrapers focus on publicly available information on job postings, it's important to remember that this public information might still include personal details. Extracting this kind of data is only permissible if you have a valid justification.

If you're unsure if your reason qualifies, it's best to consult with a lawyer. We also have a blog post on our site that explores the legal aspects of web scrapingand ethical considerations.

Also, some websites may block you from scraping them. In such situations, we have a detailed blog post on how to crawl a website without getting blocked.

Is there a LinkedIn API that can be used with Python?

LinkedIn does offer an official API that you can use to create applications that help LinkedIn members; however, it might not be the most suitable solution for your project.

Many developers have reported some drawbacks of the LinkedIn API citing various reasons. Among these drawbacks cited are:

• LinkedIn's API rate limits: These limits restrict the number of actions your application can take within a specific timeframe. Exceeding these limits can lead to throttling or even blacklisting your IP address. This can be particularly problematic if your project relies heavily on frequent API calls, potentially impacting its performance and responsiveness. Compared to other APIs that might offer more generous limits or no limits at all, LinkedIn's stricter approach can limit your development flexibility.
• Limited data scope: The LinkedIn jobs API is constantly evolving. It primarily grants access to your connections and a very limited view of public data.

Your feedback

We are always working on improving the performance of our Actors. So if you’ve got any technical feedback for the LinkedIn Job Posting Scraper Actor or simply found a bug, please create an issue on the Actor’s Issues tabin Apify Console.