LinkedIn Job Scraper

Overview

The LinkedIn Job Scraper has the following features:

• Scrape valuable data: Extract job titles, companies, locations, and more from LinkedIn.
• Handle infinite scrolling: Efficiently navigate through dynamically loaded content.
• Parse HTML with Beautiful Soup: Leverage a popular library to extract data from webpages.
• Export to CSV: Save scraped data in a clean, structured format for further analysis.

Prerequisites

To use the LinkedIn Job Scraper, provide the following information as input on the input tab:

• Title: e.g. "Software developer"
• Location: e.g. "United States"
• Start: e.g. 0

What's the output format

After the run you can get the job dataset in your desired format (JSON, CSV, XML, Excel, HTML Table, RSS, JSONL), in the dataset you will find:

[
      {
      "id": "4320634407",
      "title": "Software Engineer (Reactjs, Python, AI)",
      "company": "Hillview Consulting Solutions",
      "location": "New York, NY",
      "number_of_applicants": null,
      "job_description": "Full Stack Engineer (React + Python) — Data & AI Applications Location: NYC Hybrid role- 3 days in NYC office Contract- 6 Months Payrate- $65 to 75/hr Type of Interview- First Take home exercise (data extraction + visualization exercise) 2nd one or two Tech+ Behavioural discussion (Video or might be onsite) About the Role: We are seeking a Full Stack Engineer with strong expertise in React and Python to join our Data & AI engineering team. The role involves building applications that extract and visualize structured insights from unstructured PDF documents such as rent rolls, leases, and marketing flyers. You will design and implement an end-to-end solution that parses document data, stores it in queryable databases, and enables intuitive search and visualization through a modern web UI. Responsibilities Design and build a frontend application using React for document visualization, search, and data exploration. Develop Python-based backend services to extract and transform unstructured document data (PDFs). Integrate OCR or GenAI-based tools for intelligent data extraction. Store extracted data in SQL databases and expose REST APIs for the frontend. Implement document upload, real-time parsing, and side-by-side result visualization with source citations. Ensure clean, modular, and testable code with proper documentation. Collaborate with the Data & AI team to improve extraction accuracy and user experience. Required Skills 3–6 years of full-stack development experience Strong React.js and frontend engineering fundamentals Solid Python programming skills (FastAPI, Flask, or Django) Experience with SQL databases and schema design Exposure to PDF parsing, OCR, or document AI Strong debugging and problem-solving skills Familiarity with GitHub and modern CI/CD workflows Preferred Skills Experience with LangChain, OpenAI API, or other LLM-based extraction tools Familiarity with vector databases (FAISS, Chroma) Data visualization experience (charts, tables, dashboards) Understanding of microservices and containerization (Docker)",
      "date_posted": "2 days ago",
      "job_url": "https://www.linkedin.com/jobs/view/software-engineer-reactjs-python-ai-at-hillview-consulting-solutions-4320634407?trk=public_jobs_topcard-title",
      "logo": "https://media.licdn.com/dms/image/v2/D4E0BAQHPY9zXEMtllQ/company-logo_100_100/company-logo_100_100/0/1685635589262/hillview_consulting_solutions_logo?e=2147483647&v=beta&t=N7S2yL6bdKjspHv-b1Qqwd1m0HI0XyaoBRBSaDmUN7E",
      "seniority_level": "Mid-Senior level",
      "employment_type": "Contract",
      "job_function": "Engineering and Information Technology",
      "industries": "Real Estate, Internet Marketplace Platforms, and Software Development"
    },
    {
      "id": "4306620914",
      "title": "Machine Learning Engineer, Robot Learning - Robotics Software Firm in High Growth",
      "company": "Andiamo",
      "location": "New York, NY",
      "number_of_applicants": "144 applicants",
      "job_description": "Senior Data Engineer About The Role Design and scale data platforms that power analytics, ML, and product features. You’ll build streaming and batch pipelines, enforce data contracts, and ensure trust in critical datasets. Responsibilities Develop ELT/ETL and near-real-time pipelines (Kafka/Flink/Spark) with strong SLAs. Model data (Dimensional/Data Vault), implement governance, lineage, and quality checks. Operate cloud data warehouses (Snowflake/BigQuery/Redshift) and lakehouse patterns (Iceberg/Delta/Hudi). Enable self-service with dbt, catalogs, and metrics layers; partner with DS/BI stakeholders. Requirements 5+ years in data engineering; strong SQL and Python/Scala. Experience with orchestration (Airflow/Dagster) and CI/CD for data. Focus on reliability, cost efficiency, and documentation. About Andiamo Andiamo is a globally recognized staffing and consulting firm specializing in placing the top 2% of technology and go-to-market professionals with the world’s largest and most well-known companies. For over 20 years, we've maintained the status of tier-one vendor for firms such as Amazon, Bloomberg, Palantir, MasterCard, Visa, Two Sigma, Citadel, as well as other major financial services firms, elite hedge funds, Google-backed tech start-ups, and major software firms. Our talent solutions include Permanent Placement, Contract Staffing, Executive Search, and Dedicated Recruiting Services (RPO). Find out more at www.andiamogo.com",
      "date_posted": "2 weeks ago",
      "job_url": "https://www.linkedin.com/jobs/view/machine-learning-engineer-robot-learning-robotics-software-firm-in-high-growth-at-andiamo-4306620914?trk=public_jobs_topcard-title",
      "logo": "https://media.licdn.com/dms/image/v2/D4E0BAQHPuA5fkezdzQ/company-logo_100_100/company-logo_100_100/0/1736365591445/andiamo_partners_logo?e=2147483647&v=beta&t=4mGgHbHTu8vkZnXBE_UHbVOQKDNlIojbxk1QVzAixT0",
      "seniority_level": "Entry level",
      "employment_type": "Full-time",
      "job_function": "Engineering and Information Technology",
      "industries": "Staffing and Recruiting"
    }
]

FAQs

Is it legal to scrape LinkedIn?

While web scraping itself is generally considered legal, there might be specific regulations you need to follow depending on your location. For instance, rules set by GDPR (Europe) or CCPA (California) could come into play.

Also, while LinkedIn scrapers focus on publicly available information on job postings, it's important to remember that this public information might still include personal details. Extracting this kind of data is only permissible if you have a valid justification.

If you're unsure if your reason qualifies, it's best to consult with a lawyer. We also have a blog post on our site that explores the legal aspects of web scraping and ethical considerations.

Also, some websites may block you from scraping them. In such situations, we have a detailed blog post on how to crawl a website without getting blocked.

Is there a LinkedIn API that can be used with Python?

LinkedIn does offer an official API that you can use to create applications that help LinkedIn members; however, it might not be the most suitable solution for your project.

Many developers have reported some drawbacks of the LinkedIn API citing various reasons. Among these drawbacks cited are:

• LinkedIn's API rate limits: These limits restrict the number of actions your application can take within a specific timeframe. Exceeding these limits can lead to throttling or even blacklisting your IP address. This can be particularly problematic if your project relies heavily on frequent API calls, potentially impacting its performance and responsiveness. Compared to other APIs that might offer more generous limits or no limits at all, LinkedIn's stricter approach can limit your development flexibility.
• Limited data scope: The LinkedIn jobs API is constantly evolving. It primarily grants access to your connections and a very limited view of public data.

Your feedback

We are always working on improving the performance of our Actors. So if you’ve got any technical feedback for the LinkedIn Job Posting Scraper Actor or simply found a bug, please create an issue on the Actor’s Issues tab in Apify Console.