Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

What Can Totaljobs Jobs Details Scraper Do?

Introduction

Totaljobs.com stands as the UK's largest hiring platform with over 280,000 live job advertisements, making it a goldmine of employment data across diverse industries and locations. For recruitment agencies, market researchers, salary analysts, and HR professionals, manually collecting job information from this vast database is time-consuming and inefficient. The Totaljobs Jobs Details Scraper addresses this challenge by automating the extraction of comprehensive job posting data, transforming hours of manual work into minutes of automated data collection.

As part of StepStone, one of the world's leading next-generation recruitment solution providers, Totaljobs leverages innovative market-leading insights and technological innovation. This wealth of structured job data represents invaluable intelligence for understanding UK employment trends, salary benchmarks, and market dynamics across various sectors.

Comprehensive Job Data Extraction Tool

The Totaljobs Jobs Details Scraper is a powerful automation tool designed to extract detailed information from individual job postings on Totaljobs.com. Unlike basic web scrapers that collect only surface-level data, this scraper captures the complete job posting structure, including employment details, company information, location data with commute times, salary ranges, benefits packages, and multimedia content.

This scraper is particularly valuable for recruitment professionals who need to analyze competitor job postings, salary researchers building compensation databases, and market analysts tracking employment trends across the UK. The tool handles the complex structure of Totaljobs' job pages, ensuring consistent and accurate data extraction even as the website's layout evolves.

Target users include recruitment agencies conducting market research, HR departments benchmarking salaries, business analysts tracking industry trends, and data scientists building employment databases. The scraper's robust architecture handles large-scale data collection while respecting website rate limits and maintaining data integrity.

Input and Output Specifications

Example url 1: https://www.totaljobs.com/job/management-accountant/kennedy-pearce-consulting-job105283461

Example url 2: https://www.totaljobs.com/job/customer-service-advisor/meridian-business-support-job105410235

Example url 3: https://www.totaljobs.com/job/receptionist/integrate-job105408889

Example Screenshot of jobs information page:

Input Configuration

The scraper accepts a JSON configuration that defines the extraction parameters and proxy settings. Here's the detailed input structure:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "DE" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "max_items_per_url": 20, // Total page you want scrape
  "urls": [ // Links to jobs list by query pages.
    "https://www.totaljobs.com/job/management-accountant/kennedy-pearce-consulting-job105283461",
    "https://www.totaljobs.com/job/customer-service-advisor/meridian-business-support-job105410235",
    "https://www.totaljobs.com/job/receptionist/integrate-job105408889"
  ]
}

The max_retries_per_url parameter controls retry attempts for failed requests, ensuring reliable data extraction even with network issues. The proxy configuration uses residential IP addresses to avoid bot detection, with country selection (such as "DE" for Germany) helping maintain consistent access patterns. The max_items_per_url limits the number of pages processed per URL, while the urls array contains direct links to specific job postings.

Comprehensive Output Data Structure

You get the output from the Totaljobs Jobs Details Scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[ // List of jobs information
  {
    "id": "https://www.totaljobs.com/job/management-accountant/kennedy-pearce-consulting-job105283461",
    "url": "https://www.totaljobs.com/job/management-accountant/kennedy-pearce-consulting-job105283461",
    "title": "Management Accountant",
    "date_posted": "2025-07-04T09:56:01.277Z",
    "valid_through": "2025-08-15T09:56:01.277Z",
    "employment_type": "FULL_TIME",
    "industry": "Accountancy, Accountancy-Accountancy",
    "direct_apply": true,
    "job_location": {
      "@type": "Place",
      "geo": {
        "@type": "GeoCoordinates",
        "latitude": 51.49257,
        "longitude": -0.23253
      },
      "address": {
        "@type": "PostalAddress",
        "address_country": "GB",
        "street_address": "",
        "address_locality": "West London",
        "address_region": "London",
        "postal_code": "W6"
      }
    },
    "base_salary": {
      "@type": "MonetaryAmount",
      "currency": "GBP",
      "value": {
        "@type": "QuantitativeValue",
        "min_value": 40000,
        "max_value": 45000,
        "unit_text": "ANNUM"
      }
    },
    "description": "<p>Dynamic Organisation seeks a <strong>Management Accountant</strong> to join their team on a permanent basis. The <strong>Management Accountant </strong>responsibilities will include month end, balance sheet reconciliations and process improvements.<br><strong>Duties of the Management Accountant include:</strong></p><ul><li>Prepare and post monthly accruals and prepayments.</li><li>Month-end reporting, ensuring the monthly reporting is delivered on time and accurately.</li><li>Prepare general ledger journal entries and supporting documentation.</li><li>Responsible for fixed assets ledger, ensuring the ledger reconciles each month end.</li><li>Assigned bank sheet reconciliations within the organisation.</li><li>Be a conduit between Finance and non-finance departments, to ensure that there is a communication flow where problems and enquires can be raised and resolved.</li><li>Drive the continuous improvement of end-to-end accounting practices.</li><li>Forecasting income and expenditure and ensuring expenditure is in line with the budget.</li><li>Assisting with working capital management and production of cash flow forecast.</li><li>Process improvement</li><li>Ad-hoc projects</li></ul><p> <br><strong>Requirements for the Management Accountant include:</strong></p><ul><li>Part Qualified/Qualified by experience.</li><li>Solid communication skills, both written and verbal.</li><li>Excellent attention to detail.</li><li>Strong Excel skills</li><li>Proven ability of working to a high standard while multi-tasking.</li><li>Ability to follow and implement company policies, processes, and procedures.</li></ul><p>Hybrid working</p><h3>In Short</h3><ul><li><b>Industry</b> <!-- -->HR & Recruitment</li><li><b>Founded</b> <!-- -->2006</li><li><b>Location</b> <!-- -->City of London</li><li><b>Company size</b> <!-- -->0 - 49</li></ul></div><div><div><h3>WHO ARE WE </h3><p></p><p>Kennedy Pearce is a leading recruitment firm focusing on:</p><p><br/></p><p>🔸 Accounting & Finance</p><p>🔹 HR & Executive Support</p><p>🔸 Technology & Digital</p><p>🔹 Banking Operations</p><p>🔸 Risk & Compliance</p><p><br/></p><p>We are a tight knit organisation, who value the relationships we hold with our community of candidates and clients.</p><p><br/></p><p></p></div><div><h3>WE CONNECT PEOPLE</h3><p></p><p>The key to our success is in our people. By relating to the needs of our community, we provide a specialist tailored approach to career building, while constantly evolving to meet our clients' needs. We approach everything we do through collaboration, integrity and commitment and we are proud of the tenure of our team. This extensive experience sets us apart and filters through our entire recruitment process.</p><p></p></div><div><h3>HOW WE OPERATE</h3><p></p><p>Our aim is to connect talented professionals to high achieving organisations. Our expert knowledge and advice lead the way in career development and helps businesses build teams across all levels of experience from entry level to executive search. Our specialised service covers interim, contract and permanent recruitment spanning across a wide range of fields.</p><p></p></div><div><h3>OUR VALUES</h3><p></p><p>The values that define us are:</p><p><br/></p><p>✔ Collaboration- we encourage our employees to take an entrepreneurial approach to solving requests; while working collaboratively to build and maintain relationships. </p><p><br/></p><p>✔ Integrity – we always strive to achieve excellence. However, we don’t try to do everything but everything we do, we do to the absolute best of our ability. </p><p><br/></p><p>✔ Commitment - the relationships we have with our community are integral to who we are. What sets us apart is how we progress with our candidates as their careers evolve -this is where our notable reputation stems from.</p><br/><p></p></div>",
    "videos": null,
    "multimedia_images": null,
    "location_with_commute_time": null,
    "benefits": [],
    "company": {
      "id": 1377401,
      "is_company_passport_enabled": true,
      "is_anonymous": false,
      "name": "Kennedy Pearce Consulting",
      "is_parent_company": false,
      "result_list_url": "https://www.totaljobs.com/jobs-at/kennedy-pearce-consulting/jobs",
      "logo_url": "https://www.totaljobs.com/CompanyProfilesLogos/b4431a9a-54a5-4445-8b80-b09d44d8a72f.png",
      "hero_image_url": "https://www.totaljobs.com/CompanyProfilesHeroImages/72f7db4d-098f-4d92-83cd-7686d601912f.jpg",
      "jobs_count": 50,
      "address": "City of London",
      "employees": "0 - 49",
      "founded": 2006,
      "custom_sections": [
        {
          "title": "WHO ARE WE ",
          "content": "<p>Kennedy Pearce is a leading recruitment firm focusing on:</p><p><br /></p><p>🔸 Accounting &amp; Finance</p><p>🔹 HR &amp; Executive Support</p><p>🔸 Technology &amp; Digital</p><p>🔹 Banking Operations</p><p>🔸 Risk &amp; Compliance</p><p><br /></p><p>We are a tight knit organisation, who value the relationships we hold with our community of candidates and clients.</p><p><br /></p>"
        },
        {
          "title": "WE CONNECT PEOPLE",
          "content": "<p>The key to our success is in our people. By relating to the needs of our community, we provide a specialist tailored approach to career building, while constantly evolving to meet our clients' needs. We approach everything we do through collaboration, integrity and commitment and we are proud of the tenure of our team. This extensive experience sets us apart and filters through our entire recruitment process.</p>"
        },
        {
          "title": "HOW WE OPERATE",
          "content": "<p>Our aim is to connect talented professionals to high achieving organisations. Our expert knowledge and advice lead the way in career development and helps businesses build teams across all levels of experience from entry level to executive search. Our specialised service covers interim, contract and permanent recruitment spanning across a wide range of fields.</p>"
        },
        {
          "title": "OUR VALUES",
          "content": "<p>The values that define us are:</p><p><br /></p><p>✔ Collaboration- we encourage our employees to take an entrepreneurial approach to solving requests; while working collaboratively to build and maintain relationships.&#160;</p><p><br /></p><p>✔ Integrity – we always strive to achieve excellence. However, we don’t try to do everything but everything we do, we do to the absolute best of our ability.&#160;</p><p><br /></p><p>✔ Commitment - the relationships we have with our community are integral to who we are. What sets us apart is how we progress with our candidates as their careers evolve -this is where our notable reputation stems from.</p><br />"
        }
      ],
      "industries": [
        "HR & Recruitment"
      ],
      "videos": [],
      "images": [
        {
          "url": "https://www.totaljobs.com/CompanyProfilesSectionImages/532b6cb9-ce7d-4de7-8bb5-6a335eae1ff8.jpg",
          "type": "companyPassportImage"
        }
      ],
      "contacts": [],
      "application_process": [],
      "benefits": []
    }
  }, // ... Many other jobs details
]

The scraper extracts 16 distinct data fields, providing a complete picture of each job posting:

ID: Unique job identifier extracted from Totaljobs' internal system, essential for tracking and deduplication in databases.

URL: The complete web address of the job posting, enabling direct access and verification of scraped data.

Title: The job position title as posted by employers, crucial for job categorization and search functionality.

Date Posted: The publication date of the job listing, vital for understanding posting freshness and application timing.

Valid Through: The expiration date for applications, helping candidates understand deadlines and recruiters track active postings.

Employment Type: Classification such as full-time, part-time, contract, or temporary positions, essential for employment statistics and candidate filtering.

Industry: The business sector or industry classification, valuable for market analysis and sector-specific recruitment insights.

Direct Apply: Boolean indicator showing whether candidates can apply directly through Totaljobs, affecting application funnel analysis.

Job Location: Geographic location including city, region, and postal code information, critical for location-based job matching and regional market analysis.

Base Salary: Salary range or specific compensation details, fundamental for salary benchmarking, market research, and candidate expectation management.

Description: Complete job description including responsibilities, requirements, and company information, providing context for job classification and skills analysis.

Videos: Links to recruitment videos or company promotional content, offering insights into employer branding strategies.

Multimedia Images: Associated images such as company logos, office photos, or infographics, valuable for visual content analysis.

Location With Commute Time: Enhanced location data including estimated commute times from major transport hubs, crucial for candidate convenience analysis.

Benefits: Detailed benefits package information including health insurance, pension schemes, and additional perks, essential for comprehensive job comparison.

Company: Employer information including company name, size, and basic details, vital for employer brand analysis and recruitment intelligence.

Usage Guidelines and Best Practices

To maximize the scraper's effectiveness, follow these implementation steps. First, prepare your target URLs by collecting direct links to individual job postings rather than search result pages. Configure the proxy settings to match your geographic requirements – using UK or EU proxy locations typically provides better access to Totaljobs content.

Set appropriate retry limits based on your data quality requirements. Higher retry counts improve data completeness but increase processing time. Monitor the max_items_per_url parameter to balance comprehensive data collection with reasonable execution times.

Best practices include running the scraper during off-peak hours to minimize server load impact, implementing data validation to check for complete field extraction, and maintaining a respectful crawling pace to avoid triggering anti-bot measures. Regular monitoring of success rates helps identify when proxy rotation or configuration adjustments are needed.

Common troubleshooting involves checking proxy connectivity if extraction fails, verifying URL formats for direct job posting links, and adjusting retry parameters for optimal data completion rates. Always validate extracted data against source pages to ensure accuracy and completeness.

Business Applications and Benefits

The Totaljobs Jobs Details Scraper delivers significant time savings by automating data collection that would typically require hours of manual work. Recruitment agencies can quickly analyze competitor job postings, identify market trends, and adjust their positioning strategies. HR departments benefit from automated salary benchmarking, allowing them to maintain competitive compensation packages.

Market researchers can track employment trends across industries, monitor job availability patterns, and analyze regional employment dynamics. The structured data format enables easy integration with analytics tools, CRM systems, and business intelligence platforms.

For salary analysis, the comprehensive benefits and compensation data provides detailed insights into total rewards packages beyond base salary. Location data with commute information helps understand geographic employment patterns and candidate preferences.

Business intelligence applications include competitive analysis, market sizing for recruitment services, and trend analysis for strategic planning. The rich dataset supports advanced analytics including skills demand forecasting, salary trend analysis, and employment market health assessment.

Conclusion

The Totaljobs Jobs Details Scraper transforms complex, time-intensive data collection into an efficient, automated process. By extracting comprehensive job posting information from the UK's largest hiring platform, it provides invaluable intelligence for recruitment professionals, researchers, and business analysts.

Ready to streamline your job market research? Deploy the Totaljobs Jobs Details Scraper today and unlock the power of automated employment data collection for smarter business decisions.

Related Actors

• Totaljobs Jobs Search Scraper: Your comprehensive tool for extracting valuable property information from Totaljobs extensive directory platform.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Totaljobs Jobs Details Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.