Contact

If you encounter any issues or need to exchange information, please feel free to contact us through the following link: My profile

What Can Totaljobs Jobs Search Scraper Do?

Introduction

Totaljobs stands as the UK's largest hiring platform, featuring over 280,000 live job advertisements and attracting more than 20 million visits monthly. Founded in 1999, this leading job board processes over 5 million applications from qualified jobseekers every month, making it an invaluable data source for recruitment professionals, market researchers, and business analysts.

The challenge lies in efficiently extracting and analyzing this vast repository of job market data. Manual browsing through thousands of listings is time-consuming and impractical for comprehensive market analysis, competitive intelligence, or automated recruitment processes. This is where a specialized Totaljobs scraper becomes essential, transforming hours of manual work into automated, structured data collection that can power informed business decisions and streamline recruitment workflows.

Totaljobs Scraper Overview

The Totaljobs Jobs Search Scraper is a sophisticated web scraping solution designed specifically for extracting comprehensive job listing data from Totaljobs.com. This scraper efficiently navigates through the platform's 40+ job sectors, capturing detailed information from each job posting including company details, salary ranges, location data, and comprehensive job descriptions.

This powerful tool stands out for its ability to handle large-scale data extraction while maintaining data integrity and structure. It's engineered to respect the website's architecture while providing users with clean, organized datasets suitable for immediate analysis or integration into existing systems. The scraper supports multiple search parameters, allowing users to target specific job categories, locations, or salary ranges according to their research needs.

The primary users of this scraper include recruitment agencies seeking market intelligence, HR professionals conducting salary benchmarking, researchers analyzing employment trends, and businesses monitoring competitor hiring patterns. Whether you're conducting market research, building job aggregation platforms, or analyzing recruitment trends across the UK job market, this scraper provides the comprehensive data foundation you need.

Input and Output Configuration

Example url: https://www.totaljobs.com/jobs/audit?searchOrigin=Homepage_top-search

https://www.totaljobs.com/searchbar/onsitesearch/uk/v1/?searchOrigin=Resultlist_top-search&what=Act+with+integrity&whatType=skillAutosuggest&siteId=4&uiLanguage=en

https://www.totaljobs.com/jobs/it-skills?searchOrigin=Resultlist_top-search

Example Screenshot of jobs information page:

Input Format

The scraper accepts a JSON configuration that provides precise control over the data collection process:

{
  "max_retries_per_url": 2, // Maximum waiting time when accessing the links you provided.
  "proxy": { // Add a proxy to ensure that during the data collection process, you are not detected as a bot.
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL" 
    ],
    "apifyProxyCountry": "SG" // You should choose an Country that coincides with the Country you want to collect data from
  },
  "max_items_per_url": 20, // Total page you want scrape
  "urls": [ // Links to jobs list by query pages.
    "https://www.totaljobs.com/jobs/audit?searchOrigin=Homepage_top-search",
    "https://www.totaljobs.com/jobs/it-skills?searchOrigin=Resultlist_top-search",
    "https://www.totaljobs.com/searchbar/onsitesearch/uk/v1/?searchOrigin=Resultlist_top-search&what=Act+with+integrity&whatType=skillAutosuggest&siteId=4&uiLanguage=en"
  ]
}

• URLs - Links to jobs list by query pages. If you want to scrape from any page, enter the URL of that page, and set the total of pages to scrape. You can paste URLs one at a time or use the Bulk Edit section to add a prepared list.
• Max items per url - Don't forget to fill in this field, which allows you to choose the total items per url when scraping from the jobs listing page.
• Limit the number of retries - Maximum number of retries for each URL when collecting data when an unexpected error occurs.
• Proxy configuration - Add a proxy to ensure that during the data collection process, you are not detected as a bot.

Output Format

You get the output from the Totaljobs Jobs Search Scraper stored in a tab. The following is an example of the Information Fields collected after running the Actor.

[ // List of jobs information
  {
    "id": 105282932,
    "title": "Audit Manager",
    "labels": [],
    "url": null,
    "company_id": 940382,
    "company_name": "H M Revenue & Customs (HMRC)",
    "company_url": "http://searchcore.internal.tjgprod.io/jobs/h-m-revenue-and-customs-hmrc?cmpId=940382&q=H+M+Revenue+%26+Customs+%28HMRC%29&cmp=1",
    "company_logo_url": "https://www.totaljobs.com/companylogos/f4b24efcfd6b4d3dbea537ac42fd3702.png",
    "date_posted": "2025-07-05T02:06:01.523",
    "location": "Greater Manchester, M3 5AX",
    "is_anonymous": false,
    "salary": "From £56,344 to £70,422 per annum",
    "post_code": "M3 5AX",
    "partnership": {
      "is_partnership_job": false,
      "show_partnership_label": false,
      "is_backfilled": false,
      "source_site_friendly_name": "CWJobs.co.uk",
      "is_cross_posted": true
    },
    "unified_salary": null,
    "work_from_home": "",
    "meta_data": {
      "position_on_page": 1,
      "position_absolute": 1
    },
    "job_posting_sequence": 1,
    "period_posted_date": "2025-07-05T02:06:01.523",
    "publish_from_date": "2025-07-04T09:44:25.077",
    "publish_to_date": "2025-07-14T23:55:00",
    "has_future_posting": false,
    "fingerprint_count": 1,
    "section": "main",
    "top_labels": [
      {
        "label": "FEATURED",
        "type": "FEATURED"
      },
      {
        "label": "NEW",
        "type": "NEW"
      }
    ],
    "skills": [],
    "text_snippet": "Have you got experience of delivering internal <strong>audit</strong> reviews? This will take place at 15.00 - 16:00 on 11 July 2025 via Teams, so visitHMRC-<strong>Audit-</strong>Manager-ticketsto book your place. Internal <strong>Audit</strong> is integral to HMRC's operation, winning the Institute of Internal Auditors award for added value to an organisation in 2023. As well as undertaking risk-based and compliance type <strong>audit</strong> work, we are actively brought in early to help the business design controls into new products and processes. The <strong>Audit</strong> Manager is a key role that supports the Director of Internal <strong>Audit</strong> and Internal <strong>Audit</strong> Senior Leadership Team in providing HMRC/VOA Chief Executives with advice and assurance on the overall adequacy and effectiveness of their respective frameworks of governance",
    "cv_to_job_score": null,
    "is_highlighted": false,
    "is_sponsored": false,
    "travel_time": null,
    "unified_travel_time": null,
    "is_top_job": false,
    "is_traffic_from_partner": false,
    "from_url": "https://www.totaljobs.com/jobs/audit?searchOrigin=Homepage_top-search"
  }, // ... Many other jobs details
]

The scraper delivers comprehensive job data in structured JSON format, with each job listing containing 32 distinct data fields:

Core Job Information:

• ID: Unique identifier for each job posting, essential for database storage and duplicate prevention
• Title: The job position title as advertised by the employer
• URL: Direct link to the complete job posting on Totaljobs.com
• Text Snippet: Brief job description preview, useful for quick content analysis

Company Details:

• Company Name: Employer's official name, crucial for company-specific analysis
• Company ID: Unique company identifier for tracking multiple postings from the same employer
• Company URL: Link to the company's profile page on Totaljobs
• Company Logo URL: Direct link to company branding assets
• Is Anonymous: Boolean indicating whether the employer chose to remain anonymous

Location and Logistics:

• Location: Primary job location as specified in the posting
• Post Code: UK postal code for precise geographical analysis
• Work From Home: Boolean indicating remote work availability
• Travel Time & Unified Travel Time: Commute information when specified

Financial Information:

• Salary: Raw salary information as posted by employers
• Unified Salary: Standardized salary format for comparison analysis

Temporal Data:

• Date Posted: When the job was originally published
• Period Posted Date: Alternative date format for temporal analysis
• Publish From Date & Publish To Date: Job posting validity period
• Has Future Posting: Boolean indicating scheduled future publication

Categorization and Metadata:

• Labels & Top Labels: Job category tags for classification
• Skills: Required or preferred skills listed in the posting
• Section: Website section where the job appears
• Meta Data: Additional structured information about the posting

Performance and Visibility Metrics:

• CV To Job Score: Platform-specific relevancy scoring
• Is Highlighted: Boolean indicating premium job placement
• Is Sponsored: Boolean showing whether it's a paid promotion
• Is Top Job: Boolean indicating featured job status
• Is Traffic From Partner: Boolean showing traffic source attribution

Technical Fields:

• Job Posting Sequence: Internal sequencing information
• Fingerprint Count: Duplicate detection metric
• Partnership: Information about posting partnerships or agencies

This comprehensive output structure enables detailed analysis of UK job market trends, salary benchmarking across industries and regions, and comprehensive recruitment intelligence gathering.

Usage Instructions

To effectively utilize the Totaljobs scraper, begin by identifying your target job categories and locations on Totaljobs.com. Navigate to the website and perform searches using relevant keywords, location filters, and other criteria. Copy the resulting search page URLs to use as input for the scraper.

Configure your JSON input with appropriate retry limits and proxy settings. The platform supports filtering by relevance, salary, date, and distance, so ensure your search URLs reflect these parameters for targeted data collection. Set reasonable limits for max_items_per_url to balance comprehensiveness with processing efficiency.

When running the scraper, monitor the output for data quality and completeness. The structured JSON format allows for immediate integration into databases, spreadsheet applications, or business intelligence tools. Pay particular attention to the salary unification fields for accurate compensation analysis and the location data for geographical insights.

For optimal results, consider running periodic extractions to track job market changes over time. The combination of posting dates and unique job IDs enables effective duplicate removal and trend analysis across different time periods.

Benefits and Applications

The Totaljobs scraper delivers significant time savings by automating what would otherwise require manual browsing through thousands of job listings. This automation enables comprehensive market analysis that would be impractical to conduct manually, transforming weeks of research into hours of automated data collection.

For recruitment agencies, the scraper provides competitive intelligence by revealing industry hiring patterns, salary benchmarks, and skill requirements across different sectors. HR professionals can leverage the salary data for compensation planning and market positioning, while business analysts can identify emerging job market trends and skill demands.

The comprehensive location data enables regional market analysis, helping businesses understand geographical variations in job availability, salary ranges, and skill requirements. This geographic intelligence is invaluable for expansion planning, talent acquisition strategies, and regional market entry decisions.

From a business value perspective, the scraper transforms raw web data into actionable intelligence, enabling data-driven decisions in recruitment, competitive analysis, and market research. The structured output format ensures seamless integration with existing business intelligence systems and analytics platforms.

Conclusion

The Totaljobs scraper represents a powerful solution for accessing and analyzing the UK's most comprehensive job market data. By automating the extraction of detailed job listings from the UK's largest hiring platform with over 280,000 live job advertisements, this tool empowers businesses and researchers with the data-driven insights needed for informed decision-making in today's competitive job market.

Ready to unlock the power of UK job market data? Start leveraging comprehensive Totaljobs data extraction for your recruitment intelligence and market analysis needs today.

Related Actors

• Totaljobs Jobs Details Scraper: Your comprehensive tool for extracting valuable property information from Totaljobs extensive directory platform.

Your feedback

We are always working to improve Actors' performance. So, if you have any technical feedback about Totaljobs Jobs Search Scraper or simply found a bug, please create an issue on the Actor's Issues tab in Apify Console.