1 day trial then $30.00/month - No credit card required now

Reed.co.uk Scraper

lexis-solutions/reed-co-uk-scraper

1 day trial then $30.00/month - No credit card required now

The Reed.co.uk scraper is a web scraping tool that retrieves job postings from Reed.co.uk, a job search website in the UK 🇬🇧

Back to issues Create new issue

companyProfileURL is empty for some results

Closed

testtheworkout opened this issue

Hello, I've noticed that the 'companyProfileURL' is blank for some records and not for others. Every record has a 'companyName' and when clicking on the record I can see no reason why they shouldn't all have a 'companyProfileURL' as there is a clickable name present for all.

An example would be:

This role has a companyProfileURL: https://www.reed.co.uk/jobs/senior-data-manager/52918589

This role does not: https://www.reed.co.uk/jobs/data-scientist/52915607

They both have a companyName and from looking at the record we should also have the 'companyProfileURL'.

I imagine there will also be other values missing for these records as well but I am not sure what other columns would be impacted.

Thanks for looking into this, and any other information you need, please let me know.

If no companyProfileURL is available, is there another identifier unique identifier that could be added to the file? I am trying to identify who is posting each record and I don't think companyName is unique so I am struggling on the other records

Lexis Solutions (lexis-solutions)

Hi, if you open the links from the job page, you can see they are different kinds of pages.

https://www.reed.co.uk/company-profile/willmott-dixon-1340 is a company page, with a banner, description, etc.
https://www.reed.co.uk/jobs/adecco-uk-limited-45420/p45420 is not a company page, but a list of jobs posted by the employer.

To ensure there is always a value that can be used as a key, we've added a new field "companyNameURL", this is the href value from the job page on the employer's name.

This field can be either of the types, but will be present, if the company name leads somewhere.

Hope this is helpful, feel free to reopen the issue if there's anything else we can improve.

Thanks!

Add comment

Developer

Lexis Solutions

Actor metrics

1 monthly user
9 stars
100.0% runs succeeded
1.9 days response time
Created in Mar 2023
Modified 29 days ago

Categories

Business

EURES EU Jobs Scraper

lexis-solutions/eures-eu-jobs-scraper

EURES EU Jobs Scraper helps you search and scrape job data from eures.europa.eu - EURopean Employment Services. EURES by the European Commission & European Labour Authority provides access to over 2 million job posts in Europe.

Lexis Solutions

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

9.7k

161

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

21.1k

468

🏯 Tweet Scraper V2 (Pay Per Result) - X / Twitter Scraper

apidojo/tweet-scraper

⚡️ Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.30 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

6.1k

191

Google Maps Scraper

compass/crawler-google-places

Extract data from hundreds of Google Maps locations and businesses. Get Google Maps data including reviews, images, contact info, opening hours, location, popular times, prices & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

74.6k

407

Facebook Events Scraper

apify/facebook-events-scraper

Facebook Events Scraper extracts data such as event name, location, description or number of users who are interested. You can use URLs of specific events or come up with search queries and explore pretty much unlimited number of events. Search queries can be combined with various search filters.

Apify

749

Google Maps Reviews Scraper

compass/Google-Maps-Reviews-Scraper

Extract all reviews of Google Maps places using place URLs. Get review text, published date, response from owner, review URL, and reviewer's details. Download scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Compass

3.2k

🔥 LinkedIn Jobs Scraper

bebity/linkedin-jobs-scraper

ℹ️ Designed for both personal and professional use, simply enter your desired job title and location to receive a tailored list of job opportunities. Try it today!

Bebity

3.1k

Dun & Bradstreet Scraper

epctex/dnb-scraper

Effortlessly extract valuable company information, financial projections, industry insights, and more from the extensive Dun & Bradstreet commercial database. Dive deep into the D&B Data Cloud, Business Directory, articles, companies, and industries with customized search terms.

epctex

1.7k

Facebook Ads Scraper

apify/facebook-ads-scraper

Extract advertising data from one or multiple Facebook Pages. Get page details, reach estimates, publisher platforms, report count, number of impressions, ad IDs, timestamps, and more. Download Facebook ads data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

4.9k