Google Jobs Scraper

Features

Our Google Jobs Scraper crawls Google Jobs Search Results Pages and extracts data from the HTML in a structured format such as JSON, XML, CSV, or Excel.

The following data can be extracted from each Google Jobs results:

• Google Jobs
• Categories

Google Jobs Scraper

Our Google Jobs Scraper provides real-time results optimized for structured JSON output that you can download and use any way you want.

To save cost and customize the results: contact scrapeit37@gmail.com.

Why use a Google Jobs Scraper?

• ⚡️ Scrape Google jobs results fast and reliable.
• 💪 Actively maintaining. Fix all bugs within two days of business. Please email scrapeit37@gmail.com
• 🙌 Any feature requests, please email scrapeit37@gmail.com. We will implement for you.

Cost of usage

To scrape SERPs effectively, you should use Apify Proxy and you need to set a sufficient limit for Google Jobs Scraper queries (you can see the limit on your Account page).

New Apify users have a free trial of Apify Proxy, so you can use the actor for free at the beginning.

Once the Apify Proxy trial expires, you'll need to subscribe to a paid plan in order to keep using the actor. If you need to increase your Google Jobs Scraper limit on Apify Proxy or have any questions, please email support@apify.com

In terms of platform usage credits, it is our experience that you will get 1,000 results for about $0.25.

Number of results

The scraper will consume one Apify proxy per request, so you will make the best use of your proxies by getting the maximum 100 results per request.

The default number of results per page is 10. You can set maxPagesPerQuery to get more results for each query.

Input settings

The actor gives you fine-grained control over what kind of Google Jobs results you'll get.

You can specify the following settings:

• Query phrases or raw URLs
• Country
• Language
• Exact geolocation
• Jobs Radius
• Filter job by date, job type, industry...
• Maximum of pages per query

For a complete description of all settings, see input specification.

Results

The actor stores its result in the default dataset associated with the actor run, from which you can export it to various formats, such as JSON, XML, CSV, or Excel.

The results can be downloaded from the Get dataset items API endpoint:

https://api.apify.com/v2/datasets/[DATASET_ID]/items?format=[FORMAT]

where [DATASET_ID] is the ID of the dataset and [FORMAT] can be csv, html, xlsx, xml, rss or json.

For each Google Jobs results page, the dataset will contain a single record, which in JSON format looks as follows. Bear in mind that some fields have example values:

1{
2  "searchQuery": {
3    "term": "teacher",
4    "page": 1,
5    "type": "SEARCH",
6    "domain": "google.com",
7    "countryCode": "US",
8    "languageCode": null,
9    "locationUule": null,
10    "resultsPerPage": 10
11  },
12  "url": "https://www.google.com/search?ibp=htl%3Bjobs&q=teacher",
13  "hasNextPage": true,
14  "googleJobs": [
15    {
16      "title": "Lead Teacher",
17      "companyName": "primrose school of ashburn at broadlands",
18      "location": "Virginia",
19      "via": "via FOX21News Jobs",
20      "description": "<Long Google Jobs Description>",
21      "job_highlight": "<Long Google Jobs Highlight>",
22      "apply_link": {
23        "title": "Apply on Linkedin",
24        "link": "<Link to Linkedin>"
25      },
26      "relatedLinks": [
27        {
28          "link": "https://www.google.com/search?hl=en&q=Lead+Teacher",
29          "text": "Search for lead teacher"
30        }
31      ],
32      "extras": [
33        "5 hours ago",
34        "Full-time",
35        "No degree mentioned",
36        "Health insurance",
37        "Dental insurance",
38        "Paid time off"
39      ],
40      "metadata": {
41        "postedAt": "5 hours ago",
42        "scheduleType": "Full-time"
43      }
44    },
45    {
46      "title": "Assistant Teacher",
47      "companyName": "primrose school of ashburn at broadlands",
48      "location": "Virginia",
49      "via": "via PIX11 Jobs",
50      "description": "<Long Google Jobs Description>",
51      "job_highlight": "<Long Google Jobs Highlight>",
52      "apply_link": {
53        "title": "Apply directly on ZipRecruiter",
54        "link": "<Link to apply>"
55      },
56      "extras": [
57        "10 days ago",
58        "Full-time",
59        "No degree mentioned",
60        "Health insurance",
61        "Dental insurance",
62        "Paid time off"
63      ],
64      "metadata": {
65        "postedAt": "10 days ago",
66        "scheduleType": "Full-time"
67      }
68    },
69    ...
70  ],
71  "categories": [
72    {
73      "type": "Title",
74      "param": "job_family_1",
75      "options": [
76        {
77          "text": "All"
78        },
79        {
80          "text": "Teacher",
81          "value": "teacher"
82        },
83        {
84          "text": "English teacher",
85          "value": "english teacher"
86        },
87        {
88          "text": "Education teacher",
89          "value": "education teacher"
90        },
91        ...
92      ]
93    },
94    {
95      "type": "Location",
96      "param": "city",
97      "options": [
98        {
99          "text": "All"
100        },
101        {
102          "text": "Virginia Beach, VA",
103          "value": "pycV_OjBuolzAS6jgBAWBA=="
104        },
105        {
106          "text": "Chicago, IL",
107          "value": "7cv00DwsDogAwMAJrabgrw=="
108        },
109        ...
110      ]
111    },
112    {
113      "type": "Date posted",
114      "param": "date_posted",
115      "options": [
116        {
117          "text": "All"
118        },
119        {
120          "text": "Past day",
121          "value": "today"
122        },
123        {
124          "text": "Past 3 days",
125          "value": "3days"
126        },
127        ...
128      ]
129    }
130    ...
131  ]
132}

When using a tabular format such as csv or xls, you'll get a table where each row contains just one google jobs result. For more details about exporting and formatting the dataset records, please see the documentation for the Get dataset items API endpoint.

Personal data

You should be aware that search results can contain personal data. Personal data is protected by GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. You can also read our blog post on the legality of web scraping.

Changelog

v0.2- Add more information

• Scrape job highlights, apply link... v0.1- Launch
• Google Jobs Scraper is well-tested. We guarantee fixing all bugs within 2 days of business.