root = true

[*]
indent_style = space
indent_size = 4
charset = utf-8
trim_trailing_whitespace = true
insert_final_newline = true
end_of_line = lf


.editorconfig

.eslintrc

# This file tells Git which files shouldn't be added to source control

.idea
node_modules

apify_storage

.gitignore

# First, specify the base Docker image. You can read more about
# the available images at https://sdk.apify.com/docs/guides/docker-images
# You can also use any other image from Docker Hub.
FROM apify/actor-node:16

# Second, copy just package.json and package-lock.json since it should be
# the only file that affects "npm install" in the next step, to speed up the build
COPY package*.json ./

# Install NPM packages, skip optional and development dependencies to
# keep the image small. Avoid logging too much and print the dependency
# tree for debugging
RUN npm --quiet set progress=false \
 && npm install --only=prod --no-optional \
 && echo "Installed NPM packages:" \
 && (npm list --only=prod --no-optional --all || true) \
 && echo "Node.js version:" \
 && node --version \
 && echo "NPM version:" \
 && npm --version

# Next, copy the remaining files and directories with the source code.
# Since we do this after NPM install, quick build will be really fast
# for most source file changes.
COPY . ./

# Optionally, specify how to launch the source code of your actor.
# By default, Apify's base Docker images define the CMD instruction
# that runs the Node.js source code using the command specified
# in the "scripts.start" section of the package.json file.
# In short, the instruction looks something like this:
#
# CMD npm start


Dockerfile

Specify Google Jobs Search queries or full URLs. Beware that the additional settings such as Country, Language, or UULE location code only apply to the search queries, but not the URLs.

Notice: To get Google Jobs results from a location, please use UULE param(Setting country to 'es' will not return Google Jobs Results from Spain. To get Google Jobs Results from Spain, please use UULE param) . This param is for the Google Search domain (e.g. <code>google.es</code> for Spain). The values must be lower-cased <a href="https://en.wikipedia.org/wiki/ISO_3166-1_alpha-2" target="_blank">ISO 3166</a> country codes supported by Google. By default, the actor uses United States (<code>google.com</code>). This setting only applies to Search queries, but not to URLs.

Here you can specify further parameters of the scrape. However we worked hard to set the best options for you already.

Country

If checked, the crawler will return results in a structure suitable for CSV format. Only 'googleJobs' results are included. CSV headers would be: title, companyName, location, description...

CSV friendly output (1 result on 1 row)

Jobs results can be filtered by this filter param. The filter param can built from <code>categories.param:categories.options.value</code>. Eg: <code>date_posted:today</code>,<code>employment_type:FULLTIME</code>

Filter Param

If checked, the lower quality results that Google normally filters out will be included. Usually it is few hundred extra results.

Include unfiltered results

Language for the search results, which is passed to Google Search as the <code>hl</code> URL query parameter. Only set this if you want to use a non-default language for the selected country. The values must be lower-cased <a href="https://en.wikipedia.org/wiki/List_of_ISO_639-1_codes" target="_blank">ISO 639</a> language codes supported by Google. This setting only applies to Search queries, but not to URLs.

Language

The code for geolocation of search results. It's passed to Google Search as the <code>uule</code> URL query parameter. You can use the <a href='https://padavvan.github.io/' target='_blank'>UULE code generator</a>. Learn more about <a href='https://moz.com/ugc/geolocation-the-ultimate-tip-to-emulate-local-search' target='_blank'>emulating local search</a>. This setting only applies to Search queries, but not to URLs.

UULE location code

The maximum number of search results pages the crawler will load in parallel. A higher number means you will get your results faster, but also it will burn through your available proxies quicker.

Max concurrency

The maximum number of search result pages for each search query.

Max pages per query

Google Jobs Search queries (e.g. <code>Teacher</code>) and/or full URLs (e.g. <code>https://www.google.com/search?q=teacher&ibp=htl;jobs</code>). Enter one item per line.

Search job queries or URLs

Allow you to search jobs within the radius - in kilometers.

Jobs radius

If checked, the HTML of Google Search results pages will be stored to the default dataset, under the <code>html</code> property. This is useful if you need to process the HTML, but it makes the dataset large and reduces performance.

Save HTML to dataset

If checked, the HTML of the Google Search results pages will be stored to the default key-value store and links to the files stored to the dataset under the <code>htmlSnapshotUrl</code> property. This is useful for debugging, since you can easily view the the pages in browser, but use of this feature has some performance penalty.

Save HTML to key-value store

Google Jobs Search Scraper input

INPUT_SCHEMA.json

google-jobs-scraper

apify.json.deprecated

main.js

scraper

package.json

.actor/actor.json

src/consts.js

src/google_domains.json

src/tools.js

Google Jobs Scraper is to enable you to scrape Google Jobs Results, extract "googleJobs", "categories". Allow customizing country or language or job radius and extraction of custom attributes. Download data as HTML table, JSON, CSV, Excel, XML.

Google Jobs Scraper

Google Jobs Scraper · Apify

Input · Google Jobs Scraper · Apify

API · Google Jobs Scraper · Apify

Related Actors · Google Jobs Scraper · Apify

Google Jobs Scraper is to enable you to scrape Google Jobs Results, extract "googleJobs", "categories". Allow customizing country or language or job radius and extraction of custom attributes. Down...

Where next?