Start URLs
URLs to start with. It should be a search URL
Search Queries
(Required if you don't use 'Start URLs') You can provide a list of queries that you want to search.
Country
Country determines the Google Search domain (e.g. google.es
for Spain).
This setting only applies to Search queries.
Value options:
Default value of this property is
Language
Language for the search results, which is passed to Google Search as the hl URL query parameter. (af, tr, de, etc...)
Value options:
Default value of this property is
Location UULE
The code for the exact location for the Google search. It's passed to Google Search as the uule URL query parameter. You can use the UULE code generator https://padavvan.github.io/
Maximum number of items
Maximum number of items that you want as output. Default is all
Results per page
Number of search results for each Google result page. By default, Google Search returns 10 results per page. The allowed values are 10, 20, 30, 40, 50 and 100.
Value options:
Default value of this property is
Include unfiltered results
If checked, the lower-quality results that Google normally filters out will be included. This usually consists of a few hundred extra results.
Default value of this property is
List end page
The page number that you want to end with. By default there is no end page. This is applies to all search request and startUrls individually.
Extend output function
Function that takes a JQuery handle ($) as argument and returns data that will be merged with the default output
Custom map function
Function that takes each of the objects as argument and returns data that will be mapped by the function itself.
Proxy configuration
Select proxies to be used by your crawler.
- 38 users
- 228 runs
- Modified about 23 hours ago