Pricing

$19.99/month + usage

Google Search Results Scraper: Research Papers & Citation Count

Google Search Results Scraper: Research Papers & Citation Counts extracts Google search results for academic papers, including titles, authors, publication links, citation counts, snippets, and URLs. Ideal for academic research, literature reviews, citation analysis, and competitive research.

Pricing

$19.99/month + usage

Rating

0.0

(0)

Developer

ScrapePilot

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Categories

Automation

Lead generation

Social media

🔍 Search term(s)

queries

Required

Use regular search words or enter Google Search URLs. You can also apply advanced Google search techniques, such as AI site:twitter.com or javascript OR python. You can also define selected search filters as separate fields below (in the Advanced search filters section). Just ensure that your queries do not exceed 32 words to comply with Google Search limits.

Type:string

📊 Results per page

resultsPerPage

Optional

Specifies the desired number of results per page that is passed to Google Search as the num parameter. However, Google applies its own internal filtering and quality checks, so the actual number of returned results may differ from this value, especially on the first page. To potentially retrieve more results closer to your desired count, consider enabling the "Unfiltered results" option from the "Additional settings" section below, which includes results that Google normally filters out.

Type:integer

Minimum:1

Maximum:100

Default:100

📄 Max pages per search

maxPagesPerQuery

Optional

Maximum number of pages to scrape per search query. Each page contains approximately 10 results.

Type:integer

Minimum:1

Default:1

⏩ Add-on: Google AI Mode ($)

aiMode

Optional

Enable scraping of Google's AI Mode to perform Answer Engine Optimization (AEO), GEO targeting, track brand visibility, and analyze competitors.

Type:string

Default:aiModeOff

Options:

aiModeOffaiModeWithSearchResultsaiModeOnly

🔑 SerpApi key (for AI Overview)

serpApiKey

Optional

Optional. When set and AI Mode is not off, fetches AI Overview via SerpApi.

Type:string | null

⏩ Add-on: Perplexity AI search ($)

perplexitySearch

Optional

Enable Perplexity to retrieve AI-generated answers and citations using the Sonar model. This feature is designed for cross-platform analysis, allowing you to directly compare Google AI Mode and ChatGPT results against Perplexity's perspective to identify narrative differences and coverage gaps.

Note: An additional fee applies per result when this feature is active. Please refer to the Pricing tab for your specific rate.

Type:object

Default:

{
  "enablePerplexity": false,
  "searchRecency": "",
  "returnImages": false,
  "returnRelatedQuestions": false
}

⏩ Add-on: ChatGPT Search ($)

chatGptSearch

Optional

Enable ChatGPT to retrieve AI-generated answers powered by OpenAI's search model. This feature is designed for cross-platform analysis, allowing you to directly compare Google AI Mode and Perplexity results against ChatGPT's perspective to identify narrative differences, coverage gaps, and search engine biases.

The output includes query fan-out under queryFanOut, showing additional search queries the model generated to answer your question.

Note: An additional fee applies per result when this feature is active. Please refer to the Pricing tab for your specific rate.

Type:object

Default:

{
  "enableChatGpt": false
}

⏩ Add-on: Extract Business Leads Information - Maximum leads per domain ($)

maximumLeadsEnrichmentRecords

Optional

Enrich your results with detailed contact and company information, including employee names, job titles, emails, phone numbers, LinkedIn profiles, and key company data like industry and number of employees.

This setting allows you to set the maximum number of leads records you want to scrape per each domain found. By default, it's set to 0 which means that no leads information will be scraped.

⚠️ Note that some of the fields contain personal data. GDPR protects personal data in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your use case is legitimate, please consult an attorney.

To keep your leads relevant, we automatically filter out large chains and online platforms (e.g., social media, retail giants, food delivery services).

⚠️ Cost warning: This is a multiplier. Requesting 10 leads for 1,000 domains will attempt to find 10,000 total leads. You are only charged for leads successfully found.

Type:integer

Minimum:0

Default:0

🏢 Leads departments selection

leadsEnrichmentDepartments

Optional

You can use this filter to include only specific departments (like Sales, Marketing, or C-Suite). Note: This will only work if the ⏩ Add-on: Extract business leads information - Maximum leads per domain (maximumLeadsEnrichmentRecords) option is enabled. Please note that some job titles are sometimes miscategorized in the wrong departments.

Type:string[]

Default:

[]

⏩ Add-on: Enable paid results (ads) extraction ($)

focusOnPaidAds

Optional

Enable extraction of paid results (Google Ads). This feature improves ad detection accuracy by using an ad-specialized proxy to perform up to 3 retries for each search query. Best used for queries likely to show ads. An extra cost per search page applies when enabled, regardless of ads found. Pricing depends on your Apify subscription plan.

Type:boolean

Default:false

🌍 Country

countryCode

Optional

Specifies the country used for the search and the Google Search domain (e.g. google.es for Spain). By default, the Actor uses United States (google.com).

Type:string

Default:us

Options:

afaldzasadaoaiaqagaramawauatazbsbhbdbbbybebzbjbmbtbobabwbvbriobnbgbfbikhcmcacvkycftdclcncxcccokmcgcdckcrcihrcucyczdkdjdmdoecegsvgqereeetfkfofjfifrgfpftfgagmgedeghgigrglgdgpgugtgngwgyhthmvahnhkhuisinidiriqieilitjmjpjokzkekikpkrkwkglalvlblslrlyliltlumomkmgmwmymvmlmtmhmqmrmuytmxfmmdmcmnmsmamzmmnanrnpnlanncnzninengnunfmpnoompkpwpspapgpypephpnplptprqarerorurwshknlcpmvcwssmstsasncsscslsgsksisbsozagseslksdsrsjszsechsytwtjtzthtltgtktotttntrtmtctvuguaaegbusumuyuzvuvevnvgviwfehyezmzw

🔤 Search language

searchLanguage

Optional

Restricts search results to pages in a specific language. For example, choosing 'German' results in pages only in German. Passed to Google Search as the lr URL query parameter. Read more here.

Type:string | null

Options:

arbgcacsdadeelenesetfifrhrhuidisitiwjakoltlvnlnoplptroruskslsrsvtrzh-CNzh-TW

🌐 Interface Language

languageCode

Optional

Language of the Google Search interface (menus, buttons, etc. - not the search results themselves). Passed to Google Search as the hl URL query parameter. From Google Reference: You can use the hl request parameter to identify the language of your graphical interface. The hl parameter value may affect search results, especially on international queries when language restriction (using the lr parameter) is not explicitly specified. Read more here.

Type:string

Default:en

Options:

afsqsmarazeubebnbhbsbgcazh-CNzh-TWhrcsdanleneoetfofifrfyglkadeelguiwhihuisidiagaitjajwknkolalvltmkmsmlmtmrnenonnocfaplpt-BRpt-PTparorugdsrsiskslessuswsvtltatethtitrukuruzvicyxhzu

📍 Exact location (Google UULE parameter)

locationUule

Optional

The code for the exact location for the Google search. It's passed to Google Search as the uule URL query parameter. You can use the UULE code generator. Learn more about emulating local search.

Type:string | null

🎯 Force exact match

forceExactMatch

Optional

If checked, the scraper will search for the exact phrase in the query. This is done by wrapping the query in quotes. Note that this may return fewer results. Also note that if you're using operators such as OR or AND, the whole query will be wrapped in quotes, such as "Windows AND macOS". If you want to search for queries such as "Windows" AND "macOS", you need to specify them directly in the queries field.

Type:boolean

Default:false

🌐 Site

site

Optional

Limits the search to a specific site, such as: site:example.com. Note that the site filter takes precedence over the relatedToSite filter. If both filters are set, the relatedToSite filter will be ignored and not added to the search queries.

Type:string | null

🔗 Related to site

relatedToSite

Optional

Filters pages related to a specific site, such as: related:example.com. Note that the site filter takes precedence over the relatedToSite filter. If both filters are set, the relatedToSite filter will be ignored and not added to the search queries.

Type:string | null

📝 Words in title

wordsInTitle

Optional

Filters pages with specific words in the title. The scraper uses the intitle: operator, even for multiple words (e.g. recipe site:allrecipes.com intitle:"easy apple" intitle:pie). There's also a allintitle: operator available, but it's problematic when combined with other search filters, so the scraper avoids using it. If you need to use the allintitle: operator specifically, you can include it in your custom queries from the queries field.

Type:array

Max. items:32

Default:

[]

📄 Words in text

wordsInText

Optional

Filters pages with specific words in the text. The scraper uses the intext: operator, even for multiple words (e.g. cartoon site:wikipedia.com intext:cat intext:mouse). There's also a allintext: operator available, but it's problematic when combined with other search filters, so the scraper avoids using it. If you need to use the allintext: operator specifically, you can include it in your custom queries from the queries field.

Type:array

Max. items:32

Default:

[]

🔗 Words in URL

wordsInUrl

Optional

Filters pages with specific words in the URL. The scraper uses the inurl: operator, even for multiple words (e.g. recipe site:allrecipes.com inurl:apple inurl:pie). There's also a allinurl: operator available, but it's problematic when combined with other search filters, so the scraper avoids using it. If you need to use the allinurl: operator specifically, you can include it in your custom queries from the queries field.

Type:array

Max. items:32

Default:

[]

⏱️ Quick date range

quickDateRange

Optional

Filters results from a specific date range. d[number] specifies the number of past days (e.g. the past 10 days can be written as d10). The same applies to hours, weeks, months, and years: h[number], w[number], m[number], y[number]. Example for the past year: 'y1' or even 'y'. The value is passed to Google Search using the tbs URL query parameter, prefixed with qdr:. You should avoid combining this filter with the beforeDate and afterDate filters to prevent conflicts.

Type:string | null

📅 Before date

beforeDate

Optional

Filters results from before the specified date. Either absolute date (e.g. 2024-05-03) or relative date from now into the past (e.g. 8 days, 3 months). Absolute time is always interpreted in the UTC timezone, not your local timezone - please convert accordingly. Supported relative date & time units: days, weeks, months, years. You should avoid combining this filter with the quickDateRange filter to prevent conflicts.

Type:string | null

📆 After date

afterDate

Optional

Filters results from after the specified date. Either absolute date (e.g. 2024-05-03) or relative date from now into the past (e.g. 8 days, 3 months). Absolute time is always interpreted in the UTC timezone, not your local timezone - please convert accordingly. Supported relative date & time units: days, weeks, months, years. You should avoid combining this filter with the quickDateRange filter to prevent conflicts.

Type:string | null

📎 File types

fileTypes

Optional

Filters results of specific file types using the filetype: operator, such as filetype:pdf. You can select multiple file types as well. They will be combined with the OR operator, for example: filetype:doc OR filetype:txt. If you need to use a file type that is not in the list (such as a source code file type), you can include it in your custom queries from the queries field, using the filetype: operator.

Type:string[]

Max. items:10

Default:

[]

📱 Mobile results

mobileResults

Optional

If checked the scraper will return results for mobile version of Google search. Otherwise desktop results are returned.

Type:boolean

Default:false

🔓 Unfiltered results

includeUnfilteredResults

Optional

If checked the lower quality results that Google normally filters out will be included.

Type:boolean

Default:false

💾 Save HTML to dataset

saveHtml

Optional

If checked the HTML of the Google Search results pages will be stored to the default dataset, under the html property. This is useful if you need to process the HTML, but it makes the dataset large.

Type:boolean

Default:false

🗄️ Save HTML to key-value store

saveHtmlToKeyValueStore

Optional

If checked the HTML of the Google Search results pages will be stored to the default key-value store and links to the files stored to the dataset under the htmlSnapshotUrl property. This is useful for debugging since you can easily view the pages in the browser. However, the use of this feature may slow down the Actor.

Type:boolean

Default:true

🖼️ Include icon image data (base64)

includeIcons

Optional

If checked, all of the results (organicResults, paidResults, suggestedResults) will contain Base64-encoded icon image data if found.

Type:boolean

Default:false

🔒 Proxy configuration

proxyConfiguration

Optional

This actor always uses proxies to maximize success rates. By default, it starts with a Google SERP proxy and falls back to residential proxy (with 3 retries) if blocked. Once a residential proxy is used, it will stick to it for all subsequent requests.

Type:object

🎓 Include research paper details

includePaperDetails

Optional

Splits out the research line Google prints in front of a result's snippet — first author, publication year, and the "Cited by 834" count — plus the publisher name shown next to the link, into their own fields instead of leaving them mashed into the description text. Costs no extra request: this is parsed from the page the Actor already downloads. Google only prints this line on academic and technical results, so a consumer query will return these fields empty.

Type:boolean

Default:true

📚 Also collect Google's "Scholarly articles" block

includeScholarlyArticles

Optional

Also collects the "Scholarly articles for " box Google shows on academic topics — each paper's title, first author, citation count, and its link unwrapped to the publisher's own article or PDF. The Actor's normal request carries udm=14 whenever AI Mode is off, which is Google's "Web"-only tab and does not contain this box at all, so this feature issues one extra request per search on the plain search page. Turn it off to get byte-identical base behaviour and zero extra requests. Google shows this box on some academic topics and not others, so it can legitimately come back empty.

Type:boolean

Default:true

🔢 Minimum citation count

minCitations

Optional

Live filter on a number read off the page: keep only papers and results whose printed "Cited by N" is at least this. Leave at 0 to keep everything, including results with no citation line at all. Above 0, results that print no citation count are dropped. Nothing is stored and nothing is compared against a previous run — the filter is applied to what this run just fetched.

Type:integer

Minimum:0

Default:0

📅 Published from year

publishedFromYear

Optional

Live filter on the publication year Google prints in the result line (the "· 2023 ·" part). Keep only papers from this year onwards. Leave at 0 for any year. This is different from the date filters above: those tell Google to restrict the search itself, while this one reads the year printed against each paper. Above 0, results that print no year are dropped.

Type:integer

Minimum:0

Maximum:2100

Default:0

🎯 Only searches that returned research

onlyQueriesWithPapers

Optional

When true, a search that produced neither a "Scholarly articles" box nor a single result with a citation line is dropped from the dataset instead of being pushed as a row with empty paper fields. Useful when running a long list of topics and only wanting the ones with research behind them. Evaluated on the rows fetched in this run only — no history, no comparison against an earlier run.

Type:boolean

Default:false

Google Scholar Lite - Cheap Bulk Academic Papers API

johnvc/google-scholar-lite-api

Search Google Scholar for academic papers in bulk and export clean JSON: title, authors, journal, year, citation count, and PDF links. Fast bibliometric search for literature reviews, citation discovery, and research datasets. Pay per paper from $1.50 per 1,000, with no setup or per-run fee.

John

5.0

Google Scholar Scraper

moving_beacon-owner1/google-scholar-scraper

Scrapes Google Scholar search results, including paper titles, authors, publication years, citation counts, article URLs, and PDF links. Supports multiple queries and year filters for research, literature reviews, and citation analysis.

Jamshaid Arif

Academic Research & Citation Tracker

second_coming/academic-research-tracker

Searches academic databases (arXiv, PubMed, Crossref) for research papers matching keywords. Returns structured citation data including title, authors, journal, DOI, abstract, and URL.

Richard P

📚 OpenAlex Scraper - Academic Papers & Citation Data

benthepythondev/openalex-scraper

OpenAlex Scraper to search 250M+ academic papers via the free OpenAlex API. Extract title, authors, institutions, year, venue, DOI, citation count, open-access status, concepts and PDF links. Filter by year and open access. For literature reviews, citation analysis and AI/RAG datasets.

Ben

Google Scholar Scraper

automation-lab/google-scholar-scraper

Search Google Scholar and extract academic papers. Get titles, authors, citation counts, abstracts, PDF links, and publication details. Supports year filtering.

Stas Persiianenko

Google Scholar Scraper — Papers & Citations

muhammadafzal/google-scholar-scraper

Scrape Google Scholar results with paper titles, authors, publication details, citation counts, related links, and research metadata.

Muhammad Afzal

Google Scholar Scraper

cloud9_ai/google-scholar-scraper

Extract academic papers from Google Scholar: title, authors, year, journal, citation count, abstract snippet, PDF links. Search by keyword with year range filters. Stricter rate limiting for reliability. Perfect for literature review, research trend analysis, citation tracking.

cloud9

Google Scholar Scraper - Low-cost💲🔥📚🎓

delectable_incubator/google-scholar-scraper-low-cost

Scrape Google Scholar academic papers 📚🔍 with a powerful research scraper. Extract paper titles, authors, publication dates, journals/sources, citations, and direct links to full texts. Ideal for academic research, literature reviews, citation analysis, AI/NLP training, and knowledge discovery 🚀

Prime Scrape

5.0

Academic Paper Scraper

labrat011/academic-paper-scraper

Search MILLIONS of academic papers from Semantic Scholar and arXiv by keyword, DOI, or citation graph. Returns titles, authors, abstracts, citation counts, and open access PDFs as clean JSON. Works as an MCP tool for AI agents.

mick_

Semantic Scholar Papers Scraper

scrapers_lat/semantic-scholar-scraper

Scrape academic papers with title, year, venue, citation count, authors, DOI, abstract and a direct link. Search by keyword. Export to JSON, CSV or Excel.