Google Scholar Scraper

Google Scholar Scraper collects the academic results shown for a search on Google Scholar. It organizes publication details, author information, citations, versions, and available full-text links in an Apify dataset. The Actor collects result-page information; it does not download papers or open publisher pages.

What can you collect?

Each result can include the publication title and link, author line, publication venue, publisher, year, citation and version counts, and links to related results or full text when Google Scholar displays them. A short result description and the search query can also be included. Optional fields are omitted when the result does not show them, and citation counts are included only when Google Scholar displays a clear value.

Use the dataset to organize literature searches, compare publications across queries, or find citation and version links for research workflows.

How to search Google Scholar

1. Open the Actor's Input tab and enter one search query or a list of up to ten queries.
2. Set the maximum results per query and the number of result pages to inspect.
3. Optionally choose a publication-year range, sort by relevance or date, and select the Scholar interface language.
4. Select Start. Open the completed run's dataset to review or download the results.

You can also schedule the Actor in Apify or retrieve the dataset through the Apify API. The Input tab lists all available settings.

Input example

{
  "queries": [
    "attention is all you need",
    "retrieval augmented generation"
  ],
  "maxItems": 10,
  "maxPages": 2,
  "maxTotalItems": 20,
  "sortBy": "relevance",
  "language": "en"
}

Use query for one search or queries for several; when both are provided, queries takes precedence. maxItems is a per-query limit, while maxTotalItems caps the combined dataset.

Output example

This simplified example shows common publication fields. Available details depend on each search result.

{
  "recordType": "google-scholar-result",
  "dataAvailable": true,
  "recordId": "1:abc123",
  "position": 1,
  "globalPosition": 1,
  "page": 1,
  "resultId": "abc123",
  "title": "Fictional widget study",
  "link": "https://example.org/paper",
  "authors": "A Author, B Writer",
  "publication": "Journal Name, 2017",
  "year": 2017,
  "citedBy": 12,
  "searchQuery": "attention is all you need",
  "queryIndex": 1,
  "sourceType": "fixture",
  "searchUrl": "https://scholar.google.com/scholar?q=attention+is+all+you+need&hl=en"
}

Download the dataset in formats available in Apify, including JSON, HTML, CSV, and Excel, or use the dataset API in another workflow.

Pricing and availability

Check the Actor's Pricing tab for current costs. Apify platform usage may be charged separately according to your plan and the resources used. Google Scholar may show different results by query, language, and date, so a search can return fewer records than its limit.

Terms and support

This Actor collects information displayed on Google Scholar result pages and does not provide access to paper contents. Review Google's terms and applicable laws before using the results. For questions or feedback, use the Actor's Issues tab.