Google Scholar Scraper

What is this tool?

Google Scholar Scraper helps you collect scholar data from Google (the world's most popular search engine). Just type in a research topic, and the tool will gather academic papers, theses, books, conference papers, and other scholarly literature.

What can you use it for?

• Academic and scientific research
• Literature reviews and meta-analyses
• Track citations and research impact
• Find experts and researchers in any field

What data do you get?

Each result includes up to 47 fields, organized into the following categories:

Identity (7 fields): Type, Result Type, Position, Page, Venue Type, Cluster ID, Type of Work

URLs (14 fields): Article URL, Link (alias), Author Links, Cited By URL, Cites URL, PDF URL, HTML URL, Versions URL, BibTeX URL, Abstract URL, Domain, Favicon, Image URL, Search URL

Text (4 fields): Title, Title (HTML), Snippet, Description

Media (1 fields): Thumbnail

Engagement (1 fields): Versions Count

Location (2 fields): Publication Venue, Venue

Dates & Duration (3 fields): Published At, Published At (raw), Date

Categorization (1 fields): Tags

Source (2 fields): Authors, Publisher

Search Context (5 fields): Keywords, Language, Search Metadata, Query, Query (alias)

Other (7 fields): Year, Cited By, Citing, DOI, Subjects, Free PDF, Scraped At

How to use it

Step 1: Enter your search

Type in a research topic or academic query, like "transformer neural network" or "climate change adaptation".

Step 2: Set your preferences

Adjust the options below to customize your search.

Step 3: Run the tool

Click the run button and wait for your results. The tool will gather all the data and save it in a clean, organized format.

Input options

Option	What it means	Required	Default
Search Query	The academic search query to look up on Google Scholar	Yes	machine learning
Maximum Items	Max scholar results to retrieve	No	50
Year From	Filter results published from this year onwards (optional)	No	—
Year To	Filter results published up to this year (optional)	No	—
Sort By	Sort results by relevance or date Options: relevance (Relevance), date (Date).	No	relevance

Output

Your results come in a clean, organized table with two views:

Overview view

Shows the most important fields at a glance:

• Position
• Title
• Authors
• Publication Venue
• Year
• Cited By
• Query
• Scraped At

Full details view

Shows all 47 fields in detail. See "What data do you get?" above for the complete list.

Tips for best results

✅ Be specific with your search terms for more relevant results

✅ Try different variations of your search term to discover more results

✅ Browse multiple pages of results to get a wider variety

Frequently asked questions

Why use Google? Google is the world's most popular search engine, handling over 8 billion searches per day. It has the largest index of web pages and provides the most comprehensive search results.

How do I get the results? Your results are saved in your Apify dashboard. You can download them in various formats (JSON, CSV, Excel) or access them via the API.

Can I run it on a schedule? Yes! Apify supports scheduled runs. You can set up the tool to run automatically at any interval (hourly, daily, weekly, etc.) from your dashboard.

What if I get fewer results than I asked for? This can happen if the search engine doesn't have enough matching results for your search, or if some results are blocked. Try different keywords or relax your filters.

Need more help? If you have questions or run into issues, our support team is ready to help. Just reach out through the Apify platform and we'll get back to you quickly.