Pricing

$19.89/month + usage

Try for free

Go to Apify Store

Semantic Scholar Scraper - Cheap 📚🔎🤖

Try for free

🔎 Easily collect research papers from Semantic Scholar Provide one or multiple search keywords, paper URLs or author profiles and extract structured academic data such as 📄 Paper Title👨‍🔬 Authors 📅 Publication Year 🔗 Paper URL & more Perfect for academic research & AI research monitoring 📚

Pricing

$19.89/month + usage

Rating

5.0

(1)

Developer

Storm_Scraper

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Semantic Scholar Papers Scraper 📚🔎🤖

The Semantic Scholar Papers Scraper is a powerful automation tool designed to extract structured academic research data directly from:

👉 Semantic Scholar

Whether you're monitoring research trends, tracking citations, analyzing scientific publications, building academic datasets, or collecting AI research papers — this scraper helps you collect clean, structured paper data quickly and reliably.

🔍 What It Does

Simply provide one or more Semantic Scholar search URLs, author pages, or paper listings, and the scraper will:

✅ Scrape research papers from each URL independently

✅ Automatically paginate through results to collect more papers

✅ Respect maxItemsPerUrl limits

✅ Extract clean, structured academic metadata

✅ Provide ready-to-use dataset views

📊 Data Extracted

🔹 Overview Fields

Field	Description
🆔 paperId	Paper identifier
📄 title	Paper title
👨‍🔬 authors	Paper authors
📅 year	Publication year
📊 citationCount	Number of citations
🏫 venue	Journal / conference
🔗 paperUrl	Direct paper page
🌐 sourceUrl	Original search URL

🔹 Detailed Fields

Field	Description
paperId	Paper identifier
title	Paper title
abstract	Paper abstract
authors	Authors list
authorIds	Author identifiers
year	Publication year
venue	Journal / conference
publicationDate	Publication date
citationCount	Number of citations
referenceCount	Number of references
influentialCitationCount	Influential citations
fieldsOfStudy	Research fields
publicationTypes	Publication types
journalName	Journal name
openAccessPdf	Open access PDF link
pdfUrl	PDF download link
paperUrl	Paper page URL
sourceUrl	Source search URL
scrapeTimestamp	Data extraction timestamp

🛠 How to Use

1️⃣ Deploy the Actor on Apify

2️⃣ Provide one or more Semantic Scholar search URLs

Examples:

https://www.semanticscholar.org/search?q=machine%20learning

https://www.semanticscholar.org/author/

3️⃣ Set maxItemsPerUrl

0 = unlimited

Any number = maximum papers per URL

4️⃣ Run the scraper

5️⃣ Export your data in:

✅ JSON

✅ CSV

✅ Excel

✅ XML

✅ HTML

💸 Pricing

This scraper runs on a monthly subscription model.

You only pay for successful runs.

💳 Price: $19.89 / month

If you're interested in other Rutube, E-commerce, Events, Real Estate, Jobs, Company Leads, YouTube or Facebook scraping solutions, check out these related tools:

You can even apply sentiment analysis on the data text we've extracted! 😃📊:

Sentiment Analysis Text Classification 📈

⚙️ Input Configuration

📥 Input Example

{
  "urls": [
    "https://www.semanticscholar.org/search?q=AI&sort=relevance",
    "https://www.semanticscholar.org/search?q=machine+learning&sort=relevance"
  ],
  "maxItemsPerUrl": 30
}

Input Fields

Field	Type	Description
urls	array	One or more Semantic Scholar search URLs
maxItemsPerUrl	integer	Maximum number of papers to collect per URL (0 = unlimited)

📤 Output Example

{
    "paperId": "530a059cb48477ad1e3d4f8f4b153274c8997332",
    "title": "Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI",
    "authors": "Alejandro Barredo Arrieta, Natalia Díaz Rodríguez, Francisco Herrera",
    "fieldsOfStudy": "Computer Science, Philosophy",
    "venue": "Information Fusion",
    "pubDate": "22 October 2019",
    "citationCount": 7,
    "pdfUrl": "https://arxiv.org/pdf/1910.10045.pdf",
    "abstract": "Previous efforts to define explainability in Machine Learning are summarized, establishing a novel definition that covers prior conceptual propositions with a major focus on the audience for which explainability is sought, and a taxonomy of recent contributions related to the explainability of different Machine Learning models are proposed.",
    "paperUrl": "https://www.semanticscholar.org/paper/Explainable-Artificial-Intelligence-(XAI)%3A-and-AI-Arrieta-Rodr%C3%ADguez/530a059cb48477ad1e3d4f8f4b153274c8997332",
    "sourceUrl": "https://www.semanticscholar.org/search?q=AI&sort=relevance"
  },
  {
    "paperId": "81600fd653a828d69f6160705be6814dd101beb7",
    "title": "From local explanations to global understanding with explainable AI for trees",
    "authors": "Scott M. Lundberg, G. Erion, Su-In Lee",
    "fieldsOfStudy": "Computer Science, Mathematics",
    "venue": "Nature Machine Intelligence",
    "pubDate": "1 January 2020",
    "citationCount": 6,
    "pdfUrl": "https://doi.org/10.1038/s42256-019-0138-9",
    "abstract": "An explanation method for trees is presented that enables the computation of optimal local explanations for individual predictions, and the authors demonstrate their method on three medical datasets.",
    "paperUrl": "https://www.semanticscholar.org/paper/From-local-explanations-to-global-understanding-AI-Lundberg-Erion/81600fd653a828d69f6160705be6814dd101beb7",
    "sourceUrl": "https://www.semanticscholar.org/search?q=AI&sort=relevance"
  }

📊 Preconfigured Dataset Views

🔎 Overview View

Quick summary of collected papers.

Fields included:

Paper ID

Title

Year

Authors

Citation Count

Source URL

📚 Detailed View

Complete research metadata for each paper.

Fields included:

Paper ID

Title

Year

Authors

Venue

Journal Name

Journal Volume

Journal Pages

Fields of Study

Citation Count

TLDR summary

DOI

DOI URL

PDF URL

Paper URL

Open Access status

Abstract

Source URL

🌐 By Source URL View

Groups papers based on the search URL they were scraped from.

Fields included:

Source URL

Paper ID

Title

Year

Authors

Citation Count

Paper URL

🌍 Why Use This Scraper?

📚 Literature Reviews Collect large sets of papers for academic research.

🤖 AI Research Monitoring Track new publications in fields like Machine Learning, NLP, and Computer Vision.

📊 Citation Analysis Analyze citation counts and identify influential research.

🏫 Academic Dataset Creation Build datasets for bibliometric analysis or research trend analysis.

🔬 Scientific Trend Tracking Monitor emerging topics across scientific publications.

Disclaimer

This scraper is an independent automation tool and is not affiliated with, endorsed by, or sponsored by Student.com.

📫 Support & Contact

😊 Leave a 5-star rating ⭐⭐⭐⭐⭐ if you’re satisfied

🌪️ Storm Scraper https://apify.com/scrapestorm

For questions, feature requests, or custom scraping solutions, contact us directly via Apify or email.

Education & Research Email Scraper – Cheap & Advanced 🎓📧

scrapestorm/education-research-email-scraper---cheap-advanced

🔍 Scrape Education & Research Emails Easily Enter your search parameters (e.g. academic title, email domains & platform) to collect verified academic or institutional contacts along with role title, research snippet & more 📊 Perfect for academic outreach & education database enrichment 🧩

Storm_Scraper

5.0

(1)

Baidu Library (Wenku) Scraper - 便宜 Cheap 🇨🇳📚🔎

scrapestorm/baidu-library-wenku-scraper---bian-yi-cheap

📚 Easily Collect Baidu Wenku 🇨🇳🔎 Extract document search results from Baidu Wenku for any keyword, including document URLs, titles, cover images, authors, page counts, ratings, views & more 🌐📊 Perfect for document trend monitoring, competitor intelligence & Baidu Wenku SERP tracking 🚀✨

Storm_Scraper

5.0

(1)

Hugging Face Models Scraper - Cheap 🤗🤖🔎

scrapestorm/hugging-face-models-scraper---cheap

🟠 Easily collect Models from Hugging Face Provide one or multiple search keywords and extract structured model data including model name, owner, likes, downloads, tags, last update date, match count & more 🤖📊 Perfect for AI model research, popularity tracking & model ecosystem monitoring 🚀

Storm_Scraper

5.0

(1)

HuggingFace Scraper (All-in-One) 🚀🤗🔎

scrapestorm/huggingface-scraper-all-in-one

🟠 Easily collect Models, Datasets & Spaces from Hugging Face Provide one or multiple search keywords and extract data across the entire HuggingFace ecosystem including Repository name 👤 Owner 🔗 Source search URL & more… Perfect for AI architecture research & full ecosystem intelligence 🚀🤖

Storm_Scraper

5.0

(1)

n8n Templates Scraper - Cheap 🚀🔎⚡

scrapestorm/n8n-templates-scraper---cheap

🟠 Easily collect Workflow Templates from n8n Provide one or multiple n8n workflow search URLs and extract template data including 🆔 Workflow ID🏷️ Title 👤 Creator 💰 Price 🌐 Source search URL 📊 and more… Perfect for automation workflow research and integration ecosystem analysis 🚀🤖📊

Storm_Scraper

5.0

(1)

FINRA BrokerCheck Scraper - Cheap 🔎📊

scrapestorm/finra-brokercheck-scraper---cheap

🔍 Easily collect broker & firm records from FINRA BrokerCheck Provide one or multiple individual names, firm names, CRD numbers, or location filters and extract detailed regulatory data such as name & more 📋📊 Perfect for compliance monitoring & financial professional research 🚀📈

Storm_Scraper

5.0

(1)

GitHub Followers / Following Scraper - Cheap 🔍🐙👥

scrapestorm/github-followers-following-scraper---cheap

🔍 Easily collect followers & following from GitHub Provide a GitHub profile URL or username and extract detailed user information such as username, display name, bio, location & profile link 👥🐙 Perfect for community analysis, network mapping, lead generation & market intelligence 📊🔥

Storm_Scraper

5.0

(1)

Stripe App Marketplace Scraper - Cheap 💳🛍️🔎

scrapestorm/stripe-app-marketplace-scraper---cheap

🟣 Easily collect Apps from the Stripe Marketplace Provide one or multiple Stripe Marketplace category or search URLs and extract app data including 🆔 App Slug 🏷️ Name 📝 Tagline 🗂️ Source URL 🔗 App URL & more… Perfect for Stripe ecosystem research and SaaS competitive monitoring 🚀📊💳

Storm_Scraper

5.0

(1)

GitHub Repositories Scraper - Cheap📦🐙🔍

scrapestorm/github-repositories-scraper---cheap

🔍 Easily collect repositories from GitHub Provide a GitHub profile URL or username and extract detailed repository information such as repository name, description, language, stars, topics & repository link 📦🐙 Perfect for open-source analysis, developer scouting & market intelligence 📊🔥

Storm_Scraper

5.0

(1)

Made in China Product Scraper 🔎🇨🇳🛒

scrapestorm/made-in-china-product-scraper

🟠 Easily collect Products from Made-in-China Provide one or multiple Made-in-China search or category URLs and extract product data including 🆔 Product ID 🏷️ Title 💲 Price Range 📍 Location 🌐 Source URL 🔗 Product URL & more… Perfect for B2B sourcing research and competitor monitoring 🚀📊🏭

Storm_Scraper

5.0

(1)

Baidu Scraper All-in-One - 便宜 Cheap 🇨🇳🔎🌐

scrapestorm/baidu-scraper-all-in-one---bian-yi-cheap

🔍 Easily Collect Baidu Search Results Across All Verticals 🇨🇳🌐 Extract structured search results from Baidu — including Web, Images, Videos, News, Notes and Library — for any keyword Perfect for China market research, SEO, media tracking, competitor analysis & multi-vertical SERP monitoring 🚀

Storm_Scraper

5.0

(1)