Academia.edu Scraper

Want public Academia.edu papers in a spreadsheet? This scraper makes it easy.

Use structured filters — better for AI agents — or paste an input_url. When input_url is set it overrides the filters.

Academia.edu hosts public papers, books, and conference papers. This actor returns up to 2000 paper rows per run.

💡 Perfect for...

• Research: Export public papers on a topic from Academia.edu.
• Dashboards: Track a keyword without paging the site.
• Literature reviews: Slice papers by type, language, or year.
• Data analysts: Export structured rows with public paper URLs.
• 🤖 AI Agents: Power Claude, Cursor, Codex, the Hermes Agent, and OpenClaw workflows with live Academia.edu results.
• 📚 RAG Systems: Feed titles, authors, and abstracts into retrieval pipelines.
• 🔗 AI Workflows: Plug into LangChain, AutoGPT, CrewAI, and similar stacks.

✨ Why you'll love this scraper

• 🔗 Input URL or Filters: Paste an Academia.edu paper search URL, or pick the same filters as the site. input_url always wins when set.
• 🎯 Website-Matched Filters: Keyword, titles or full text, publication type, language, year, and sort — the same controls as the paper search.
• 🌐 Listing cards: Title, authors, year, abstract, publication, field of study, and author photo.

📦 What's inside the data?

id, url, title, authors, year, abstract, publication, field_of_study, document_type, language, pages, image

🚀 Quick start

Option A: paste https://www.academia.edu/search?q=education. Option B: type a keyword and set max_results.

Input Example (filters):

{
  "query": "education",
  "search_in": "titles",
  "publication_type": "journal-article",
  "year_from": 2020,
  "sort_by": "relevance",
  "max_results": 100
}

Input Example (URL):

{
  "input_url": "https://www.academia.edu/search?q=education",
  "max_results": 100
}

Output Example:

{
  "id": "117874244",
  "url": "https://www.academia.edu/117874244/Education_Education_Education_2004",
  "title": "Education Education Education 2004",
  "authors": "Richard Wilcocks",
  "year": 2005,
  "abstract": "I am sharing this session with Andrew McCarthy…",
  "publication": "The Brontës and Education",
  "field_of_study": "Literacy; English Literature",
  "document_type": "talk",
  "language": "en",
  "pages": 9,
  "image": "https://2.academia-photos.com/54831564/14690253/143516875/s65_richard.wilcocks.jpg"
}

Output fields:

Field	Description
id	Paper id.
url	Public paper page.
title	Paper title.
authors	Authors when shown.
year	Publication year.
abstract	Abstract snippet.
publication	Journal or book name when shown.
field_of_study	Research interests on the card.
document_type	Paper type when shown.
language	Language code when shown.
pages	Page count when shown.
image	Author photo or preview when shown.

📋 Input reference

Parameter	Type	Required	Default	Description
input_url	string	No	—	Academia.edu paper search URL. Overrides every filter.
query	string	No	education	Same as the search box.
search_in	dropdown	No	Titles	Titles or full text.
publication_type	dropdown	No	any	Journal article, book, conference paper, or other.
language	dropdown	No	any	Paper language.
year_from	integer	No	—	Earliest publication year.
year_to	integer	No	—	Latest publication year.
sort_by	dropdown	No	Relevance	Relevance, date, recently added, most cited, or year.
max_results	integer	No	50	Maximum rows (1–2000).