Thesis Literature Review Scraper

Researchgpt Deep Research Agent

wheat_tourist/researchgpt-deep-research-agent

🔬 Transform any topic into a comprehensive research report in minutes! Scrapes Wikipedia, arXiv, Semantic Scholar, news & web sources. Outputs professional JSON, HTML & PDF reports. Perfect for students, researchers, content creators & businesses. No API keys needed.

URL to BibTeX Converter

crawlerbros/url-to-bibtex-converter

Convert any URL (academic papers, articles, books, web pages) to properly formatted BibTeX citations. Automatically extracts metadata from arXiv, PubMed, IEEE, ACM, and general web pages. Supports multiple citation types.

arXiv Metadata Collector— Metadata, PDF, Authors & Abstract

scrapepilot/arxiv-metadata-collector---metadata-pdf-authors-abstract

Scrape arXiv research papers with metadata including title, authors, abstract, PDF links, DOI, and categories. Supports keyword search, proxy integration, and structured dataset output for AI, ML, and academic research use

Crossref Scraper

automation-lab/crossref-scraper

Search and extract academic paper metadata from Crossref — titles, authors, DOIs, citations, abstracts, and journal details. Process thousands of scholarly articles in a single run. Export to JSON, CSV, or Excel for literature reviews and citation analysis.

Google Scholar Search Scraper

ecomscrape/google-scholar-search-scraper

Extract comprehensive academic data from Google Scholar including research papers, citations, author information, and PDF links. Automate your literature review process with advanced scraping capabilities for researchers and academics.

NASA Reports Scraper

parseforge/nasa-reports-scraper

Access NASA’s Technical Reports Server (NTRS) with an automated scraper that collects scientific papers, conference proceedings, journal articles, and research reports. Provides structured metadata for researchers, scientists, and academics needing large-scale access to NASA’s technical publications

Search PubMed's 35M+ biomedical research papers. Extract abstracts, authors, citations, MeSH terms, and publication data. Ideal for literature reviews, meta-analyses, and medical research.

Open Library Authors Scraper

parseforge/open-library-authors-scraper

Discover rich author profiles and book lists from Open Library in one run. Search by author name or paste a profile link to collect bios, life dates, photos, IDs, and works in a clean format. Great for research, catalogs, editorial planning, and building trusted reading collections.

Second Brain Builder — Karpathy's LLM Wiki, Automated

openclawai/second-brain-builder

Transform web content into an organized Obsidian-compatible knowledge base with AI-powered compilation. Scrapes any website and generates a Second Brain structure with wikilinks.

Edusson Profile Spider

getdataforme/edusson-profile-spider

The Edusson Profile Spider scrapes comprehensive writer profiles from Edusson, extracting ratings, skills, achievements, and bios for research, education, and business insights. It delivers fast, accurate JSON data with multi-URL support, error resilience, and seamless Apify integration.

arXiv Search Scraper 📚

easyapi/arxiv-search-scraper

Extract comprehensive research paper data from arXiv search results. Get detailed metadata including titles, authors, abstracts, categories and more. Perfect for academic research monitoring, trend analysis and building paper databases. 🎓📚