ResearchGate Web Scraper

A powerful web scraper designed to extract comprehensive data from ResearchGate publication pages. This tool automatically fetches and parses academic articles to extract structured information including titles, authors, citations, references, and metadata.

Extracted Data Structure

The scraper returns a comprehensive JSON object containing:

{
  "title": "Article Title",
  "authors": ["Author 1", "Author 2"],
  "overview": "Article abstract/description",
  "publication": {
    "journal": "Journal Name",
    "publisher": "Publisher",
    "issn": "ISSN Number",
    "date_published": "Publication Date",
    "volume": "Volume Number",
    "issue": "Issue Number"
  },
  "identifiers": {
    "doi": "DOI Number",
    "pmid": "PMID",
    "rg_publication_id": "ResearchGate ID"
  },
  "links": {
    "page_url": "Original URL",
    "abstract_html_url": "Abstract URL",
    "fulltext_html_url": "Full Text URL",
    "pdf_url": "PDF URL",
    "image": "Article Image URL"
  },
  "citations": [
    {
      "title": "Cited Article Title",
      "authors": ["Author"],
      "date_published": "Date",
      "publisher": "Publisher",
      "url": "Citation URL"
    }
  ],
  "references": [
    {
      "title": "Reference Title",
      "url": "Reference URL"
    }
  ],
  "other_specifications": {
    "og_title": "Open Graph Title",
    "og_description": "Open Graph Description"
  }
}

Credits

• Web Unblocking Service: Relyr.io
• Proxy Infrastructure: Powered by Relyr WebUnblocker
• Deployment Platform: Apify.com

License

This project is designed for academic and research purposes.