Academic Paper Scraper

Scrape academic papers, research articles, citations, author profiles, and h-index data. Essential for literature reviews, research monitoring, and academic analytics.

Why Use This Actor?

This actor provides reliable, structured data extraction that you can integrate into your workflows via API, scheduled runs, or webhooks. All data is returned as clean JSON, ready for analysis, databases, or downstream processing.

Keywords: academic papers, research articles, citations, author profiles, h-index

Features

• Query — Search query for academic papers
• Maxresults — Maximum number of papers to return
• Year — Filter by year (e.g., 2024)

How to Use

1. Configure inputs — Set your search parameters in the Apify Console or via API
2. Run the actor — Click "Start" or trigger via API/scheduler
3. Get results — Download structured JSON data from the dataset

API Integration

curl "https://api.apify.com/v2/acts/nexgendata~academic-paper-scraper/runs" \
  -X POST \
  -H "Authorization: Bearer YOUR_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{}'

Scheduled Runs

Set up automated runs on any schedule — hourly, daily, or weekly — using Apify's built-in scheduler. Perfect for monitoring and data pipelines.

Output Format

Results are stored in Apify datasets as structured JSON objects. Each run creates a new dataset that you can:

• Download as JSON, CSV, or Excel
• Access via REST API
• Push to webhooks or integrations
• Connect to Google Sheets, Slack, or Zapier

Technical Details

• Uses httpx for fast async HTTP requests
• Leverages official APIs where available

Integrations

This actor works seamlessly with the Apify platform ecosystem:

• API access — Full REST API for programmatic control
• Webhooks — Get notified when runs complete
• Scheduler — Automate recurring data collection
• Integrations — Connect to Zapier, Make, Google Sheets, Slack, and more

Support

For questions, bug reports, or feature requests, open an issue on the actor's page or contact the developer through Apify.

About nexgendata

nexgendata builds reliable, production-ready data extraction tools on Apify. We focus on clean APIs, structured output, and developer-friendly documentation.