J-STAGE Scraper avatar

J-STAGE Scraper

Pricing

from $3.00 / 1,000 results

Go to Apify Store
J-STAGE Scraper

J-STAGE Scraper

Scrape Japanese research articles from J-STAGE via the official WebAPI. Use a keyword or paste a J-STAGE URL — the URL wins when set.

Pricing

from $3.00 / 1,000 results

Rating

0.0

(0)

Developer

Marco Rodrigues

Marco Rodrigues

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

2

Monthly active users

a day ago

Last modified

Categories

Share

🇯🇵 J-STAGE Scraper

Want J-STAGE Japanese research articles in a spreadsheet? This scraper makes it easy.

Use the same filters as the global results page — structured filters work better for AI agents. This actor does not take input_url; pick a keyword and the sidebar / advanced fields instead.

The public English results UI is global search. This actor submits that results form and returns up to 2000 rows per run.

💡 Perfect for...

  • Researchers: Export titles, journals, authors, and years for a topic.
  • Dashboards: Track new J-STAGE hits without paging the HTML search.
  • Market research: Slice Japanese scholarly output by subject, access, or year.
  • Data analysts: Export structured J-STAGE rows with public article URLs.
  • 🤖 AI Agents: Power Claude, Cursor, Codex, the Hermes Agent, and OpenClaw workflows with live J-STAGE results.
  • 📚 RAG Systems: Feed titles, journals, and years into retrieval pipelines.
  • 🔗 AI Workflows: Plug into LangChain, AutoGPT, CrewAI, and similar stacks.

✨ Why you'll love this scraper

  • 🎯 Website-Matched Filters: Keyword, search field, publication type, peer review, article attribute, access type, license, subject, data repository, journal, author, year range, and sort — the same fields as the results form.
  • 🌐 Public result cards: Title, journal, authors, year, and article URL.

📦 What's inside the data?

Every row includes all of these fields:

  • Core: id, url, title, journal
  • People / time: authors, year, doi

🚀 Quick start

  1. Type a keyword (cancer, fasting, …).
  2. Optionally narrow with the same filters you would click on the results page.
  3. Set max_results (up to 2000) and click Start.

Tech details for developers 🧑‍💻

Input Example:

{
"keyword": "fasting",
"publication_type": "100",
"peer_reviewed": "1",
"access_type": "2",
"subject": "051100",
"year_from": 2020,
"year_to": 2024,
"sort": "5",
"max_results": 100
}

Output Example:

{
"id": "https://www.jstage.jst.go.jp/article/sptgender/21/0/21_41/_article/-char/en",
"url": "https://www.jstage.jst.go.jp/article/sptgender/21/0/21_41/_article/-char/en",
"title": "[title in Japanese]",
"journal": "Journal of Sport and Gender Studies",
"authors": ["Kari Fasting"],
"year": "2023",
"doi": null
}

Output fields:

FieldDescription
idPublic article URL.
urlPublic J-STAGE article page.
titleTitle from the result card.
journalPublication title.
authorsAuthor names from the card.
yearPublished year when shown.
doiNot present on the HTML card (always null).

📋 Input reference (detailed)

ParameterTypeRequiredDefaultDescription
keywordstringNocancerGlobal search box (freeText / globalSearchKey).
search_fieldenumNoall fieldsAdvanced item1 (title, abstract, author, …).
publication_typeenumNoallsrySybt (journal, proceedings, …).
peer_reviewedenumNoanykjnSdkUm.
article_attributeenumNoanykijiZksi (last 30 days, AOP, HTML, supplements).
access_typeenumNoanynnshuSybt (free / open / authorized).
licenseenumNoanylicenseCd (CC BY family).
subjectenumNoallbnyaShbnr subject codes.
data_repositoryenumNoanydataRepo.
journalstringNoJournal title facet (srynm).
authorstringNoAuthor facet (chshnm).
year_from / year_tointegerNoyearfrom / yearto.
sortenumNorelevanceorder / Sort by.
max_resultsintegerNo50Maximum rows (12000).

Notes on filters

  • These are the filters on the English global results page, plus the advanced search-field list from the same form.
  • There is no input_url. Combine filters instead of pasting a results URL.
  • Year range and facets only apply when sent with freeText, same as the website form.