J-STAGE Scraper
Pricing
from $3.00 / 1,000 results
J-STAGE Scraper
Scrape Japanese research articles from J-STAGE via the official WebAPI. Use a keyword or paste a J-STAGE URL — the URL wins when set.
Pricing
from $3.00 / 1,000 results
Rating
0.0
(0)
Developer
Marco Rodrigues
Maintained by CommunityActor stats
0
Bookmarked
3
Total users
2
Monthly active users
a day ago
Last modified
Categories
Share
🇯🇵 J-STAGE Scraper
Want J-STAGE Japanese research articles in a spreadsheet? This scraper makes it easy.
Use the same filters as the global results page — structured filters work better for AI agents. This actor does not take input_url; pick a keyword and the sidebar / advanced fields instead.
The public English results UI is global search. This actor submits that results form and returns up to 2000 rows per run.
💡 Perfect for...
- Researchers: Export titles, journals, authors, and years for a topic.
- Dashboards: Track new J-STAGE hits without paging the HTML search.
- Market research: Slice Japanese scholarly output by subject, access, or year.
- Data analysts: Export structured J-STAGE rows with public article URLs.
- 🤖 AI Agents: Power Claude, Cursor, Codex, the Hermes Agent, and OpenClaw workflows with live J-STAGE results.
- 📚 RAG Systems: Feed titles, journals, and years into retrieval pipelines.
- 🔗 AI Workflows: Plug into LangChain, AutoGPT, CrewAI, and similar stacks.
✨ Why you'll love this scraper
- 🎯 Website-Matched Filters: Keyword, search field, publication type, peer review, article attribute, access type, license, subject, data repository, journal, author, year range, and sort — the same fields as the results form.
- 🌐 Public result cards: Title, journal, authors, year, and article URL.
📦 What's inside the data?
Every row includes all of these fields:
- Core:
id,url,title,journal - People / time:
authors,year,doi
🚀 Quick start
- Type a keyword (
cancer,fasting, …). - Optionally narrow with the same filters you would click on the results page.
- Set
max_results(up to 2000) and click Start.
Tech details for developers 🧑💻
Input Example:
{"keyword": "fasting","publication_type": "100","peer_reviewed": "1","access_type": "2","subject": "051100","year_from": 2020,"year_to": 2024,"sort": "5","max_results": 100}
Output Example:
{"id": "https://www.jstage.jst.go.jp/article/sptgender/21/0/21_41/_article/-char/en","url": "https://www.jstage.jst.go.jp/article/sptgender/21/0/21_41/_article/-char/en","title": "[title in Japanese]","journal": "Journal of Sport and Gender Studies","authors": ["Kari Fasting"],"year": "2023","doi": null}
Output fields:
| Field | Description |
|---|---|
id | Public article URL. |
url | Public J-STAGE article page. |
title | Title from the result card. |
journal | Publication title. |
authors | Author names from the card. |
year | Published year when shown. |
doi | Not present on the HTML card (always null). |
📋 Input reference (detailed)
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
keyword | string | No | cancer | Global search box (freeText / globalSearchKey). |
search_field | enum | No | all fields | Advanced item1 (title, abstract, author, …). |
publication_type | enum | No | all | srySybt (journal, proceedings, …). |
peer_reviewed | enum | No | any | kjnSdkUm. |
article_attribute | enum | No | any | kijiZksi (last 30 days, AOP, HTML, supplements). |
access_type | enum | No | any | nnshuSybt (free / open / authorized). |
license | enum | No | any | licenseCd (CC BY family). |
subject | enum | No | all | bnyaShbnr subject codes. |
data_repository | enum | No | any | dataRepo. |
journal | string | No | — | Journal title facet (srynm). |
author | string | No | — | Author facet (chshnm). |
year_from / year_to | integer | No | — | yearfrom / yearto. |
sort | enum | No | relevance | order / Sort by. |
max_results | integer | No | 50 | Maximum rows (1–2000). |
Notes on filters
- These are the filters on the English global results page, plus the advanced search-field list from the same form.
- There is no
input_url. Combine filters instead of pasting a results URL. - Year range and facets only apply when sent with
freeText, same as the website form.