Taylor & Francis Online Scraper - Articles & Abstracts
Pricing
from $3.00 / 1,000 results
Taylor & Francis Online Scraper - Articles & Abstracts
Scrape Taylor & Francis Online: search 4,250 T&F and Routledge journals for article titles, DOIs, full author lists, abstracts, keywords, journal and issue details, view and citation counts, access status and PDF links. Abstracts included for paywalled papers. Incremental monitoring built in.
Pricing
from $3.00 / 1,000 results
Rating
0.0
(0)
Developer
Paweł
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
3 days ago
Last modified
Categories
Features
Share
📚 Taylor & Francis Online Scraper
🎯 Turn 4,250 Taylor & Francis and Routledge journals into a clean, ready-to-analyse dataset — abstracts included, even for paywalled papers.
Search the entire Taylor & Francis catalogue by keyword, title, author, journal, year or article type and get back structured records: titles, DOIs, full author lists, abstracts, author keywords, journal and issue details, page ranges, submission and publication dates, view counts, citation counts, Altmetric scores, open-access status and PDF links.
🚀 What Does It Do?
This scraper automatically works through Taylor & Francis Online search results and collects structured, ready-to-use data for every article it finds. No manual browsing, no copy-pasting from result pages — set your filters and hit Start.
💡 Two ways to point it at what you want:
- 🔍 Discovery Mode — describe what you are looking for (keyword, author, journal, years, article type) and the scraper walks the whole result set for you, however large it is.
- 📋 Direct URL Mode — paste specific addresses: search result pages, journal issue pages, individual article pages, or plain DOIs.
💰 Three Cost Levels — Pick What You Actually Need
| Mode | What You Get | Cost |
|---|---|---|
| 📋 Bibliography only | Titles, DOIs, every author, journal, volume/issue, dates, view and citation counts, access status — everything the result pages show | Cheapest: nothing is fetched per article at all |
| 📄 With abstracts (default) | All of the above plus the full abstract of every article, and author keywords and topics | About 1 KB fetched per article — roughly 1/180th of what reading a page costs |
| 📖 Full mode | All of the above plus the page range, the received/accepted dates, and the article's own view and Altmetric counters | About 195 KB fetched per article, so noticeably slower and dearer |
Switch with the 📖 Full mode toggle. The default with abstracts mode is the sweet spot: abstracts arrive through the site's own citation export, which answers for fifty articles in a single request, so you get complete abstracts without paying to download whole pages. Turn full mode on only when you specifically need page ranges, submission dates or the view counters.
👥 Who Is This For?
| 🏢 Use Case | 💬 How It Helps |
|---|---|
| 🎓 Researchers & PhD students | Build a complete literature review in minutes instead of clicking through hundreds of result pages |
| 📊 Bibliometrics & research analytics teams | Get citation counts, view counts and Altmetric scores across thousands of papers in one consistent table |
| 🏛️ University libraries | Track exactly what a department publishes, in which journals, and how often it gets cited |
| 💊 Pharma & biotech intelligence | Monitor new publications on a compound, method or indication and get alerted the day they appear |
| 🤖 AI & data teams | Feed clean abstracts and keywords into a model, a search index or a RAG pipeline |
| ✍️ Science journalists & editors | Spot high-Altmetric, high-attention papers the moment they are published |
✨ Features
- 🌐 Full catalogue coverage — every one of the 4,250 Taylor & Francis and Routledge journals is searchable
- 📄 Abstracts for paywalled papers — the abstract, keywords and dates are collected whether or not the full text is behind a paywall
- 🪶 Lightweight by design — abstracts arrive fifty at a time through the site's own citation export, about 1.8 KB per article instead of downloading a whole page
- 👥 Complete author lists — every author on the paper, not just the first three
- 📈 Real engagement metrics — view counts, citation counts and Altmetric attention scores straight from the journal pages
- 🔓 Access status — instantly see which papers are open access, free to read, or subscription-only
- 🎛️ Smart Filters — keyword, title words, abstract words, author, journal, publication years, article type, open access, minimum citations, and must-contain / must-not-contain word lists
- ↕️ Five sort orders — relevance, newest, oldest, most cited or most downloaded
- 🔄 Incremental monitoring — scheduled runs return only what is new or changed, cutting the cost of a daily literature alert by 80–95%
- 🔔 Instant alerts — new papers can be pushed to Slack, Discord, Telegram or your own webhook the moment they appear
- 📊 Exact citation counts — optionally top up every record with up-to-the-day citation figures
- 🧹 Automatic deduplication — every paper appears exactly once, no matter how many pages or journals it was found on
- ⚡ Fast & Scalable — no result ceiling: a search with 195,000 matches can be collected all the way to the last record
- 📤 Export Anywhere — download results as JSON, CSV, Excel, or push to Google Sheets, Zapier, Make, or your CRM
🎛️ Filters & Options
| Option | What It Does |
|---|---|
| 🔍 Search query | Find words anywhere in the record — title, abstract, keywords and full text |
| 📝 Words in the title | Match only papers with these words in the title |
| 📄 Words in the abstract | Match only papers with these words in the abstract |
| 👤 Author | Find papers by a specific author |
| 📚 Journals | Restrict the run to specific journals; typos are caught and reported before the run wastes time |
| 📑 Article type | Research articles, review articles, book reviews, editorials, brief reports, rapid communications and more |
| 📅 Published from / to | Restrict results to a publication-year range |
| ↕️ Sort by | Relevance, newest, oldest, most cited or most downloaded |
| 🔓 Open access only | Keep only freely readable papers |
| 📈 Minimum citations | Drop papers below a citation threshold |
| ✅ Must contain | Keep a paper only if it mentions at least one of your words |
| 🚫 Must not contain | Drop papers that mention any of your words |
| 📖 Full details | Open each paper to add its abstract, keywords, page range and submission dates |
| 📊 Exact citation counts | Top up every record with current citation figures, ISSNs and page ranges |
| 🏷️ Extra keywords & topics | Add topic classifications and a backup abstract from an open scholarly index |
| ✂️ Abstract max length | Trim long abstracts to a set number of characters |
| 📦 Results per page | Trade download size against speed — bigger pages mean fewer requests, up to 500 |
| 🔄 Incremental monitoring | Emit only papers that are new or changed since the previous run |
| 🔔 Notifications | Send new papers to Slack, Discord, Telegram or a webhook |
| 🗜️ Compact output | Emit only the essential fields |
| 🔢 Max Results | Control how many papers to extract per run |
| 🔗 Direct URLs | Optionally provide specific search, issue, article or DOI addresses to scrape |
📦 What You Get (Output Fields)
Every article includes:
Identity & links
| Field | Example |
|---|---|
| doi | 10.1080/00032710701484459 |
| title | Electrospray Ionization Mass Spectrometry of Hexanitrohexaazaisowurtzitane (CL-20) |
| url | https://www.tandfonline.com/doi/full/10.1080/00032710701484459 |
| pdfUrl | https://www.tandfonline.com/doi/epdf/10.1080/00032710701484459?needAccess=true |
| source | tandf |
| discoverySource | site-search |
Journal & issue
| Field | Example |
|---|---|
| journalName | Analytical Letters |
| journalCode | lanl20 |
| issn | ["0003-2719", "1532-236X"] |
| volume | 40 |
| issue | 10 |
| pages | 1972-1978 |
| contentType | article |
| articleType | research-article |
Dates
| Field | Example |
|---|---|
| publishedDate | 2007-08-18 |
| onlineDate | 2007-08-18 |
| receivedDate | 2007-04-10 |
| acceptedDate | 2007-05-28 |
| year | 2007 |
Authors
| Field | Example |
|---|---|
| authors | [{ "name": "J. A. Campbell", "given": "J. A.", "family": "Campbell", ... }] |
| authorCount | 4 |
Content
| Field | Example |
|---|---|
| abstract | Hexanitrohexaazaisowurzitane (CL-20) is a newly developed propellant and has been examined using negative ion electrospray mass spectrometry... |
| abstractLength | 211 |
| keywords | ["Negative ion electrospray mass spectrometry", "CL-20", "adduct ions", "explosives", "propellants"] |
| topics | ["Electrochemical Analysis and Applications", "Electrochemical sensors and biosensors"] |
| subjects | [] |
| language | en |
Topics are added when Extra keywords & topics is switched on. Taylor & Francis publishes no subject classification of its own beyond the author's keywords, so subjects is usually empty — topics is the field to group papers by.
Access & metrics
| Field | Example |
|---|---|
| isOpenAccess | false |
| accessType | restricted |
| oaStatus | closed |
| license | http://creativecommons.org/licenses/by/4.0 |
| citationCount | 101 |
| citationSource | crossref |
| viewsCount | 492 |
| altmetricScore | 0 |
Run metadata
| Field | Example |
|---|---|
| scrapedAt | 2026-07-28T12:00:00.000Z |
| contentHash | a3f9c1e0b5d47e2a8c6f1b9d0e3a7c5f2b8d4e6a |
📊 Example Output
{"doi": "10.1080/00032710701484459","title": "Electrospray Ionization Mass Spectrometry of Hexanitrohexaazaisowurtzitane (CL-20)","url": "https://www.tandfonline.com/doi/full/10.1080/00032710701484459","source": "tandf","discoverySource": "site-search","contentType": "article","articleType": "research-article","journalName": "Analytical Letters","journalCode": "lanl20","issn": ["0003-2719", "1532-236X"],"volume": "40","issue": "10","pages": "1972-1978","publishedDate": "2007-08-18","onlineDate": "2007-08-18","receivedDate": "2007-04-10","acceptedDate": "2007-05-28","year": 2007,"authors": [{"name": "J. A. Campbell","given": "J. A.","family": "Campbell","affiliation": null,"affiliations": [],"orcid": null,"email": null,"isCorresponding": false},{"name": "J. E. Szecsody","given": "J. E.","family": "Szecsody","affiliation": null,"affiliations": [],"orcid": null,"email": null,"isCorresponding": false}],"authorCount": 4,"abstract": "Hexanitrohexaazaisowurzitane (CL-20) is a newly developed propellant and has been examined using negative ion electrospray mass spectrometry. The primary ions observed included adduct ions (M+Cl)- and (M+ONO2)-.","abstractLength": 211,"keywords": ["Negative ion electrospray mass spectrometry", "CL-20", "adduct ions", "explosives", "propellants"],"subjects": [],"language": "en","isOpenAccess": false,"accessType": "restricted","license": null,"pdfUrl": null,"citationCount": 4,"citationSource": "crossref","viewsCount": 251,"altmetricScore": 0,"scrapedAt": "2026-07-28T12:00:00.000Z","contentHash": "a3f9c1e0b5d47e2a8c6f1b9d0e3a7c5f2b8d4e6a"}
📋 Dataset Views
The Apify Console gives you six ready-made table views to quickly browse your results:
| View | What It Shows |
|---|---|
| 📊 Overview | Title, journal, publication date, author count, citations, views, access status and links |
| 📄 Abstracts & keywords | Title, full abstract, keywords, journal and date — the literature-review view |
| 👥 Authors | Title, the complete author list and author counts per paper |
| 📈 Citations & metrics | Citations, views and Altmetric scores side by side for ranking papers by impact |
| 🔄 Monitoring changes | What changed since the previous run — new, updated, first seen and last seen |
| 📋 Full Details | Every single field — the complete dataset |
❓ FAQ
🤔 Do I get abstracts for papers I don't have a subscription to? Yes. Taylor & Francis publishes the abstract, keywords and all the dates for every paper, whether the full text is paywalled or not — and that is exactly what this scraper collects. Only the full text itself stays behind the paywall, and it is never touched.
🤔 Is there a limit on how many results a search can return? No. Unlike most academic sites there is no result ceiling here — a search matching 195,000 papers can be collected right down to the last record. Use "Max Results" to stop wherever you like.
🤔 How do I find a journal's code?
It is the short code in the journal's own address: for tandfonline.com/journals/lanl20 the code is lanl20. If you mistype one, the run tells you immediately instead of quietly returning unrelated papers.
🤔 Which mode do I need? Start with the default: you get the complete bibliographic record plus full abstracts, keywords and topics, and it stays cheap because abstracts come through a small dedicated request rather than a whole page download. Switch on full mode only if you need the page range, the received/accepted dates or the article's own view and Altmetric counters — those exist nowhere else.
🤔 Are the abstracts in the cheap mode shortened? No. They are the complete abstracts, identical to what the article page shows, including multi-section abstracts with their Background/Methods/Results headings.
🤔 Will keywords be there for a paper published yesterday? Usually not. Keywords and topics come from an open scholarly index that covers virtually everything older than about a week, but the newest few days can be missing. If you are monitoring brand-new papers and need their keywords, turn on full mode, which reads them from the article page directly.
🤔 Can I get an alert when a new paper on my topic appears? Yes — turn on incremental monitoring, schedule the run daily, and add a Slack, Discord, Telegram or webhook address. You will only hear about papers that are genuinely new.
🤔 Can I export the data? Yes — JSON, CSV, Excel, XML, HTML, RSS. You can also push data directly to Google Sheets, Zapier, Make, or any webhook/API endpoint.
🤔 How often should I run this? For fresh data, run daily or weekly. You can schedule automatic runs on Apify with just a few clicks.
🤔 Does it work with proxies? Yes — residential proxies are recommended for the best results, and they are switched on by default. The scraper works with Apify's built-in proxy service.
🛠️ Need Custom Filters or Features?
I'm happy to customize this scraper for your specific needs! 🤝
Whether you need:
- 🎯 Additional filters (funder, institution, ORCID, reference lists, corresponding-author details, specific subject areas)
- 📊 Extra data fields or custom output formats
- 🔄 Integration with your CRM, reference manager, Google Sheets, or database
- ⏰ Scheduled scraping with automatic deduplication
- 🌐 Scraping from other academic publishers alongside Taylor & Francis — the output format is shared across my publisher scrapers, so datasets merge cleanly
👉 Don't hesitate to reach out via private message — I respond quickly and I'm always open to building exactly what you need. No request is too small or too specific!
⚖️ Legal & Ethical Use
This scraper collects only publicly available information from Taylor & Francis Online. It does not access private data, bypass authentication, log in to any account, or retrieve paywalled full texts — only the freely published bibliographic record and abstract. Please use the data responsibly and in compliance with applicable laws and platform terms of service.