The Guardian Article Search & Archive Scraper avatar

The Guardian Article Search & Archive Scraper

Pricing

from $29.62 / 1,000 results

Go to Apify Store
The Guardian Article Search & Archive Scraper

The Guardian Article Search & Archive Scraper

Search The Guardian's full article archive (2.6M+ articles since 1999). Filter by query, section, tag, contributor, date, or production office. Returns headline, byline, body, tags, contributors, and publication metadata.

Pricing

from $29.62 / 1,000 results

Rating

0.0

(0)

Developer

ParseForge

ParseForge

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Share

ParseForge Banner

📰 The Guardian Article Search Scraper

🚀 Search 2.6 million Guardian articles in seconds. Headlines, bylines, full body text, tags, contributors, star ratings, and section metadata across the complete archive since 1999. No sign-up, no manual scraping.

🕒 Last updated: 2026-05-15 · 📊 30 fields per article · 📰 2.6M+ articles · 📂 32 sections · 📅 Archive since 1999

The Guardian Article Search Scraper exports articles from The Guardian and returns 30 fields per record, including headline, byline, full body text and HTML, contributors, tags, section metadata, star ratings for reviews, and image gallery URLs. The Guardian archive is one of the most-cited English-language news corpora in academic research, NLP training, and media-trends analysis.

The catalogue covers 2.6 million-plus articles across 32 sections, including World, UK, US, Australia, Politics, Business, Technology, Science, Environment, Sport, Culture, and Opinion, with full archive coverage from 1999 onward. This Actor makes the corpus searchable as CSV, Excel, JSON, or XML in under a minute. Filtering by section, tag, contributor, date, language, production office, and minimum star rating runs server-side.

🎯 Target Audience💡 Primary Use Cases
Media-monitoring teams, NLP researchers, journalism students, data scientists, content strategists, OSINT analysts, librariansBrand mentions tracking, sentiment & topic models, journalism research, media-bias studies, archival queries, training corpora for LLMs

📋 What the Guardian Article Search Scraper does

Six powerful filters in a single run:

  • 🔍 Free-text search. Operators include AND, OR, NOT, and quoted phrases.
  • 📂 Section filter. Pick one of 32 sections or search every section.
  • 🏷️ Tag filter. Combine multiple Guardian tags (e.g. environment/climate-change, football/premierleague).
  • 📅 Date range. Restrict by fromDate and toDate.
  • 🌍 Production office. Filter by UK, US, Australia, or international edition.
  • Minimum star rating. Pull only 4-star and above film, TV, music, or restaurant reviews.

Each record includes the article ID, section, pillar, byline, contributors, full body text and HTML, image gallery URLs, word count, star rating (where applicable), and live-blog status.

💡 Why it matters: The Guardian is one of the most influential English-language newsrooms. Its archive is cited in NLP papers, media-bias studies, and journalism education. Building your own pipeline means parsing the article search response and reconstructing tag taxonomies. This Actor skips all of that.


🎬 Full Demo

🚧 Coming soon: a 3-minute walkthrough showing climate-change coverage exported to a research notebook.


⚙️ Input

InputTypeDefaultBehavior
maxItemsinteger10Articles to return. Free plan caps at 10, paid plan at 1,000,000.
querystring"climate change"Free-text search with AND, OR, NOT, and quoted phrases.
sectionstring"all"One of 32 sections or all.
tagstring""Comma-separated Guardian tags.
fromDate, toDatestring""YYYY-MM-DD bounds.
productionOfficestring"any"UK, US, Australia, or international edition.
orderBystring"newest"newest, oldest, or relevance.
langstring""Language code (en, fr, es, de, ar, etc.).
starRatingintegerMinimum star rating (1-5) for reviews.
includeBodyTextbooleantrueInclude the full article body text and HTML.

Example: latest 100 climate-change articles in the Environment section.

{
"maxItems": 100,
"query": "climate change",
"section": "environment",
"orderBy": "newest"
}

Example: 4-star and above film reviews from 2024.

{
"maxItems": 50,
"query": "",
"section": "film",
"starRating": 4,
"fromDate": "2024-01-01",
"toDate": "2024-12-31",
"orderBy": "relevance"
}

⚠️ Good to Know: Guardian tag IDs follow the pattern section/topic (e.g. football/premierleague, profile/jonathan-freedland). Reviews live in sections like film, tv-and-radio, music, books, and food. Star ratings only appear on review-type articles.


📊 Output

Each article record contains 30 fields. Download the dataset as CSV, Excel, JSON, or XML.

🧾 Schema

FieldTypeExample
🖼️ imageUrlstring | null"https://i.guim.co.uk/img/.../1000.jpg"
🆔 idstring"environment/2026/may/14/climate-policy-..."
📌 webTitlestring"Climate policy review prompts ..."
📌 headlinestring"Climate policy review prompts ..."
🔗 webUrlstring"https://www.theguardian.com/..."
📂 typestring"article", "liveblog", "video"
📂 sectionIdstring"environment"
📂 sectionNamestring"Environment"
📂 pillarIdstring"pillar/news"
📂 pillarNamestring"News"
📅 webPublicationDateISO 8601"2026-05-14T18:00:00Z"
📅 firstPublicationDateISO 8601"2026-05-14T17:30:00Z"
🕒 lastModifiedISO 8601"2026-05-14T19:42:00Z"
🏢 productionOfficestring"UK"
🌍 languagestring"en"
📰 publicationstring"The Guardian"
👤 bylinestring"Damian Carrington"
👤 contributorsarray[{ "id": "...", "webTitle": "Damian Carrington" }]
🔢 wordCountnumber812
starRatingnumber | null4
📺 liveBloggingNowbooleanfalse
📝 standfirststring"Government's first climate review ..."
📝 trailTextstringtrail snippet
📝 bodyTextstringfull article text
📝 bodyHtmlstringfull article HTML
🏷️ keywordsarray["environment/climate-change", "world/world"]
📦 seriesarray[{ "id": "...", "webTitle": "Climate countdown" }]
🏷️ tonesarray[{ "id": "tone/news", "webTitle": "News" }]
📦 imageGalleryarrayimage asset URLs and captions
🕒 snapshotTimeISO 8601"2026-05-15T00:00:00.000Z"

📦 Sample records


✨ Why choose this Actor

Capability
📰2.6M+ articles. Full Guardian archive from 1999 onward.
🔍Boolean search. AND, OR, NOT, and quoted phrases at the operator level.
📂32 sections. From World and Politics to Sport, Culture, and Opinion.
Star-rating filter. Pull only top-rated film, TV, music, restaurant, and book reviews.
📝Full body text. Body text and HTML are included by default; toggle off for lighter records.
🌍Multi-edition. UK, US, Australian, and international production offices.
🚫No sign-up. Works against the public Guardian content source.

📊 The Guardian archive is among the most-used English-language corpora in NLP research and a frequent reference in journalism studies.


📈 How it compares to alternatives

ApproachCostCoverageRefreshFiltersSetup
⭐ Guardian Article Search Scraper (this Actor)$5 free credit, then pay-per-use2.6M+ articlesLive per runsection, tag, date, office, language, star rating⚡ 2 min
Manual Guardian site searchFreeSame archiveLiveUI-only filters🚫 Not bulk-friendly
News-aggregator APIs$99+/monthMulti-sourceLiveMany⏳ Integration
Build your own scraperFree timeVariableManualNone🐢 Days

Pick this Actor when you want filtered, bulk Guardian data without writing a scraper or paying for a multi-source aggregator.


🚀 How to use

  1. 📝 Sign up. Create a free account with $5 credit (takes 2 minutes).
  2. 🌐 Open the Actor. Go to the Guardian Article Search Scraper page on the Apify Store.
  3. 🎯 Set input. Enter a search query, optionally pick a section, tag, date range, and star rating.
  4. 🚀 Run it. Click Start and let the Actor pull matching articles.
  5. 📥 Download. Grab your results in the Dataset tab as CSV, Excel, JSON, or XML.

⏱️ Total time from signup to downloaded archive: 3-5 minutes. No coding required.


💼 Business use cases

📊 Media Monitoring & PR

  • Track brand mentions across the Guardian archive
  • Monitor competitor coverage in Business and Tech
  • Build alerts for crisis-comms triggers
  • Audit narrative shifts on a topic over time

🔬 NLP & Data Science Research

  • Build training corpora for sentiment models
  • Generate topic-modeling datasets across decades
  • Replicate published media-bias studies
  • Train text-summarization models with full body text

📰 Journalism & Editorial

  • Source background research with Boolean operators
  • Build series timelines from tag-filtered archives
  • Compare US, UK, and AU edition coverage
  • Pull star-rated reviews for "best of" round-ups

🎯 Content Strategy & SEO

  • Map topic coverage to identify white-space opportunities
  • Benchmark headlines and standfirst length
  • Audit byline and contributor mix on a beat
  • Build content-trend dashboards

🔌 Automating Guardian Article Search Scraper

Control the scraper programmatically for scheduled runs and pipeline integrations:

  • 🟢 Node.js. Install the apify-client NPM package.
  • 🐍 Python. Use the apify-client PyPI package.
  • 📚 See the Apify documentation for full details.

The Apify Schedules feature lets you trigger this Actor every hour for breaking-news monitoring or daily for editorial research.


🌟 Beyond business use cases

A high-quality news archive powers more than commercial workflows. The same structured records support research, education, civic projects, and personal initiatives.

🎓 Research and academia

  • Train NLP models on multi-decade English-language corpora
  • Replicate media-bias and framing studies
  • Teach computational journalism with real archives
  • Power dissertation research on long-running topics

🎨 Personal and creative

  • Build a personal "year in news" newsletter
  • Render data art from headlines over time
  • Curate a hobbyist film-review database by star rating
  • Power a fan-site with structured author archives

🤝 Non-profit and civic

  • Provide free archival research to community newsrooms
  • Audit coverage of a public-interest topic
  • Track climate-coverage volume for advocacy briefs
  • Inform civic dashboards on policy debates

🧪 Experimentation

  • Train LLM fine-tuning sets on long-form journalism
  • Validate sentiment classifiers against tone tags
  • Prototype a topic-trend visualizer
  • Test AI summarizers on real article text

🤖 Ask an AI assistant about this scraper

Open a ready-to-send prompt about this ParseForge actor in the AI of your choice:


❓ Frequently Asked Questions

🧩 How does it work?

Enter a Boolean query, set optional filters (section, tag, date range, language, production office, star rating), and run. The Actor pulls matching articles from The Guardian and writes one clean record per article with full body text by default.

📏 How accurate is the data?

Records mirror the official Guardian content source exactly. Headlines, bylines, and tags are pulled verbatim from each article. Body text is the full publication text without paywalled gating.

🔁 How fresh is the archive?

Live. Each Actor run reflects the current state of The Guardian's content source, including just-published articles and live blogs.

📅 How far back does coverage go?

The full archive is searchable from 1999 onward, with selective coverage for older material. Use fromDate and toDate to bound your query.

🔍 What Boolean operators are supported?

AND, OR, NOT, and quoted phrases. For example: "climate change" AND policy NOT denial.

⭐ How does the star-rating filter work?

Set starRating to 1-5 to filter reviews with at least that rating. Star ratings only appear on review-type articles in sections like Film, TV, Music, Books, and Food.

⏰ Can I schedule regular runs?

Yes. Use Apify Schedules to run the Actor hourly for breaking-news monitoring or daily for archival research.

The Guardian publishes its content under open content terms via its developer programme. Verify your downstream use case against The Guardian's content licensing terms.

💼 Can I use this data commercially?

Some commercial uses require additional licensing from The Guardian. Always review their content licensing terms before deploying in a paid product.

💳 Do I need a paid Apify plan to use this Actor?

No. The free Apify plan is enough for testing and small runs (10 articles per run). A paid plan lifts the limit and enables scheduling.

🆘 What if I need help?

Our support team is here to help. Contact us through the Apify platform or use the Tally form linked below.


🔌 Integrate with any app

Guardian Article Search Scraper connects to any cloud service via Apify integrations:

  • Make - Automate multi-step workflows
  • Zapier - Connect with 5,000+ apps
  • Slack - Push breaking-news alerts to channels
  • Airbyte - Pipe article data into your warehouse
  • GitHub - Trigger runs from commits and releases
  • Google Drive - Export datasets straight to Sheets

You can also use webhooks to trigger downstream actions when a run finishes. Push fresh climate articles into a research notebook, or alert a Slack channel when a brand mention surfaces.


💡 Pro Tip: browse the complete ParseForge collection for more news and reference-data scrapers.


🆘 Need Help? Open our contact form to request a new scraper, propose a custom data project, or report an issue.


⚠️ Disclaimer: this Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by Guardian News & Media or any of its affiliates. All trademarks mentioned are the property of their respective owners. Only publicly available content is collected.