The Hindu News - Full Articles, Images & Comments

What does The Hindu News Scraper do?

The Hindu News Scraper extracts fully enriched articles from thehindu.com, one of India's largest English-language newspapers. Point it at any combination of 35 sections - India, World, Opinion/Editorial, Business, Cricket and every other sport, Sci-Tech, Entertainment, Education, Life & Style, Society and more - and it returns the full article: headline, byline or wire-agency credit, publish/update timestamps, complete body text, every image URL ready to download, topic tags, and reader comments (author username and full text, not just a count). Run it on demand, on a schedule, or wire it into a pipeline via the Apify API - proxy rotation, monitoring and storage are handled by the platform.

Why use The Hindu News Scraper?

• Media monitoring - track coverage of a company, policy, or public figure across India's national, state and business desks.
• Research & academia - build a clean, structured corpus of Indian news and public opinion (editorials, letters, op-eds) without manual copy-pasting.
• Sentiment & discussion analysis - reader comments are pulled with real usernames and full text, not just totals, so downstream NLP can work with actual language.
• Content aggregation - repurpose or archive full articles, including every image, into your own systems.

How to use The Hindu News Scraper

1. Click Try for free (or Start) on the Actor page.
2. On the Input tab, pick the sections you care about, or leave the default to cover the whole site.
3. Set maxItemsPerSection to control cost, and toggle includeComments off if you only need article text.
4. Click Start and watch the run in real time.
5. When it finishes, open the Output tab (or the API) to download your data as JSON, CSV, Excel, HTML, or RSS.

Input

Field	Type	Description
sections	array	Section slugs to crawl (e.g. national, sport-cricket, opinion-editorial). Defaults to all 35.
maxItemsPerSection	integer	Max articles to fetch per section per run. Default 20.
maxPagesPerSection	integer	Max section-listing pages to paginate through (~50 links each). Default 3.
includeComments	boolean	Fetch reader comments (author + text) per article. Default true.
proxyConfiguration	object	Apify Proxy settings. Off by default - the site has shown no anti-bot blocking.

See the Input tab for the full schema with all section options.

Output

Each dataset item is one article:

{
  "section": "national",
  "articleId": "70224146",
  "headline": "Trump says it is time to get rid of U.S. Senate's filibuster custom",
  "summary": "Trump calls for abolishing the Senate filibuster to overcome Democratic obstacles amid a prolonged government shutdown.",
  "url": "https://www.thehindu.com/news/international/trump-says-it-is-time-to-get-rid-of-us-senates-filibuster-custom/article70224146.ece",
  "authorName": "Reuters",
  "publishedAt": "2025-10-31T08:54:41.000+05:30",
  "updatedAt": "2026-08-18T13:49:41.000+05:30",
  "tags": ["donald-trump"],
  "bodyText": "Republican U.S. President Donald Trump said on Thursday...",
  "heroImageUrl": "https://th-i.thgim.com/public/incoming/.../LANDSCAPE_1200/....JPG",
  "images": [{ "url": "https://th-i.thgim.com/...jpg", "caption": null }],
  "videos": [],
  "commentCount": 4,
  "comments": [
    { "author": "Rajveer", "text": "Understood the whole idea...", "createdAt": "2026-08-10T12:56:00.751Z", "reactionCount": 0, "isReply": false }
  ],
  "scrapedAt": "2026-08-18T14:00:00.000Z"
}

You can download the dataset in various formats such as JSON, HTML, CSV, or Excel.

Data table

Field	Description
headline, summary, url	Core article identity
authorName	Byline, or wire-agency credit (Reuters/PTI/AFP)
publishedAt / updatedAt	ISO-8601 timestamps
tags	Topic tags
bodyHtml / bodyText	Full article body
heroImageUrl / images	Every directly downloadable image URL
videos	Embedded video URLs, when present
commentCount / comments	Reader discussion, with author username and full text

Pricing / Cost estimation

This Actor uses the Pay-per-result pricing model at $0.8 per 1,000 articles. A run covering all 35 default sections at 20 articles each (700 articles) costs roughly $0.56. Turning off includeComments reduces the number of requests per article and speeds up large runs.

Tips or Advanced options

• Narrow sections to just what you need (e.g. ["sport-cricket"]) to keep runs fast and cheap.
• Raise maxPagesPerSection if you need deeper history within a section rather than just the latest items.
• Leave Apify Proxy off unless you start seeing failures - thehindu.com's article and section pages are plain server-rendered HTML with no anti-bot challenge observed during development.

FAQ, disclaimers, and support

This Actor only reads publicly accessible pages and a public, anonymous comment API - no login, paywall bypass, or private data is involved. It is intended for research, monitoring, and archival use; respect thehindu.com's Terms of Service for your use case. Data field availability can vary by article (e.g. wire-service pieces may not have comments enabled). Found a bug or need a custom field? Use the Actor's Issues tab - custom modifications are also available on request.