Brave News Scraper

Extract news article results from Brave News — a privacy-focused news search without filter bubbles or tracking.

Features

• Article metadata — title, URL, source publisher, snippet, thumbnail, publication time
• Pagination — automatically follows pages (offset-based) up to maxItems
• Cross-page deduplication — skips URLs already pushed from previous pages
• Time range filter — limit results to the past day, week, month, or year
• Sort options — sort by relevance or by publication date
• Geo-targeting — set country and language for localised news
• Proxy support — works with Apify residential/datacenter proxies

Input Parameters

Field	Type	Default	Description
query	string	(required)	News search query
maxItems	integer	50	Maximum number of articles to extract
country	string	"us"	Country code
language	string	"en"	Language code
timeRange	string	""	Filter by time: pd (day), pw (week), pm (month), py (year)
sortBy	string	""	Sort order: date (newest), relevance
proxyConfiguration	object	—	Apify proxy config (recommended: residential)

Example INPUT.json

{
    "query": "artificial intelligence news",
    "maxItems": 50,
    "country": "us",
    "language": "en",
    "timeRange": "pw",
    "sortBy": "date",
    "proxyConfiguration": { "useApifyProxy": true }
}

Output Fields

Field	Type	Description
position	integer	Rank in results (1-based)
title	string	Article headline
url	string	Direct URL to the article
source	string	Name of the news publication
snippet	string	Short excerpt from the article
thumbnail	string	Article thumbnail image URL (null if none)
publishedAt	string	Publication time (ISO or relative, e.g. "3 hours ago")
category	string	Category or topic tag (null — not available from Brave)
searchQuery	string	The query used
country	string	Country code used
language	string	Language code used
scrapedAt	string	ISO 8601 scrape timestamp

Example Output

{
    "position": 1,
    "title": "OpenAI Releases New Model for Enterprise Use",
    "url": "https://www.techcrunch.com/2025/05/01/openai-enterprise/",
    "source": "TechCrunch",
    "snippet": "OpenAI announced its latest enterprise-focused AI model with improved reasoning...",
    "thumbnail": "https://techcrunch.com/wp-content/uploads/2025/05/openai.jpg",
    "publishedAt": "2025-05-01T09:30:00.000Z",
    "category": null,
    "searchQuery": "artificial intelligence news",
    "country": "us",
    "language": "en",
    "scrapedAt": "2025-05-01T12:00:00.000Z"
}

Pagination

The scraper uses offset-based pagination:

• Each page returns ~10 articles
• Pages are queued automatically until maxItems is reached
• Articles are deduplicated by URL across pages

Notes

• thumbnail is null for articles where Brave does not display a preview image
• category is always null — Brave News does not expose topic categories in the DOM
• publishedAt is normalized to ISO format where possible; relative strings (e.g. "2 hours ago") are retained when exact dates cannot be parsed
• Use a residential proxy for higher throughput

Why Use This Scraper?

• Privacy-respecting news — Brave News doesn't track readers or personalize results
• Diverse source selection — Brave surfaces publishers differently than Google News
• No filter bubble — get unfiltered, unskewed news coverage of any topic
• Structured extraction — clean JSON output ready for analysis or aggregation

Use Cases

• Unbiased News Monitoring — track brand or topic mentions without Google's personalization
• Alternative Media Coverage — find news from sources not prominently featured in Google News
• Academic Research — collect news datasets free from recommendation algorithms
• Competitive Press Monitoring — track competitor coverage from a neutral search perspective
• Newsletter Curation — find diverse news articles on any topic for curated newsletters

Custom Solutions

Need a custom scraper or dedicated server setup? We offer:

• On-demand scraper development for any website
• Individual server setups with your own infrastructure
• Custom modifications to existing scrapers
• Priority support and maintenance

📧 Email: lakshmanan.w3dev@gmail.com
📱 WhatsApp: +91 6382775774