News Scraper - Keyword News Search & Monitoring API
Pricing
Pay per event
Search 250+ news publishers by keyword in one run: headline, link, time, publisher, description, keywords. Country, language and topic filters, your own sites and feeds, duplicate stories collapsed, only-new alerts. $1 per 1,000 articles.
What to look for, one search per line. All words of a line must appear (title, description, news keywords or the link), in any order, whole words, case and accents ignored. Use "quotes" for an exact phrase, -word to exclude, OR between alternatives and word* for a prefix, e.g. Nvidia OR AMD, "interest rates" -mortgage, tariff*. An article matching any line is returned. Leave empty to get the latest articles of the selected publishers.
Only publishers from these countries (254 publishers in 47 countries). Empty = all. Does not apply to your own sources.
Only articles in these languages (publisher language, or the article's own language when its news sitemap says so). Empty = all.
Only publishers that cover these topics, e.g. technology for TechCrunch, The Verge, heise... Empty = all publishers (general news sites also cover every topic, so for a subject search usually leave this empty and use keywords).
More sites to read, one per line: a home page or domain (its Google News sitemap and RSS / Atom feeds are found automatically), a section page, or a feed or news sitemap address. Trade press, company newsrooms, local papers, blogs. Sources that cannot be read are listed as free error rows.
Read only the sources listed above, not the built-in publisher list.
Never return articles from these domains (and their subdomains), e.g. dailymail.co.uk.
Only articles published in the last N hours. Google News sitemaps hold about 48 hours; RSS feeds usually hold the latest 10-100 items, sometimes older. For a longer history, schedule the Actor with "Only new articles".
Upper limit of articles returned (and charged) in this run, after filters and duplicate collapsing.
Newest first, or relevance (keyword in the title first, then articles matching more of your searches, then newest).
Title, description, news keywords, categories and link words (default), or the headline only (fewer, more precise results).
Wire stories (AP, Reuters, AFP...) republished with the same headline are returned once, earliest copy first, with the other publishers in alsoPublishedBy (free). Turn off to get every copy.
Also open each returned article page (if its robots.txt allows) and read the metadata it publishes: authors, section, tags, modified time, canonical link, paywall flag (isAccessibleForFree), word count and description. No article text is returned. Extra "Article details" event per article where metadata was found; blocked or empty pages are free.
With article details on, read details only for the first N articles of the results (0 = all).
For schedules: return only articles that an earlier run of the same monitor did not return (by link and by headline, remembered 14 days). Articles returned before are skipped for free. The first run returns everything.
Name of the "only new" memory. Runs with the same name share it; by default it is derived from your keywords and filters, so changing them starts a new memory.
Some feeds do not date their items. Off (default): such items are skipped, because their age cannot be checked.
Save ARTICLES.csv (main columns) in the run's key-value store for Excel or Google Sheets.
How many publishers are read at the same time. Each publisher still gets one request at a time, with a short pause between requests.
