The Sun Scraper

Pricing

$20.00/month + usage

The Sun Scraper

Scrape news data from the-sun.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Pricing

$20.00/month + usage

Rating

0.0

(0)

Developer

Hana Tsai

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

3 years ago

Last modified

Start URLs

startUrlsarrayRequired

Can be main page URL or any category URLs. Article pages are found and enqueued from these.

Maximum number of articles

maxArticlesPerCrawlintegerOptional

Maximum number of valid articles scraped. The crawler will stop automatically after reaching this number.

Date from

dateFromstringOptional

Only articles from this day to present will be scraped. If empty, all articles will be scraped. Format is YYYY-MM-DD, e.g. 2019-12-31, or Number type e.g. 1 week or 20 days

Only new articles

onlyNewArticlesPerDomainbooleanOptional

If true, will scrape only new articles each time you run it. All URLs you scraped are compared with saved ones. Scraped articles are saved in one dataset per each domain, datasets are named 'ARTICLES-SCRAPED-domain'

Default value of this property is false

US News Scraper

hanatsai/us-news-scraper

Scrape news data from usnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Hana Tsai

The Guardian Scraper

theo/the-guardian-scraper

Scrape news data from theguardian.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

The Atlantic Scraper

hanatsai/the-atlantic--scraper

Scrape news data from theatlantic.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Hana Tsai

Fox News Scraper

hanatsai/fox-news-scraper

Scrape news data from foxnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Hana Tsai

141

CBS News Scraper

natasha.lekh/cbs-news-scraper

Scrape news data from cbsnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Natasha Lekh

AP News Scraper

theo/ap-news-scraper

Scrape news data from apnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

NBC news Scraper

natasha.lekh/nbc-news-scraper

Scrape news data from nbcnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Natasha Lekh

India Times Scraper

zuzka/india-times-scraper

Scrape news data from indiatimes.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Zuzka Pelechová

The Daily Beast Scraper

david.lukac/the-daily-beast-scraper

Scrape news data from thedailybeast.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

David Lukáč

New York Post Scraper

maria.f/new-york-post-scraper

Scrape news data from nypost.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.