Scrape news data from thehill.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Based on your use case, input either a URL that will scrape the news site or a category (e.g. “sports”) located on the portal. Limit articles extracted based on their number, date or, if scraping periodically, only new publications.

Only articles from this day to present will be scraped. If empty, all articles will be scraped. Format is YYYY-MM-DD, e.g. 2019-12-31, or Number type e.g. 1 week or 20 days

Date from

Maximum number of valid articles scraped. The crawler will stop automatically after reaching this number.

Maximum number of articles

If true, will scrape only new articles each time you run it. All URLs you scraped are compared with saved ones. Scraped articles are saved in one dataset per each domain, datasets are named 'ARTICLES-SCRAPED-domain'

Only new articles

Can be main page URL or any category URLs. Article pages are found and enqueued from these.

Start URLs

Input schema for Smart article extractor

the-hill-scraper

The Hill Scraper

The Hill Scraper · Apify

API · The Hill Scraper · Apify

Input · The Hill Scraper · Apify

Related actors · The Hill Scraper · Apify

Scrape news data from thehill.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topic...

Where next?