Generic Articles Main Content Extractor
Pricing
from $0.00001 / result
Extract the main content of articles. Input can be article links or pages from which to identify and extract article links. Articles are scraped and cleaned to extract the main text and many useful metadatas. Search terms and date post filters can be applied and highlighted snippets produced.
A list of pages with article links ('url' (required): page url, 'external' (defaults to 'false'): allow extra domain links,'auto' (defaults to 'true'): enable automatic links extraction mode, 'include': matching patterns for valid links, 'exclude': matching patterns for invalid links. Example of valid input: [{ 'url': 'https://www.forbes.com/business/', 'auto': false, 'external': false, 'include': '/sites/', 'exclude': '' }]
The maximum number of links to extract from each article links url provided in 'article_links_urls' input.
A list of terms to look for in each article content. When a term is found, a specific column is filled in the result table
Maximum number of highlighted snippets to output by search term. If set to 0, highlighting is disabled
Check if an article has been published since a given date. Select date in format YYYY-MM-DD or {number}{unit}
Enable global statistics computation.
Enable global statistics computation.
When enabled, statistics are only computed based on valid articles.
The maximum number of times a request will be retried on network, proxy or server errors.
