Pricing
$15.00/month + usage
A powerful and modular web scraping tool designed to extract content from any webpage, article, or news site. Get clean, structured data from any website with optimized extraction algorithms, anti-bot detection avoidance, and proxy support.
5.0 (2)
Pricing
$15.00/month + usage
3
16
5
Last modified
21 days ago
startUrlsarrayRequired
Enter URLs of articles you want to extract content from. The extractor will parse the content and extract title, main text, author information, publication date, and other metadata.
extractorEngineEnumRequired
Choose which extraction engine to use. Each has unique strengths: Newspaper4k (best all-around), Trafilatura (best for news), Boilerpy3 (fastest), News-Please (rich metadata), Goose3 (good with images), Article Parser (HTML/markdown output), JusText (boilerplate removal).
"newspaper4k": string"trafilatura": string"boilerpy3": string"news-please": string"goose3": string"article-parser": string"justext": stringDefault value of this property is "newspaper4k"
saveHtmlbooleanOptional
Enable this option to save the complete HTML of each webpage alongside the extracted content.
Default value of this property is false
saveArticleHtmlbooleanOptional
When enabled, preserves the cleaned article HTML from Newspaper4k and Article Parser extractors in the output. This includes only the article content (not the full page) with its formatting, links, and embedded media intact. Only works when using the Newspaper4k or Article Parser extraction methods.
Default value of this property is false
maxRetriesintegerOptional
How many times to retry if a page fails to load. More retries means better chance of success but may take longer. Default (25) works well for most sites.
Default value of this property is 15
useHeaderGeneratorbooleanOptional
Automatically generate realistic browser headers for each request to help bypass anti-bot measures.
Default value of this property is true
headerGeneratorOptionsobjectOptional
Configure which devices and browsers to emulate when generating headers. Only applies when Smart Header Generator is enabled.