article-scrapper

Pricing

$3.00 / 1,000 result_sets

article-scrapper

A flexible and powerful Apify Actor for scraping articles from tech news websites. This scraper can work with any tech news site - either from predefined presets or custom URLs

Pricing

$3.00 / 1,000 result_sets

Rating

0.0

(0)

Developer

RK K

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

2 months ago

Last modified

Categories

News

Use Preset Sites

usePresets

Optional

Use predefined news sites or provide custom URLs

Type:boolean

Default:true

Preset News Sources

presetSources

Optional

Select from predefined tech news sources (only used if 'Use Preset Sites' is checked)

Type:string[]

Default:

[
  "verge",
  "techcrunch",
  "wired"
]

Custom URLs

customUrls

Optional

Enter custom URLs to scrape (one per line). Can be homepages or article listing pages. Used when 'Use Preset Sites' is unchecked.

Type:string[]

Max Articles Per Source

maxArticlesPerSource

Optional

Maximum number of articles to scrape from each source

Type:integer

Minimum:1

Maximum:100

Default:10

Max Listing Pages

maxPages

Optional

Maximum number of listing pages to check per source

Type:integer

Minimum:1

Maximum:10

Default:1

Include Full Article Content

includeContent

Optional

Extract full article text (may increase scraping time)

Type:boolean

Default:true

Search Keywords (Optional)

searchKeywords

Optional

Filter articles by keywords. Only articles containing ANY of these keywords in title or description will be included. Leave empty to scrape all articles.

Type:string[]

Title Must Contain (Optional)

titleContains

Optional

Only scrape articles where the title contains this text (case-insensitive). Leave empty to scrape all articles.

Type:string

Description Must Contain (Optional)

descriptionContains

Optional

Only scrape articles where the summary/description contains this text (case-insensitive). Leave empty to scrape all articles.

Type:string

Article Extractor & News Scraper

web.harvester/article-extractor-news-scraper

Extract articles from any news site, blog, or webpage. Get title, full text, author, date, images & metadata using 7 extraction engines (Newspaper4k, Trafilatura, Goose3). Anti-bot bypass, proxy rotation, automatic fallback. Perfect for news monitoring, NLP datasets & content aggregation.

Web Harvester

5.0

Enhanced Deep Content Crawler

assertive_analogy/advanced-crawler

A fast, Python-powered web crawler with smart content extraction, JS support, metadata capture, and duplicate detection. Ideal for SEO, content migration, and e-commerce scraping. Reliable, scalable, and easy to customize.

Gideon Nesh

1.0

Website Content Crawler Fast

timelody/website-content-crawler-fast

Scraping data from every single web page.

timelody

5.0

Website Scraper

snipercoder/website-scraper

Scrape websites effortlessly

Sniper Coder

130

Extract Website With URL

mrahil/extract-website-with-url

The Extract Website with URL API allows users to extract structured data from any webpage by providing a URL. It retrieves HTML, metadata, tables, and images, returning data in JSON format. Ideal for web scraping, SEO analysis, and content extraction. Use it for e-commerce data, news scraping

Mohammed Rahil

197

Website extract

mrahil/my-actor

It is website extractor

Mohammed Rahil

140

AI website scraper report

chitosibug3/ai-website-scraper-report

Gather website info and summarize it by advanced llm

Chito Sibug

AI Website Content Markdown Scraper

quaking_pail/ai-website-content-markdown-scraper

This Apify Actor, "Website Content Crawler with Markdown Extraction," is designed to perform a comprehensive crawl of specified websites, extract their text content, convert it into Markdown format, and store it in a structured dataset. The extracted content is suitable for feeding LLMs.

AI_Builder

854

3.9

Fast Website Content Crawler

6sigmag/fast-website-content-crawler

A high-performance web scraper that rapidly extracts and analyzes content from multiple websites simultaneously. Perfect for competitive research, content aggregation, and website structure analysis.

David Deng

2.9K

4.7

Website Content Extractor

fastidious_drawer/website-content-extractor

This extractor lets you extract content from any website with a single or multiple URLs. Use selectors to choose specific sections like the body and exclude elements like headers or navigation. It also extracts images and links, providing data in JSON and DataTable formats for easy processing.