No credit card required

Smart Article Extractor

lukaskrivka/article-extractor-smart

No credit card required

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Contact information

Opened 15 days ago by JakubKazK, last comment 15 days ago by JakubKazK

Timeout and Storage check

Opened a month ago by hectorlca, last comment 15 days ago by HuongFi

Articles behind the pay wall

Opened 3 months ago by JakubKazK, last comment 3 months ago by Milan Knoll (milunnn)

The text field does not capture the entire article content

Opened 3 months ago by hjphalen, last comment 3 months ago by Milan Knoll (milunnn)

How do i get article with certain keywords?

Opened 4 months ago by BSD_24, last comment 3 months ago by BSD_24

CAn I get the article in HTML format so I can paste it Wordpress?

Opened 6 months ago by maxorank, last comment 6 months ago by Milan Knoll (milunnn)

Sometimes task is not running even after i had scheduled it earlier.

Opened 7 months ago by bigdot, last comment 7 months ago by Lukáš Křivka (lukaskrivka)

Inserting article urls from file works wrong

Opened 7 months ago by meaningful_cheerleader, last comment 7 months ago by Ondrej Klinovský (ondrejklinovsky)

Not returning any results for article on a particular website

Opened 7 months ago by ralic, last comment 7 months ago by Milan Knoll (milunnn)

Wrt previous isse

Opened 8 months ago by pzubkiewicz, last comment 8 months ago by Lukáš Křivka (lukaskrivka)

Article has too few words

Opened 8 months ago by pzubkiewicz, last comment 8 months ago by Lukáš Křivka (lukaskrivka)

Got an error "unknown exception"

Opened 9 months ago by MarkDB, last comment 8 months ago by Lukáš Křivka (lukaskrivka)

Empty results from medium.com

Opened 10 months ago by pzubkiewicz, last comment 10 months ago by Lukáš Křivka (lukaskrivka)

Needless text in results

Opened 10 months ago by pzubkiewicz, last comment 10 months ago by Lukáš Křivka (lukaskrivka)

Is it possible to crawl based on keyword?

Opened a year ago by assuring_fade, last comment a year ago by Lukáš Křivka (lukaskrivka)

Date to Timestamp?

Opened a year ago by japan_ravel, last comment a year ago by japan_ravel

Does not return text of articles from Russian sites

Opened a year ago by nxlex87, last comment a year ago by Lukáš Křivka (lukaskrivka)

Date Filter Not Working

Opened a year ago by dev1_labdsi, last comment a year ago by Lukáš Křivka (lukaskrivka)

pls fix doesnt work with fox news

Opened a year ago by cardinal_lobster, last comment a year ago by Lukáš Křivka (lukaskrivka)

Is it possible to set a max nr of articles per startUrl

Opened 2 years ago by ybierens, last comment a year ago by Míša Fialová (misa)

Developer

Lukáš Křivka

Actor Metrics

308 monthly users
87 stars
>99% runs succeeded
15 days response time
Created in Nov 2019
Modified 2 months ago

Categories

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

35.1k

976

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

75.4k

424

Google Scraper

caprolok/google-scraper

Extract efficient Google search data extraction with our cost-effective scraper. Quick, easy, and affordable for all your scraping needs. Ideal for SEO, market research, and analytics. Gain valuable insights and competitive edge with our reliable scraping tool.

Caprolok

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.2k

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

13k

415

Twitter Tweets and Profiles Scraper

web.harvester/twitter-scraper

Easily search and extract tweets from profiles or directly using a URL with our tool. Scrape tweets and replies effortlessly. Download data in formats like JSON, CSV, XML, RSS, or HTML Table, perfect for integration with various applications, databases, and social media analytics tools.

Web Harvester

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export scraped data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

53.6k

343

Google Trends Scraper

emastra/google-trends-scraper

Scrape data from Google Trends by search terms or URLs. Specify locations, define time ranges, select categories to get interest by subregion and over time, related queries and topics, and more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Emiliano Mastragostino

Easy Twitter Search Scraper

web.harvester/easy-twitter-search-scraper

Easily Scrape tweets with our Twitter Search Scraper. Export data in formats like JSON and Excel perfect for integration with various applications, databases, and data analysis tools.

Web Harvester