No credit card required

Smart Article Extractor

lukaskrivka/article-extractor-smart

No credit card required

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

Does not support Hebrew

Closed

abiding_flare opened this issue

I've tried to run this scrapper on Hebrew websites and it didn't work. Is there a way to add Hebrew?

Lukáš Křivka (lukaskrivka)

Hi Makan,

I'm sorry but this scraper very likely will perform poorly for Hebrew (it might work on some websites).

For less detailed parsing, you can try https://apify.com/apify/website-content-crawler which should work better for non-English

abiding_flare

Thank you for your quick response, I do need all of the parsing. It is an amazing tool and exactly what I need. (I tried it in English with great results).

abiding_flare

Could this help with adjusting the scrapper to work in Hebrew? https://stackoverflow.com/questions/1365510/where-can-i-find-a-list-of-hebrew-stop-words

Lukáš Křivka (lukaskrivka)

I don't think that will be enough. There is quite a complicated parsing library behind it. If you know some good for Hebrew, we could add it as a backend.

abiding_flare

Will this help? https://github.com/amir-zeldes/HebPipe Thank you

abiding_flare

Hi, Do you think this https://github.com/amir-zeldes/HebPipe could help? I tried to run the scraper with no minimum words per article and got some information but not the full text. https://console.apify.com/view/runs/A4SU2iteF1ZF8Mkg3

I would appreciate if this could work for Hebrew.

abiding_flare

Hi, Is there any update on this? Thank you!

Lukáš Křivka (lukaskrivka)

Hi Makam, I'm sorry but this is a big feature and we don't see enough demand to justify the development cost just yet.

abiding_flare

Hi, Is there a way for us to pay for such a development?

Lukáš Křivka (lukaskrivka)

Hi Makam, You have 2 options

Ask some of our partners or freelancers to build this from scratch.
Reach out to https://apify.com/enterprise

The best bet for Hebrew is probably using GPT so maybe using https://apify.com/drobnikj/gpt-scraper would help here

Lukáš Křivka (lukaskrivka)

I will close this issue now, we will keep your request in mind for this scraper in case an easier path forward is found

Add comment

Developer

Lukáš Křivka

Actor Metrics

278 monthly users
80 stars
>99% runs succeeded
2.3 days response time
Created in Nov 2019
Modified a month ago

Categories

News

Linkedin Company Profile Scraper

sanjeta/linkedin-company-profile-scraper

The LinkedIn Company Profile Scraper is a powerful and efficient tool designed to extract valuable information from LinkedIn company profiles with ease. Whether you're a market researcher, sales professional, or just curious about a company's background.

ScrapeVerse

142

Google News Scraper

data_xplorer/google-news-scraper

🚀 Transform your news monitoring with our Google News Scraper - the ultimate API alternative for real-time news collection. Built for developers, this solution provides structured news data across 70+ region/language combinations.

Data Xplorer

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

31.8k

856

Cheerio Scraper

apify/cheerio-scraper

Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.

Apify

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts data from pages using JavaScript code. The Actor supports both recursive crawling and lists of URLs and automatically manages concurrency for maximum performance. This is Apify's basic tool for web crawling and scraping.

Apify

73.8k

338

AI Website Content Markdown Scraper

quaking_pail/ai-website-content-markdown-scraper

This Apify Actor, "Website Content Crawler with Markdown Extraction," is designed to perform a comprehensive crawl of specified websites, extract their text content, convert it into Markdown format, and store it in a structured dataset. The extracted content is suitable for feeding LLMs.

AI_Builder

262

Fast Google Search Results Scraper

serping/fast-google-search-results-scraper

Scrape Google Search Engine Results Page (SERP). Select the country or language and extract organic and paid results, ads, queries, featured snippets, People Also Ask, Top Stories, inline videos, reviews, like a Google SERP API.

SERP.ing

188

Telegram Scraper

dainty_screw/telegram-scraper

Seamlessly extract public messages from any Telegram channel and gain valuable insights. Perfect for researchers, marketers, and data analysts.

codemaster devops

179

✨Mass Linkedin Profile Scraper with Email 📧 + 📞 (No Cookies)

dev_fusion/Linkedin-Profile-Scraper

Scrape Linkedin profiles and get full information of the lead with their email & mobile too.

Dev Fusion

671

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

11.7k

318