No credit card required

Smart Article Extractor

lukaskrivka/article-extractor-smart

No credit card required

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Back to issues Create new issue

Does not support Hebrew

Closed

abiding_flare opened this issue

I've tried to run this scrapper on Hebrew websites and it didn't work. Is there a way to add Hebrew?

Lukáš Křivka (lukaskrivka)

Hi Makan,

I'm sorry but this scraper very likely will perform poorly for Hebrew (it might work on some websites).

For less detailed parsing, you can try https://apify.com/apify/website-content-crawler which should work better for non-English

abiding_flare

Thank you for your quick response, I do need all of the parsing. It is an amazing tool and exactly what I need. (I tried it in English with great results).

abiding_flare

Could this help with adjusting the scrapper to work in Hebrew? https://stackoverflow.com/questions/1365510/where-can-i-find-a-list-of-hebrew-stop-words

Lukáš Křivka (lukaskrivka)

I don't think that will be enough. There is quite a complicated parsing library behind it. If you know some good for Hebrew, we could add it as a backend.

abiding_flare

Will this help? https://github.com/amir-zeldes/HebPipe Thank you

abiding_flare

Hi, Do you think this https://github.com/amir-zeldes/HebPipe could help? I tried to run the scraper with no minimum words per article and got some information but not the full text. https://console.apify.com/view/runs/A4SU2iteF1ZF8Mkg3

I would appreciate if this could work for Hebrew.

abiding_flare

Hi, Is there any update on this? Thank you!

Lukáš Křivka (lukaskrivka)

Hi Makam, I'm sorry but this is a big feature and we don't see enough demand to justify the development cost just yet.

abiding_flare

Hi, Is there a way for us to pay for such a development?

Lukáš Křivka (lukaskrivka)

Hi Makam, You have 2 options

Ask some of our partners or freelancers to build this from scratch.
Reach out to https://apify.com/enterprise

The best bet for Hebrew is probably using GPT so maybe using https://apify.com/drobnikj/gpt-scraper would help here

Lukáš Křivka (lukaskrivka)

I will close this issue now, we will keep your request in mind for this scraper in case an easier path forward is found

Add comment

Developer

Lukáš Křivka

Actor metrics

194 monthly users
47 stars
99.9% runs succeeded
1.9 days response time
Created in Nov 2019
Modified 15 days ago

Categories

News

Fox News Scraper

hanatsai/fox-news-scraper

Scrape news data from foxnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Hana Tsai

BBC Scraper

theo/bbc-scraper

Scrape news data from bbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

Newsweek Scraper

mtrunkatova/newsweek-scraper

Scrape news data from newsweek.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Markéta Trunkátová

New York Times Scraper

theo/new-york-times-scraper

Scrape news data from nytimes.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

138

Washington Post Scraper

theo/washington-post-scraper

Scrape news data from washingtonpost.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

CNBC Scraper

maria.f/cnbc-scraper

Scrape news data from cnbc.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Mariachiara Faraon

AP News Scraper

theo/ap-news-scraper

Scrape news data from apnews.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Theo Vasilis

Forbes Scraper

natasha.lekh/forbes-scraper

Scrape news data from forbes.com with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.

Natasha Lekh

Le Monde Scraper

david.lukac/le-monde-scraper

Scrape news data from lemonde.fr with this unofficial API. Extract articles, monitor their popularity and performance and automate the fight against fake news. Filter the results by authors, topics, categories, or publication dates. Preview or download the results in your preferred format.