No credit card required

Smart Article Extractor

lukaskrivka/article-extractor-smart

No credit card required

📰 Smart Article Extractor extracts articles from any scientific, academic, or news website with just one click. The extractor crawls the whole website and automatically distinguishes articles from other web pages. Download your data as HTML table, JSON, Excel, RSS feed, and more.

Do you want to learn more about this Actor?

Get a demo

Back to issues Create new issue

Does not support Hebrew

Closed

abiding_flare opened this issue

I've tried to run this scrapper on Hebrew websites and it didn't work. Is there a way to add Hebrew?

Lukáš Křivka (lukaskrivka)

Hi Makan,

I'm sorry but this scraper very likely will perform poorly for Hebrew (it might work on some websites).

For less detailed parsing, you can try https://apify.com/apify/website-content-crawler which should work better for non-English

abiding_flare

Thank you for your quick response, I do need all of the parsing. It is an amazing tool and exactly what I need. (I tried it in English with great results).

abiding_flare

Could this help with adjusting the scrapper to work in Hebrew? https://stackoverflow.com/questions/1365510/where-can-i-find-a-list-of-hebrew-stop-words

Lukáš Křivka (lukaskrivka)

I don't think that will be enough. There is quite a complicated parsing library behind it. If you know some good for Hebrew, we could add it as a backend.

abiding_flare

Will this help? https://github.com/amir-zeldes/HebPipe Thank you

abiding_flare

Hi, Do you think this https://github.com/amir-zeldes/HebPipe could help? I tried to run the scraper with no minimum words per article and got some information but not the full text. https://console.apify.com/view/runs/A4SU2iteF1ZF8Mkg3

I would appreciate if this could work for Hebrew.

abiding_flare

Hi, Is there any update on this? Thank you!

Lukáš Křivka (lukaskrivka)

Hi Makam, I'm sorry but this is a big feature and we don't see enough demand to justify the development cost just yet.

abiding_flare

Hi, Is there a way for us to pay for such a development?

Lukáš Křivka (lukaskrivka)

Hi Makam, You have 2 options

Ask some of our partners or freelancers to build this from scratch.
Reach out to https://apify.com/enterprise

The best bet for Hebrew is probably using GPT so maybe using https://apify.com/drobnikj/gpt-scraper would help here

Lukáš Křivka (lukaskrivka)

I will close this issue now, we will keep your request in mind for this scraper in case an easier path forward is found

Add comment

Developer

Lukáš Křivka

Actor Metrics

303 monthly users
87 stars
>99% runs succeeded
7.8 days response time
Created in Nov 2019
Modified 2 months ago

Categories

News

YouTube Full Channel Transcripts Extractor

karamelo/youtube-full-channel-transcripts-extractor

With only the channel link You can extract 1 to 1000s of all the transcripts of a channel, be it videos or shorts or streams/lives or even podcasts and playlists, you name it. Get all the transcripts/captions organized with video ID and title in a nice table or JSON or CSV to download.

karamelo

217

Crunchbase Scraper: Reliable & Easy

scrapefull/crunchbase-scraper

Our Crunchbase data extractor reliably extracts comprehensive organization data from Crunchbase pages. Get clean, organized Crunchbase data to identify insights and seamlessly integrate into your workflow.

Scrapefull

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

34.2k

943

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

74.9k

400

Tripadvisor Scraper

maxcopell/tripadvisor

This unofficial Tripadvisor API is a data extraction tool able to get data on hotels, restaurants, things to do, vacation rentals, attractions, tours, and public trips. Get pricing, contact details, amenities, awards, ratings, and more. Download your data in Excel, JSON, CSV, and other formats.

Maximillian Copelli

7.7k

Facebook Reels Video Scraper

apify/facebook-reels-scraper

Extract data from hundreds of Facebook reels from one or multiple Facebook pages and profiles. Get reel URL, text, page or profile URL, timestamp, number of plays and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

168

Youtube Transcript Scraper

pintostudio/youtube-transcript-scraper

Looking for a reliable way to extract transcripts from YouTube videos? 🎥✨ Look no further! The YouTube-Transcript-Scraper has you covered. 🚀 It effortlessly retrieves transcripts while offering additional valuable insights. Ready to start? Let’s scrape away! 🕵️‍♂️💻

Pinto Studio

111

🔥Bulk Linkedin Company Profile Scraper (No Cookies)

dev_fusion/Linkedin-Company-Scraper

The LinkedIn Company Scraper Actor efficiently extracts comprehensive company information from LinkedIn, including names, industries, websites, employee counts, and more, without requiring cookies. It simplifies data gathering for market analysis and competitive research.

Dev Fusion

250

Dealroom Scraper

saswave/dealroom-scraper

Dealroom company scraper. Collect data from companies using their url / domain name. Dealroom web crawler extract data about social networks, similarweb website traffic, funding rounds, investments, team members, KPI revenues and more ..

SASWAVE

Puppeteer Scraper

apify/puppeteer-scraper

Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.

Apify

5.2k