Tatoeba Sentence Corpus Scraper

Scrapes web content in multiple languages, extracts clean text, detects language, scores quality, and outputs LLM-ready training data (JSONL). Perfect for multilingual AI training datasets, corpus linguistics research, and bilingual NLP pipelines.

Split Markdown or plain text into retrieval-ready chunks for RAG pipelines: cuts at headings, packs whole sentences up to a size limit with optional overlap, and tags every chunk with its heading breadcrumb. Handles Japanese sentence boundaries. No LLM cost.

DeepL Translate Scraper - Low-cost💲🔥🌐🔤

delectable_incubator/deepl-translate-scraper-low-cost

Scrape DeepL translation results 🌐🔎 with a powerful language data scraper. Extract original text, translated text, language pairs, timestamps, and translation metadata. Ideal for multilingual research, language learning, localization analysis, NLP projects, and structured translation datasets 📊🚀

Sentiment and Subject / Topic Analysis

ai_founder/sentiment-and-subject-topic-analysis

Artificial Intelligence divides the text into sentences and analyzes the topic, subtopic and sentiment for each sentence.

DeepL Translate Scraper 🌐🔤

scrapestorm/deepl-translate-scraper

Gather DeepL translation results by keywords 🌐. Access detailed translations with original text, translated text, language pairs 🔄, timestamps ⏰, and more. Ideal for language learning, research, and multilingual projects 📊. Perfect for translators, researchers, and language enthusiasts.

MyMemory Translation Scraper

parseforge/mymemory-translation-scraper

Query MyMemory, the world's largest translation memory, with billions of human and machine translations. Translate text across 100+ languages with quality match scores, source attribution, and reference segments. Export to JSON, CSV, or Excel for localization and language research.

This Google Translation Scraper Actor automates extracting translations for any input text from Google Translate. Built with Node.js and Puppeteer, it efficiently retrieves translations in multiple languages, providing structured data for use in language apps, research, or educational projects.

Duolingo Language Data Scraper | Course Vocabulary Export

parseforge/duolingo-language-data-scraper

Export Duolingo language course skills, lexemes and translations. Specify source and target language codes to pull the vocabulary set learners encounter. Useful for linguistics research, language app builders and translation tooling. CSV, Excel, JSON or XML.

OpenSesame Courses Scraper | Training Catalog

parseforge/opensesame-courses-scraper

Scrape OpenSesame catalog of online training courses: title, publisher, duration, language, category, skill level, rating, description, learning objectives, and preview URL. Export L&D content to JSON, CSV, or Excel for corporate training, HR, and learning platform aggregation.

Detect the language of any text. Supports 100+ languages.