AI Website Content Localizer & Scraper

Scrape any website and instantly translate the content into 83+ languages using Lingo.dev AI. Build multilingual datasets, localize competitor data, and power global RAG pipelines with clean, context-aware translations. The ultimate tool for shipping global apps fast!

Features

• Website Scraping: Uses PlaywrightCrawler to handle dynamic websites and extract content seamlessly.
• AI Localization: Powers context-aware translations in 83+ languages via Lingo.dev.
• Dual Mode: Toggle between WEB (scrape & translate) and TEXT (translate raw text) modes.
• Pay-Per-Event: Cost-effective pricing model—pay only for the pages scraped and text localized.
• Secure: API keys are managed securely via Apify Secrets.
• Direct Connection: This Actor uses a direct connection for crawling and does not support proxies. Note that for large-scale crawling, this might be limited by target site rate limits.

How It Works

1. Select Mode: Choose WEB to provide URLs or TEXT to paste raw text.
2. Configure Lingo: Enter your Lingo.dev API Key (Secret).
3. Target Languages: Select the languages you want to translate content into (e.g., es, fr, ja, de).
4. Run: The Actor scrapes the content (if Web mode), sends it to Lingo.dev, and pushes the structured, localized data to the Apify Dataset.

Input Configuration

Required

• Lingo API Key (lingoApiKey): Your proprietary API key from Lingo.dev.

Optional

• Mode (mode): Select WEB for scraping or TEXT for direct text input (default: TEXT).
• Start URLs (startUrls): List of URLs to scrape (WEB mode).
• Text Input (text): Raw text to localize (TEXT mode).
• Target Languages (targetLanguages): List of language codes to translate into (default: ["es", "fr", "de"]).

Output

The Actor stores results in the default Apify Dataset.

Example Output (JSON):

{
  "url": "https://example.com/",
  "title": "Example Domain",
  "original_snippet": "Example Domain\n\nThis domain is for use in documentation examples without needing permission. Avoid use in operations.\n\nLearn more",
  "localized_content": {
    "fr": "Titre : Domaine exemple\n\nCorps : Domaine exemple\n\nCe domaine est destiné à être utilisé dans des exemples de documentation sans nécessiter d'autorisation. Évitez de l'utiliser en production.\n\nEn savoir plus"
  }
}

Python Integration

You can easily integrate this Actor into your Python workflows using the Apify Client:

from apify_client import ApifyClient

# Initialize the ApifyClient with your API token
client = ApifyClient("YOUR_APIFY_TOKEN")

# Prepare the Actor input
run_input = {
    "mode": "WEB",
    "startUrls": [{ "url": "https://example.com/" }],
    "lingoApiKey": "YOUR_LINGO_API_KEY",
    "targetLanguages": ["es", "de"]
}

# Run the Actor and wait for it to finish
run = client.actor("eunit/ai-website-content-localizer-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

Related Actors

Expand your data collection capabilities with these other powerful Apify Actors developed by the same author:

Website Screenshotter

• URL: https://apify.com/eunit/website-screenshotter
• Description: Capture high-quality website screenshots. Features full-page capture, mobile emulation, custom resolutions, and export to JPG, PNG, or PDF. Fast and reliable. Export your result in any format of your choosing.

LinkedIn Job Postings Scraper

• URL: https://apify.com/eunit/linkedin-job-postings-scraper
• Description: Designed for lead generation and career intelligence, this scraper extracts tailored job titles, company names, locations, and job URLs from LinkedIn. Essential for matching job market trends with real estate data (e.g., analyzing local economic activity).

Target Product Reviews Scraper

• URL: https://apify.com/eunit/target-reviews-scraper
• Description: A tool for market research and e-commerce analysis. Scrape product reviews, star ratings, and consumer sentiment from Target.com, useful for businesses analyzing the retail landscape in target neighborhoods.

Your feedback

We are always working on improving the performance of our Actors. So if you’ve got any technical feedback for the AI Website Content Localizer & Scraper Actor or simply found a bug, please create an issue on the Actor’s Issues tab in Apify Console.