Trustpilot review scraper and translator

The Trustpilot Review Scraper and Translator is a powerful tool designed to extract detailed review data from Trustpilot. This actor captures over 30 fields of information, offering a comprehensive dataset that includes user reviews, metadata, and optional translation to a specified language.

---

Key Features

• Detailed Data Extraction: Scrape detailed information for each review, including:

  • Review content (text and title)
  • Ratings
  • User metadata (e.g., country code, review count)
  • Review-specific attributes (e.g., verification status, filtered status)
  • Dates (e.g., published, updated, experienced)
  • Reply details (e.g., message, dates)
  • Location and likes

• Translation Support: Translate reviews into your desired language using ISO 639-1 language codes (e.g., "es" for Spanish, "fr" for French).

• Pagination Support: Specify the number of review pages to scrape (20 reviews per page), sorted by recency.

• Customizable Inputs: Tailor your scraping with configurable inputs for URLs, page limits, and translation preferences.

---

Use Cases

• Market Research: Analyze customer feedback to understand trends and sentiments.
• Competitor Analysis: Monitor reviews for competing products or services.
• Data Analysis: Aggregate large datasets for sentiment analysis and other studies.
• Localization: Translate customer reviews for multilingual insights.

---

How to Use

Input Parameters

The actor accepts the following input parameters:

Parameter	Type	Description	Default
start_urls	String	The Trustpilot URL to scrape reviews from.	https://www.trustpilot.com/review/catawiki.com
page_scrape	Integer	The number of pages to scrape. Each page contains 20 reviews.	1
translator	String	Specify the target language using ISO 639-1 codes (e.g., "en" for English, "es" for Spanish). Set to "none" to disable translation.	none

Example Input

1{
2  "start_urls": "https://www.trustpilot.com/review/catawiki.com",
3  "page_scrape": 3,
4  "translator": "es"
5}

Output

The output is stored in a structured dataset, with fields corresponding to the scraped and translated data. Here’s an example:

1{
2  "text": "Este producto es excelente.",
3  "title": "Producto Maravilloso",
4  "rating": 5,
5  "consumer.countryCode": "ES",
6  "consumer.hasImage": false,
7  "dates.publishedDate": "2024-12-01",
8  "likes": 12,
9  ".........":"30 fields in total"
10}

---

Technical Details

Input Schema

The actor’s input schema is defined in input_schema.json. Key properties include:

• start_urls: The Trustpilot page to scrape.
• page_scrape: Number of pages to process.
• translator: Target language for translations.

Disclaimer

This actor is provided as-is, and it is the user's responsibility to ensure compliance with the terms of service of the websites being scraped. Data privacy regulations (e.g., GDPR) should be observed when using the collected data.

---

Advanced Features

• Retry Logic: Automatically retries requests if scraping encounters an issue.
• Headless Mode: Operates in a headless browser for improved performance.
• Custom Translation Handling: Applies translations to review text, titles, and replies (if applicable).

---

Frequently Asked Questions

Is it legal to scrape Trustpilot?

This scraper only extracts publicly available data. Users are responsible for ensuring their use complies with Trustpilot’s terms of service and applicable regulations.

How many reviews can I scrape?

There is no hard limit set by the actor. However, Trustpilot may restrict access after a certain number of requests.

What languages are supported for translation?

The actor supports any language listed in the ISO 639-1 standard, as supported by the Deep Translator library.

---

Feedback and Support

If you encounter issues or have suggestions for improvement, please submit them via the Issues tab in the Apify Console or reach out to the developer directly.

---

License

This actor is licensed under the MIT License. See the LICENSE file for more details.

---

Start leveraging the Trustpilot Review Scraper and Translator today to unlock powerful insights from customer reviews!