Project Cheerio Crawler Typescript

Introduction

The Project Cheerio Crawler Typescript is a powerful Apify Actor designed to efficiently crawl and extract structured data from websites using Cheerio, a fast and lightweight library for parsing HTML. It specializes in scraping product reviews and related metadata, enabling users to gather valuable insights from e-commerce platforms like Patagonia. This Actor provides reliable, high-performance data extraction with minimal setup, making it ideal for businesses and researchers needing clean, actionable data.

Features

• Fast and Efficient Crawling: Utilizes CheerioCrawler for rapid HTML parsing and data extraction, handling up to hundreds of pages per minute.
• Structured Data Output: Extracts detailed review information including ratings, comments, and custom fields in a consistent JSON format.
• Customizable Inputs: Supports multiple start URLs and configurable request limits to tailor crawls to specific needs.
• Error-Resilient: Built-in handling for common web scraping challenges like rate limits and dynamic content.
• Scalable and Reliable: Optimized for Apify's cloud infrastructure, ensuring consistent performance across large-scale extractions.
• Data Quality Assurance: Filters and structures raw HTML into clean, usable datasets with sentiment analysis and topic extraction.
• Easy Integration: Outputs data in JSON, CSV, or Excel formats for seamless integration with analytics tools or databases.

Input Parameters

Parameter	Type	Required	Description	Example
startUrls	array	Yes	An array of URLs to start the crawl from. Supports multiple entry points.	[{"url": "https://www.patagonia.com/product/mens-lightweight-synchilla-snap-t-fleece-pullover/25551.html?dwvar_25551_color=KALB"}]
maxItems	integer	No	Maximum number of requests the crawler can make. Default is 100.	100

Example Usage

To run the Actor, provide input parameters in JSON format:

{
  "startUrls": [
    {
      "url": "https://www.patagonia.com/product/mens-lightweight-synchilla-snap-t-fleece-pullover/25551.html?dwvar_25551_color=KALB"
    }
  ],
  "maxItems": 100
}

Example output in JSON format:

[
  {
    "reviewId": 793942293,
    "productId": "23075",
    "productName": "W's Classic Retro-X® Jacket",
    "productImageUrl": "",
    "productPageUrl": "https://yotpo.com/go/335xOpWP",
    "isSyndicated": false,
    "syndicationSource": null,
    "rating": 4,
    "title": "Amanita is fab! Hoping for an XXL",
    "reviewBody": "This jacket in Amanita is great. Festive and Eye catching. However, the jacket runs very short. It would help a lot if you could spend the extra money to put in a two-way zipper. Then at least one could open it up at the bottom where it pooches out. It would also be far more flattering in a longer cut with side slits. If not for the great print, I would not have kept this in the XL jacket",
    "isRecommended": false,
    "isIncentivized": false,
    "verifiedBuyer": false,
    "submissionTime": "2025-12-26T08:28:42.000Z",
    "reviewerName": "Alida L.",
    "country": "US",
    "sentiment": 0.1531145,
    "votesUp": 19,
    "votesDown": 1,
    "customFields": {
      "Likelihood to Recommend": {
        "title": "Likelihood to Recommend",
        "fieldType": "SingleChoice",
        "value": "No"
      },
      "Fit": {
        "title": "Fit",
        "fieldType": "Rating",
        "value": 1
      },
      "Height": {
        "title": "Height",
        "fieldType": "SingleChoice",
        "value": "5'10 - 6'0"
      },
      "Activity": {
        "title": "Activity",
        "fieldType": "MultipleChoice",
        "value": "Casual Wear"
      },
      "Size": {
        "title": "Size",
        "fieldType": "SingleChoice",
        "value": "XL"
      }
    },
    "topics": {
      "print": "If not for the great print, I would not have kept this in the XL jacket",
      "jacket": "This jacket in Amanita is great.",
      "amanita": "Amanita is fab! Hoping for an XXL"
    },
    "photos": [
      {
        "id": "798324310",
        "url": "",
        "thumbUrl": "https://cdn-yotpo-images-production.yotpo.com/Review/793942293/798324310/square.jpg?1766738046"
      },
      {
        "id": "798324314",
        "url": "",
        "thumbUrl": "https://cdn-yotpo-images-production.yotpo.com/Review/793942293/798324314/square.jpg?1766738049"
      }
    ],
    "comment": null,
    "language": "en"
  }
]

Use Cases

• Market Research and Analysis: Gather customer reviews to analyze trends, sentiment, and product performance.
• Competitive Intelligence: Monitor competitor products and reviews to inform pricing and marketing strategies.
• Price Monitoring: Extract review data alongside product details for comprehensive market insights.
• Content Aggregation: Collect user-generated content for blogs, reports, or social media campaigns.
• Academic Research: Study consumer behavior through large-scale review datasets.
• Business Automation: Automate data collection for dashboards, alerting systems, or CRM integrations.

Installation and Usage

1. Search for "Project Cheerio Crawler Typescript" in the Apify Store
2. Click "Try for free" or "Run"
3. Configure input parameters
4. Click "Start" to begin extraction
5. Monitor progress in the log
6. Export results in your preferred format (JSON, CSV, Excel)

Output Format

The Actor outputs an array of JSON objects, each representing a product review. Key fields include:

• reviewId: Unique identifier for the review.
• productId, productName: Details about the reviewed product.
• rating, title, reviewBody: Core review content and score.
• customFields: Additional metadata like fit, size, and recommendations.
• topics, photos: Extracted themes and image URLs.
• sentiment: Numerical sentiment score.
• submissionTime, reviewerName: Timestamp and author info.

Data is structured for easy parsing and analysis.

Support

For custom/simplified outputs or bug reports, please contact:

• Email: support@getdataforme.com
• Subject line: "custom support"
• Contact form: https://getdataforme.com/contact/

We're here to help you get the most out of this Actor!

---

Extract high-quality product reviews effortlessly with Project Cheerio Crawler Typescript. Features fast Cheerio-based scraping, structured JSON output, and customizable inputs for e-commerce sites. Ideal for market research, competitive analysis, and content aggregation. Start extracting valuable insights today—try it free on Apify! (248 characters)