# Hotmart Categories Spider (`getdataforme/hotmart-categories-spider`) Actor The Hotmart Categories Spider automates scraping detailed product data from Hotmart marketplace categories, extracting titles, descriptions, ratings, prices, and more.... - **URL**: https://apify.com/getdataforme/hotmart-categories-spider.md - **Developed by:** [GetDataForMe](https://apify.com/getdataforme) (community) - **Categories:** AI, Automation, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $9.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ### Description The Hotmart Categories Spider automates scraping detailed product data from Hotmart marketplace categories, extracting titles, descriptions, ratings, prices, and more.... --- ## Hotmart Categories Spider ### Introduction The Hotmart Categories Spider is a powerful Apify Actor designed to scrape and extract detailed product information from Hotmart's marketplace categories. It automates the collection of product data such as titles, descriptions, ratings, and more, enabling efficient data gathering for analysis and insights. This tool is ideal for users seeking reliable, structured data from Hotmart's diverse product offerings without manual effort. ### Features - **Comprehensive Data Extraction**: Scrapes key product details including IDs, titles, descriptions, ratings, reviews, prices, and owner information. - **Flexible URL Configuration**: Supports multiple start URLs for targeted scraping across different categories. - **High-Performance Scraping**: Built for speed and reliability, handling large volumes of data with minimal downtime. - **Structured JSON Output**: Delivers clean, machine-readable data perfect for integration into databases or analytics tools. - **Error-Resilient**: Includes built-in handling for common scraping challenges like rate limits and network issues. - **Apify Integration**: Seamlessly runs on the Apify platform with easy monitoring and export options. - **Customizable and Scalable**: Adaptable for various use cases, from small queries to large-scale data collection. ### Input Parameters | Parameter | Type | Required | Description | Example | |-----------|--------|----------|-------------|---------| | StartUrls | array | No | An array of URLs to start scraping from. Each URL should point to a Hotmart category page. At least one URL is required for the actor to run. | ["https://hotmart.com/pt-br/marketplace/categorias/animais-e-pets/pet"] | ### Example Usage #### Input Configuration ```json { "StartUrls": [ "https://hotmart.com/pt-br/marketplace/categorias/animais-e-pets/pet" ] } ```` #### Output Example ```json [ { "productId": 173373, "title": " CURSO ADESTRAMENTO ONLINE - CWD 15X15", "slug": "adestramento-cwd-15x15", "description": "Você aprende a treinar 15 minutos por aula para ter 15 anos de sucesso na obediência do seu cão. É um curso com uma linguagem e um sistema fácil, moderno e eficaz. Abordado através de técnicas baseadas em leis e princípios da psicologia comportamental que regem o fenômeno da aprendizagem.\nCom esse curso, você será ouvido e respeitado pelo seu cão. Você deixará de ser refém dele.\nVocê irá ensinar pro teu cão exercícios funcionais para seu dia a dia, e também um módulo avançado é disponibilizado.Os funcionais são:\n- Fazer as necessidades no local adequado, não pular em você, não arrastar nos passeios, se comportando corretamente, além de comandos básicos como, sentar, deitar, e atender ao chamado.Os avançados: \"Junto alto nível\", targets, base de filhotes e colar eletrônico.\nE a técnica exclusiva da Escola Caio working dogs:\nAU-tomatiza-CÃO do cão para não fugir para rua, obedecendo ao som do portão automático.\nO seu cão vai obedecer ao som da máquina do portão da sua casa evitando fugas. \nProduzido pelo Campeão Brasileiro e juiz internacional Caio Alexandre", "avatar": "https://hotmart.s3.amazonaws.com/product_pictures/a000556c-4034-4f27-958c-e015804ebf1c/FOTOOFICIALDOCURSOCWD15X15ONLINE.jpg", "finalAvatar": "https://static-media.hotmart.com/aRBIabkvD9XOje8rYsqPbG6_g8M=/300x300/smart/filters:format(webp):background_color(white)/hotmart/product_pictures/a000556c-4034-4f27-958c-e015804ebf1c/FOTOOFICIALDOCURSOCWD15X15ONLINE.jpg", "category": "animals_and_plants", "rating": 4.683673469387755, "totalReviews": 294, "price": "", "ownerName": "Caio Working dogs", "videoLink": "https://www.youtube.com/watch?v=4magTOYM9Oc&feature=youtu.be", "actor_id": "3saGT7IWzGeJApSrv", "run_id": "n6LdkMg2qv2mo6Z2g" }, { "productId": 1030128, "title": "Método Adestramento Inteligente", "slug": "metodo-alexandre-rossi", "description": "O Método Alexandre Rossi leva para sua casa os conceitos do Adestramento Inteligente ensinados pelo adestrador preferido das redes de televisão.\n\nCom o Método Alexandre Rossi qualquer pessoa da família pode aplicar as técnicas de Adestramento Inteligente e , com apenas 15min por dia, tornar a convivência com seu pet muito melhor. Além de aprender como solucionar comportamentos indesejados que só atrapalham a relação.", "avatar": "https://hotmart.s3.amazonaws.com/product_pictures/021bf065-e080-46a5-bc98-7f3f9f3365c5/WhatsAppImage20210805at105041.jpeg", "finalAvatar": "https://static-media.hotmart.com/ydPX9sFsCzTnPdf4T0oRlKxNHtI=/300x300/smart/filters:format(webp):background_color(white)/hotmart/product_pictures/021bf065-e080-46a5-bc98-7f3f9f3365c5/WhatsAppImage20210805at105041.jpeg", "category": "animals_and_plants", "rating": 4.8561643835616435, "totalReviews": 146, "price": "", "ownerName": "Alexandre Rossi Dr. Pet", "videoLink": "", "actor_id": "3saGT7IWzGeJApSrv", "run_id": "n6LdkMg2qv2mo6Z2g" }, { "productId": 2165521, "title": "Curso de Banho e Tosa PET PRO", "slug": "curso-de-banho-e-tosa-pet-pro", "description": "🔥 VOCÊ AMA ANIMAIS? Transforme essa Paixão em uma Carreira de Sucesso! 🔥\n🐾 CURSO BANHO E TOSA PET PRO: Sua Porta de Entrada para um Mercado Lucrativo e em Expansão! 🐾\n\nChegou a sua chance de brilhar no mercado de banho e tosa! Quer começar do zero e se tornar um especialista? Ou já trabalha na área, mas sonha em elevar suas habilidades? Esse curso é feito para você!\n\nPOR QUE ESCOLHER O PET PRO?\nAulas em Alta Definição: Como se estivesse ao lado de um profissional, com clareza e qualidade para você aprender cada detalhe!\nAcesso Imediato: Confirmou a inscrição? Em segundos, você já estará aprendendo!\nCertificado Exclusivo: Reconhecido pela ABED, dando a você credibilidade nacional para se destacar no mercado!\nO QUE VOCÊ VAI APRENDER?\nDesde a introdução ao mercado até as técnicas mais avançadas, incluindo o cuidado especial para cada raça e, o melhor: como precificar seus serviços para lucrar de verdade!\n\nGARANTIA INCONDICIONAL: Satisfação 100% ou seu Dinheiro de Volta!\nOu você ama o curso, ou devolvemos seu investimento em até 7 dias, sem perguntas. Risco zero para você se sentir totalmente seguro(a)!\n\nA HORA É AGORA!\nNão perca a oportunidade de se tornar a referência em banho e tosa na sua cidade. Clique para se inscrever e dê o primeiro passo para o sucesso com o Curso Banho e Tosa Pet Pro!", "avatar": "https://hotmart.s3.amazonaws.com/product_pictures/11c65550-0322-46e7-ba0f-136dfc333ff4/CopiadeCopiadeCopiadeDesignsemnome.png", "finalAvatar": "https://static-media.hotmart.com/bXoFTxGFq_t4UnSC7m_vYokJg2o=/300x300/smart/filters:format(webp):background_color(white)/hotmart/product_pictures/11c65550-0322-46e7-ba0f-136dfc333ff4/CopiadeCopiadeCopiadeDesignsemnome.png", "category": "animals_and_plants", "rating": 4.557894736842106, "totalReviews": 190, "price": "", "ownerName": "WebHoje Cursos Online", "videoLink": "https://youtu.be/1vA0zJ56pUg", "actor_id": "3saGT7IWzGeJApSrv", "run_id": "n6LdkMg2qv2mo6Z2g" } ] ``` ### Use Cases - **Market Research**: Analyze trends in product categories to identify popular niches and consumer preferences. - **Competitive Intelligence**: Gather data on competitors' offerings, pricing, and ratings for strategic planning. - **Price Monitoring**: Track product prices and availability across categories for dynamic pricing strategies. - **Content Aggregation**: Collect product descriptions and media for creating content hubs or review sites. - **Academic Research**: Study marketplace dynamics, such as rating distributions and category performance. - **Business Automation**: Automate data feeds for CRM systems or e-commerce platforms integrating Hotmart data. ### Installation and Usage 1. Search for "Hotmart Categories Spider" in the Apify Store. 2. Click "Try for free" or "Run". 3. Configure input parameters (e.g., add start URLs). 4. Click "Start" to begin extraction. 5. Monitor progress in the log. 6. Export results in your preferred format (JSON, CSV, Excel). ### Output Format The actor outputs an array of JSON objects, each representing a product. Key fields include: - `productId`: Unique identifier for the product. - `title`: Product name. - `slug`: URL-friendly identifier. - `description`: Detailed product description. - `avatar` and `finalAvatar`: Image URLs. - `category`: Product category. - `rating`: Average user rating. - `totalReviews`: Number of reviews. - `price`: Product price (may be empty). - `ownerName`: Seller's name. - `videoLink`: Associated video URL (if available). - `actor_id` and `run_id`: Metadata from the Apify run. Data is structured for easy parsing and integration. ### Error Handling The actor handles common errors like invalid URLs, network timeouts, and rate limits by retrying requests and logging issues. If a URL fails, it skips and continues. Check the run log for details on failures. For persistent issues, ensure URLs are valid Hotmart category links. ### Rate Limiting and Best Practices Hotmart may impose rate limits; the actor includes delays to comply. Best practices: Limit concurrent runs, use valid URLs, and monitor logs. Avoid overloading the site; space out large extractions. For optimal performance, run during off-peak hours. ### Limitations and Considerations - Data accuracy depends on Hotmart's site structure; changes may require updates. - Some fields like price may be unavailable. - Scraping is subject to Hotmart's terms; use ethically. - Large categories may take time; consider pagination limits. ### Support For custom/simplified outputs or bug reports, please contact: - Email: support@getdataforme.com - Subject line: "custom support" - Contact form: https://getdataforme.com/contact/ We're here to help you get the most out of this Actor! *** # Actor input Schema ## `StartUrls` (type: `array`): The start urls for the spider. ## Actor input object example ```json { "StartUrls": [ "https://hotmart.com/pt-br/marketplace/categorias/animais-e-pets/pet" ] } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("getdataforme/hotmart-categories-spider").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("getdataforme/hotmart-categories-spider").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call getdataforme/hotmart-categories-spider --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=getdataforme/hotmart-categories-spider", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Hotmart Categories Spider", "description": "The Hotmart Categories Spider automates scraping detailed product data from Hotmart marketplace categories, extracting titles, descriptions, ratings, prices, and more....", "version": "0.0", "x-build-id": "zRZkkpD5rVJL5ed7H" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/getdataforme~hotmart-categories-spider/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-getdataforme-hotmart-categories-spider", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/getdataforme~hotmart-categories-spider/runs": { "post": { "operationId": "runs-sync-getdataforme-hotmart-categories-spider", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/getdataforme~hotmart-categories-spider/run-sync": { "post": { "operationId": "run-sync-getdataforme-hotmart-categories-spider", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "StartUrls": { "title": "Start Urls", "minItems": 1, "type": "array", "description": "The start urls for the spider.", "default": [ "https://hotmart.com/pt-br/marketplace/categorias/animais-e-pets/pet" ], "items": { "type": "string" } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```