# Indie Hackers Products Scraper (`automation-lab/indie-hackers-products-scraper`) Actor Extract Indie Hackers product directory data: startups, taglines, websites, tags, founder IDs, revenue signals, and search metadata. - **URL**: https://apify.com/automation-lab/indie-hackers-products-scraper.md - **Developed by:** [Stas Persiianenko](https://apify.com/automation-lab) (community) - **Categories:** Lead generation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per event This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Indie Hackers Products Scraper Extract public product and startup records from the Indie Hackers product directory. Use this actor to collect names, taglines, websites, founder IDs, tags, social handles, and product metadata from Indie Hackers without writing your own Algolia integration. ### What does Indie Hackers Products Scraper do? Indie Hackers Products Scraper searches the public Indie Hackers product directory and saves structured product records to an Apify dataset. It is built for repeatable lead generation, market research, startup discovery, and product category analysis. The actor uses HTTP requests to the public search index exposed by Indie Hackers, so it is fast, lightweight, and does not need a browser. ### Who is it for? #### Sales teams Find SaaS companies, indie products, and startup websites for outbound prospecting. #### Investors and scouts Build watchlists of bootstrapped founders, AI startups, ecommerce tools, and niche software products. #### Market researchers Map product categories, revenue models, funding tags, and platform tags in the Indie Hackers ecosystem. #### Agencies Discover companies that may need marketing, SEO, analytics, design, or development help. #### Builders Study positioning, taglines, categories, and website examples from thousands of indie products. ### Why use this actor? - โšก Fast HTTP-only extraction - ๐Ÿ”Ž Keyword search support - ๐Ÿท๏ธ Optional tag filters - ๐ŸŒ Website and Indie Hackers profile URLs - ๐Ÿง‘ Founder user IDs when available - ๐Ÿ“Š Revenue, follower, and traffic fields when the source exposes them - ๐Ÿงพ Clean JSON output ready for export - ๐Ÿ” Works in scheduled Apify workflows ### Data you can extract | Field | Description | | --- | --- | | `name` | Product name | | `tagline` | Short product pitch | | `description` | Longer product description | | `productUrl` | Indie Hackers product page | | `websiteUrl` | External product website | | `slug` | Indie Hackers product slug | | `twitterHandle` | Public Twitter/X handle | | `twitterUrl` | Derived Twitter/X URL | | `revenue` | Public revenue value when present | | `numFollowers` | Indie Hackers follower count | | `last30DaysUniques` | Public traffic metric when present | | `userIds` | Founder or maker IDs | | `tags` | All public product tags | | `verticalTags` | Tags beginning with `vertical-` | | `revenueModelTags` | Tags beginning with `revenue-model-` | | `platformTags` | Tags beginning with `platform-` | | `fundingTags` | Tags beginning with `funding-` | | `scrapedAt` | Timestamp of extraction | ### How much does it cost to scrape Indie Hackers products? This actor uses pay-per-event pricing. You pay a small run-start fee and then a per-product fee only for product records saved to the dataset. Typical small test runs are inexpensive because the default input saves only a small number of products. Final tiered pricing is set on the Apify platform before publication. ### How to use the actor 1. Open the actor on Apify. 2. Enter a keyword such as `analytics`, `ai`, `marketing`, or `shopify`. 3. Set the maximum number of products. 4. Optionally add exact Indie Hackers tags. 5. Start the run. 6. Export the dataset as JSON, CSV, Excel, XML, or via API. ### Input The input is intentionally small and easy to use. ```json { "query": "analytics", "maxItems": 20, "tags": ["vertical-saas"] } ```` ### Input fields #### `query` Keyword searched against product name, tagline, description, website URL, and public social fields. Leave it empty to export from the broader product directory. #### `maxItems` Maximum number of product records to save. Use a low number for test runs and a higher number for production exports. #### `tags` Optional exact public Indie Hackers tags. Examples: - `vertical-saas` - `vertical-ai` - `vertical-analytics` - `revenue-model-subscription` - `platform-web` - `funding-bootstrapped` ### Output Each dataset item is one Indie Hackers product record. ```json { "name": "Dynoweb", "tagline": "Replace GA + Hotjar + CRO tools with one.", "description": "Shopify analytics tools show what happened...", "productUrl": "https://www.indiehackers.com/product/dynoweb", "websiteUrl": "https://www.dynoweb.app", "slug": "dynoweb", "twitterHandle": "Dynoweb_", "twitterUrl": "https://twitter.com/Dynoweb_", "revenue": 0, "numFollowers": 1, "tags": ["vertical-ai", "vertical-saas"], "query": "analytics", "position": 1, "scrapedAt": "2026-05-23T09:00:00.000Z" } ``` ### Tips for better results - Use focused keywords for cleaner exports. - Combine a keyword with one or two tags for niche prospecting. - Use `vertical-saas` for software products. - Use `revenue-model-subscription` to find subscription businesses. - Increase `maxItems` only after a small test run looks correct. ### Example searches - `analytics` - `ai` - `shopify` - `marketing` - `email` - `automation` - `design` - `developer tools` ### Example workflows #### Startup lead list Search for `analytics`, filter by `vertical-saas`, export websites to CSV, and enrich the domains in your CRM. #### Founder research Search by category and use `userIds` or `makerProfileUrls` to review founder profiles on Indie Hackers. #### Competitive research Export products in your category and compare positioning, tags, website URLs, and launch dates. #### Newsletter sourcing Find recently published products in a niche and curate them for a startup newsletter. ### Integrations Use the dataset with: - Google Sheets exports - Zapier or Make automations - CRM imports - Lead enrichment tools - Apify webhooks - Apify API clients - BI dashboards ### API usage #### Node.js ```js import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: process.env.APIFY_TOKEN }); const run = await client.actor('automation-lab/indie-hackers-products-scraper').call({ query: 'analytics', maxItems: 50, tags: ['vertical-saas'], }); const { items } = await client.dataset(run.defaultDatasetId).listItems(); console.log(items); ``` #### Python ```python from apify_client import ApifyClient import os client = ApifyClient(os.environ['APIFY_TOKEN']) run = client.actor('automation-lab/indie-hackers-products-scraper').call(run_input={ 'query': 'analytics', 'maxItems': 50, 'tags': ['vertical-saas'], }) items = client.dataset(run['defaultDatasetId']).list_items().items print(items) ``` #### cURL ```bash curl -X POST "https://api.apify.com/v2/acts/automation-lab~indie-hackers-products-scraper/runs?token=$APIFY_TOKEN" \ -H 'Content-Type: application/json' \ -d '{"query":"analytics","maxItems":50,"tags":["vertical-saas"]}' ``` ### MCP usage You can use this actor through Apify MCP in Claude Code or Claude Desktop. MCP URL: ```text https://mcp.apify.com/?tools=automation-lab/indie-hackers-products-scraper ``` Claude Code setup: ```bash claude mcp add apify https://mcp.apify.com/?tools=automation-lab/indie-hackers-products-scraper ``` Claude Desktop JSON config: ```json { "mcpServers": { "apify": { "url": "https://mcp.apify.com/?tools=automation-lab/indie-hackers-products-scraper" } } } ``` Example prompts: - "Find 25 Indie Hackers products about analytics and return their websites." - "Export SaaS products from Indie Hackers that mention AI." - "Create a lead list from Indie Hackers products in marketing automation." ### Scheduling Run the actor on a schedule to monitor new products in a category. For example, schedule a weekly run for `ai` and compare new product slugs against your previous dataset. ### Webhooks Attach an Apify webhook to send finished dataset URLs to Slack, Zapier, Make, or your own backend. This is useful for recurring prospecting workflows. ### Data freshness The actor reads the current public Indie Hackers search index during each run. Results can change as Indie Hackers updates product records, tags, and ranking. ### Limits The actor can request up to 10,000 products per run. If a query has fewer matching products, the actor stops when the source has no more pages. ### FAQ #### Can I scrape Indie Hackers products without a browser? Yes. This actor uses public HTTP endpoints and does not launch a browser, so runs are fast and inexpensive. ### Troubleshooting #### Why did I get fewer items than `maxItems`? The source may have fewer products matching your query and tag filters. Try removing tags or using a broader keyword. #### Why are some fields null? Indie Hackers does not expose every field for every product. The actor preserves missing values as `null` instead of inventing data. #### Why does a tag filter return zero results? Tags must match the exact public tag name used in the source index. Try running without tags first and inspect the `tags` field in the output. ### Legality This actor extracts publicly available product directory data. You are responsible for using the data in compliance with applicable laws, Indie Hackers terms, and privacy regulations. Do not use the output for spam, harassment, or unlawful profiling. ### Related scrapers Other automation-lab actors that may complement this workflow: - Product discovery scrapers - Startup directory scrapers - Website/domain enrichment actors - Social profile enrichment actors - Email verification actors Use them together to build a complete startup lead-generation pipeline. ### Changelog #### 0.1 Initial version with public Indie Hackers product search, tag filters, and structured dataset output. ### Support If a run fails or the output looks wrong, open an Apify issue with your run URL and expected result. Include the query, tags, and max item count so the issue can be reproduced. ### Notes The actor is not affiliated with Indie Hackers. It only uses public data available without logging in. # Actor input Schema ## `query` (type: `string`): Keyword to search in product names, taglines, descriptions, websites, and Twitter handles. Leave empty to export the newest/all products. ## `maxItems` (type: `integer`): Maximum number of Indie Hackers product records to save. ## `tags` (type: `array`): Optional Algolia tag filters such as vertical-saas, vertical-ai, revenue-model-subscription, platform-web, or funding-bootstrapped. All listed tags must match. ## Actor input object example ```json { "query": "analytics", "maxItems": 20, "tags": [] } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "query": "analytics", "maxItems": 20, "tags": [] }; // Run the Actor and wait for it to finish const run = await client.actor("automation-lab/indie-hackers-products-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "query": "analytics", "maxItems": 20, "tags": [], } # Run the Actor and wait for it to finish run = client.actor("automation-lab/indie-hackers-products-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "query": "analytics", "maxItems": 20, "tags": [] }' | apify call automation-lab/indie-hackers-products-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=automation-lab/indie-hackers-products-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Indie Hackers Products Scraper", "description": "Extract Indie Hackers product directory data: startups, taglines, websites, tags, founder IDs, revenue signals, and search metadata.", "version": "0.1", "x-build-id": "jZsHAbOcHcgaucKyk" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/automation-lab~indie-hackers-products-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-automation-lab-indie-hackers-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/automation-lab~indie-hackers-products-scraper/runs": { "post": { "operationId": "runs-sync-automation-lab-indie-hackers-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/automation-lab~indie-hackers-products-scraper/run-sync": { "post": { "operationId": "run-sync-automation-lab-indie-hackers-products-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "query": { "title": "Search query", "type": "string", "description": "Keyword to search in product names, taglines, descriptions, websites, and Twitter handles. Leave empty to export the newest/all products.", "default": "analytics" }, "maxItems": { "title": "Maximum products", "minimum": 1, "maximum": 10000, "type": "integer", "description": "Maximum number of Indie Hackers product records to save.", "default": 20 }, "tags": { "title": "Exact Indie Hackers tags", "type": "array", "description": "Optional Algolia tag filters such as vertical-saas, vertical-ai, revenue-model-subscription, platform-web, or funding-bootstrapped. All listed tags must match.", "default": [], "items": { "type": "string" } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```