# Kickstarter Project Search Scraper (`stealth_mode/kickstarter-project-search-scraper`) Actor Scrape Kickstarter project listings with complete campaign data. Collect 40+ fields including funding goals, pledged amounts, backer counts, creator info, and project metadata — perfect for market research, investment analysis, and competitive intelligence. - **URL**: https://apify.com/stealth\_mode/kickstarter-project-search-scraper.md - **Developed by:** [Stealth mode](https://apify.com/stealth_mode) (community) - **Categories:** Automation, Developer tools, Lead generation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $1.50 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Kickstarter Project Search Scraper: Extract Crowdfunding Data at Scale --- ### What Is Kickstarter? Kickstarter is a global crowdfunding platform where creators launch projects across categories from technology and design to film and music. With hundreds of thousands of active campaigns and millions of backers, Kickstarter represents a rich dataset of consumer trends, entrepreneurial activity, and funding patterns. However, manually collecting and organizing project data is impractical — the **Kickstarter Project Search Scraper** automates this process, delivering structured campaign intelligence at scale. --- ### Overview The **Kickstarter Project Search Scraper** extracts detailed project information from Kickstarter's advanced search and category pages, capturing the complete project lifecycle. It is ideal for: - **Investment researchers** analyzing crowdfunding trends and success metrics - **Market analysts** tracking emerging product categories and consumer demand - **Competitive intelligence teams** monitoring competitor campaigns - **Data journalists** investigating funding patterns by geography or category - **Academic researchers** studying innovation and entrepreneurial behavior Key strengths include support for filtered search URLs (by category, location, sort method), configurable item limits, and robust error handling for large-scale runs. --- ### Input Format The scraper accepts a JSON configuration: ```json { "urls": [ "https://www.kickstarter.com/discover/advanced?category_id=7&woe_id=0&sort=magic&seed=2967492&page=4" ], "ignore_url_failures": true, "max_items_per_url": 200 } ```` | Field | Description | |---|---| | `urls` | Kickstarter search or category listing URLs to scrape (supports advanced search filters) | | `max_items_per_url` | Maximum projects to extract per URL (e.g., `200`) | | `ignore_url_failures` | If `true`, scraper continues if a URL fails instead of stopping | **URL structure:** Use Kickstarter's advanced search pages: - `category_id`: Filter by category (7=design, 9=technology, etc.) - `woe_id`: Geographic filter (0=worldwide) - `sort`: Order results (magic, newest, most\_funded, trending) - `page`: Pagination for large result sets > **Tip:** Use pagination (`page=1`, `page=2`, etc.) in separate URLs to avoid hitting item limits on large categories. *** ### Output Format **Sample output** ```json { "id": 873715477, "photo": { "key": "assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png", "full": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=315&origin=ugc&q=92&v=1780274693&width=560&sig=H%2BM5e4MPvHqXP4rRh6KYTlGtVXySVLHStIah%2BcqvLTY%3D", "ed": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=198&origin=ugc&q=92&v=1780274693&width=352&sig=M9PVhUCTcfK8y3iiEx%2FtdZkJuVv349Qz3LgoeenXLK8%3D", "med": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=153&origin=ugc&q=92&v=1780274693&width=272&sig=gwSUn%2Bw4tZAd%2BaG%2BMdglTVXRfxarKlXo%2B6xhlRdGpuA%3D", "little": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=117&origin=ugc&q=92&v=1780274693&width=208&sig=czisdXb2rYTwVAFS%2BbNN9fJ3BxO%2BpsIePFf3I8InNxc%3D", "small": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=90&origin=ugc&q=92&v=1780274693&width=160&sig=TNyHxlYFkoGyojbDEAu%2FSnPgWGdMpBCk8g%2BxhK%2F4nMg%3D", "thumb": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=27&origin=ugc&q=92&v=1780274693&width=48&sig=lRrU1Qso3cwLeNppqcfI4DU%2FohyZshlrWKseJdXygrw%3D", "1024x576": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=576&origin=ugc&q=92&v=1780274693&width=1024&sig=HZAlmGxZgwYbdTgYhbAMxN7wiBmxxrEv7xoBxd0VyLU%3D", "1536x864": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=873&origin=ugc&q=92&v=1780274693&width=1552&sig=VRs4K8iurFK8d54lxnGWWN8osxhz6JskTsTb0Wn1vbk%3D" }, "name": "Poplight Renter-Friendly Wall Light", "blurb": "Instantly upgrade your space with patented, tool-free wall lighting.", "goal": 5900.0, "pledged": 11695.0, "state": "live", "slug": "poplight-renter-friendly-wall-light", "country": "US", "country_displayable_name": "the United States", "currency": "USD", "currency_symbol": "$", "currency_trailing_code": true, "deadline": 1782107940, "state_changed_at": 1780311055, "created_at": 1776191671, "launched_at": 1780311051, "is_in_post_campaign_pledging_phase": false, "staff_pick": true, "is_starrable": true, "disable_communication": false, "backers_count": 54, "static_usd_rate": 1.0, "usd_pledged": "11695.0", "converted_pledged_amount": 11695, "fx_rate": 1.0, "usd_exchange_rate": 1.0, "current_currency": "USD", "usd_type": "international", "creator": { "id": 1116699707, "name": "Rose and Caroline", "slug": "poplightforthepeople", "is_registered": null, "is_email_verified": null, "chosen_currency": null, "is_superbacker": null, "has_admin_message_badge": false, "partner_badge": null, "ppo_has_action": false, "backing_action_count": 0, "avatar": { "thumb": "https://i.kickstarter.com/assets/039/705/532/bd601fd4c9c9f6c835af9d4bd517cfaf_original.png?anim=false&fit=cover&height=40&origin=ugc&q=92&v=1674081319&width=40&sig=nnx%2FTLLSYNA6a4JXmgyFUX9LIhmOxyqmxmqKGtkWx7s%3D", "small": "https://i.kickstarter.com/assets/039/705/532/bd601fd4c9c9f6c835af9d4bd517cfaf_original.png?anim=false&fit=cover&height=80&origin=ugc&q=92&v=1674081319&width=80&sig=8bQnNkWPBAzYI1gAiDRbTfw9a%2FQ4JcdI8tKuvqd7BBk%3D", "medium": "https://i.kickstarter.com/assets/039/705/532/bd601fd4c9c9f6c835af9d4bd517cfaf_original.png?anim=false&fit=cover&height=160&origin=ugc&q=92&v=1674081319&width=160&sig=sKyXf1KNek1MRiNqIrEi8WcO2VRexkjSBSN2vuWZLY4%3D" }, "urls": { "web": { "user": "https://www.kickstarter.com/profile/poplightforthepeople" }, "api": { "user": "https://api.kickstarter.com/v1/users/1116699707?signature=1780590741.3b007e5d133e881fbe038222cf86cf151ad878de" } } }, "location": { "id": 2391279, "name": "Denver", "slug": "denver-co", "short_name": "Denver, CO", "displayable_name": "Denver, CO", "localized_name": "Denver", "country": "US", "state": "CO", "type": "Town", "is_root": false, "expanded_country": "United States", "urls": { "web": { "discover": "https://www.kickstarter.com/discover/places/denver-co", "location": "https://www.kickstarter.com/locations/denver-co" }, "api": { "nearby_projects": "https://api.kickstarter.com/v1/discover?signature=1780565080.5ec0506497850fecc082a525a5694b0480da2369&woe_id=2391279" } } }, "category": { "id": 28, "name": "Product Design", "analytics_name": "Product Design", "slug": "design/product design", "position": 5, "parent_id": 7, "parent_name": "Design", "color": 2577151, "urls": { "web": { "discover": "http://www.kickstarter.com/discover/categories/design/product%20design" } } }, "video": { "id": 1434490, "status": "successful", "hls": "https://v2.kickstarter.com/1780502992-QQv6SyI0YTaxsByDIVkpQHC41NHL4wQtnM6%2BHdq3w1s%3D/projects/5318153/video-1434490-hls_playlist.m3u8", "hls_type": "application/x-mpegURL", "high": "https://v2.kickstarter.com/1780502992-QQv6SyI0YTaxsByDIVkpQHC41NHL4wQtnM6%2BHdq3w1s%3D/projects/5318153/video-1434490-h264_high.mp4", "high_type": "video/mp4; codecs=\"avc1.64001E, mp4a.40.2\"", "base": "https://v2.kickstarter.com/1780502992-QQv6SyI0YTaxsByDIVkpQHC41NHL4wQtnM6%2BHdq3w1s%3D/projects/5318153/video-1434490-h264_base.mp4", "base_type": "video/mp4; codecs=\"avc1.42E01E, mp4a.40.2\"", "tracks": "[{\"video_track\":{\"id\":241219,\"tid\":598207528,\"captionable_id\":1434490,\"captionable_type\":\"Video\",\"kind\":\"captions\",\"language\":\"en\",\"created_at\":\"2026-05-26T17:00:38-04:00\",\"updated_at\":\"2026-05-26T17:23:43-04:00\",\"import_status\":\"none\"}}]", "width": 1280, "height": 720, "frame": "https://d15chbti7ht62o.cloudfront.net/projects/5318153/video-1434490-h264_720.jpg?2026" }, "profile": { "id": 5357629, "project_id": 5357629, "state": "inactive", "state_changed_at": 1776191671, "name": "Poplight Renter-Friendly Wall Light", "blurb": null, "background_color": null, "text_color": null, "link_background_color": null, "link_text_color": null, "link_text": null, "link_url": null, "show_feature_image": false, "background_image_opacity": 0.8, "should_show_feature_image_section": true, "feature_image_attributes": { "image_urls": { "default": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=873&origin=ugc&q=92&v=1780274693&width=1552&sig=VRs4K8iurFK8d54lxnGWWN8osxhz6JskTsTb0Wn1vbk%3D", "baseball_card": "https://i.kickstarter.com/assets/053/937/235/c98819d15ac5a40c498de67ec0a01e7d_original.png?anim=false&fit=cover&gravity=auto&height=315&origin=ugc&q=92&v=1780274693&width=560&sig=H%2BM5e4MPvHqXP4rRh6KYTlGtVXySVLHStIah%2BcqvLTY%3D" } } }, "spotlight": false, "urls": { "web": { "project": "https://www.kickstarter.com/projects/poplightforthepeople/poplight-renter-friendly-wall-light", "rewards": "https://www.kickstarter.com/projects/poplightforthepeople/poplight-renter-friendly-wall-light/rewards" } }, "percent_funded": 198.22033898305085, "is_liked": null, "is_disliked": null, "is_launched": true, "prelaunch_activated": true, "from_url": "https://www.kickstarter.com/discover/advanced?category_id=7&woe_id=0&sort=magic&seed=2967492&page=4&ajax=true" } ``` Each scraped project returns a comprehensive record with 40+ fields spanning campaign basics, funding metrics, and creator details: #### Project Identification | Field | Meaning | |---|---| | `ID` | Unique Kickstarter project identifier | | `Name` | Official project title | | `Slug` | URL-friendly project identifier | | `Blurb` | Short project tagline or summary | | `Photo` | Project's primary cover image URL | #### Funding Metrics | Field | Meaning | |---|---| | `Goal` | Target funding amount in the project's native currency | | `Pledged` | Total amount pledged to date in native currency | | `USD Pledged` | Pledged amount converted to USD | | `Converted Pledged Amount` | Pledged amount in the user's display currency | | `Percent Funded` | Percentage of goal reached (e.g., 150%) | | `Backers Count` | Total number of individual backers | | `Static USD Rate` | Fixed USD conversion rate used for calculations | | `FX Rate` | Foreign exchange rate applied | | `USD Exchange Rate` | Current USD exchange rate | #### Currency & Regional Data | Field | Meaning | |---|---| | `Currency` | Project's native currency code (e.g., USD, GBP, EUR) | | `Currency Symbol` | Display symbol for the currency (e.g., $, £, €) | | `Currency Trailing Code` | Currency format (leading or trailing code) | | `Current Currency` | Currency displayed to the current user | | `USD Type` | Type of USD conversion applied | | `Country` | Project creator's country code | | `Country Displayable Name` | Human-readable country name | #### Campaign Timeline & Status | Field | Meaning | |---|---| | `State` | Current campaign state (live, successful, failed, cancelled) | | `State Changed At` | Timestamp of the last state change | | `Created At` | When the project was created | | `Launched At` | When the project went live to the public | | `Deadline` | Campaign end date and time | | `Is Launched` | Boolean indicating if campaign is publicly visible | | `Is In Post Campaign Pledging Phase` | Whether the project is in the post-campaign funding phase | | `Prelaunch Activated` | Whether pre-launch notifications were enabled | #### Creator & Metadata | Field | Meaning | |---|---| | `Creator` | Project creator's profile information | | `Location` | Creator's geographic location | | `Category` | Primary project category (design, tech, film, etc.) | | `Profile` | Creator's Kickstarter profile data | #### Features & Content | Field | Meaning | |---|---| | `Video` | Link to the project's campaign video | | `URLs` | Associated project URLs (campaign, external, etc.) | | `Spotlight` | Whether the project was featured in Kickstarter Spotlight | | `Staff Pick` | Whether Kickstarter staff selected the project | #### Engagement & Status Flags | Field | Meaning | |---|---| | `Is Starrable` | Whether the project can be favorited/starred | | `Is Liked` | Whether the current user liked the project | | `Is Disliked` | Whether the current user disliked the project | | `Disable Communication` | Whether the creator disabled backer messaging | *** ### How to Use 1. **Build your search URL** — Visit Kickstarter's advanced search, apply filters (category, country, sort), and copy the URL. 2. **Add pagination** — For categories with 1000+ projects, create multiple URLs with `&page=1`, `&page=2`, etc. 3. **Configure input** — Paste URLs into the `urls` array. Set `max_items_per_url` (e.g., `200` for comprehensive data). 4. **Enable error handling** — Set `ignore_url_failures: true` for large-scale runs to avoid interruptions. 5. **Execute** — Run the scraper and monitor the log for issues. 6. **Export & analyze** — Download results as JSON, CSV, or Excel for analysis in spreadsheets or databases. **Best practices:** - Start with a single page URL to test configuration before bulk scraping. - Use distinct sort methods (magic, newest, trending) to capture different project subsets. - Export regularly to avoid losing data in long runs. *** ### Use Cases & Business Value - **Market research:** Identify trending product categories and consumer preferences by funding volume - **Investment analysis:** Benchmark project success rates, funding timelines, and backer behavior by category - **Competitive landscape:** Track how similar projects perform across geographies and creator types - **Startup intelligence:** Monitor emerging companies using Kickstarter as a market validation channel - **Academic studies:** Analyze crowdfunding mechanisms, creator diversity, and innovation patterns The Kickstarter Project Search Scraper transforms sprawling campaign data into actionable intelligence, enabling data-driven decision making in product development, investment, and market analysis. *** ### Conclusion The **Kickstarter Project Search Scraper** empowers researchers, investors, and analysts to extract structured crowdfunding data at scale. With 40+ fields capturing funding, creator, and timeline information, it eliminates manual research and unlocks insights into global entrepreneurship and consumer trends. Start scraping today and turn Kickstarter projects into competitive intelligence. # Actor input Schema ## `urls` (type: `array`): Add the URLs of the project list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list. ## `ignore_url_failures` (type: `boolean`): If true, the scraper will continue running even if some URLs fail to be scraped. ## `max_items_per_url` (type: `integer`): The maximum number of items to scrape per URL. ## `proxy` (type: `object`): Select proxies to be used by your scraper. ## Actor input object example ```json { "urls": [ "https://www.kickstarter.com/discover/advanced?category_id=7&woe_id=0&sort=magic&seed=2967492&page=4" ], "ignore_url_failures": true, "max_items_per_url": 20, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://www.kickstarter.com/discover/advanced?category_id=7&woe_id=0&sort=magic&seed=2967492&page=4" ], "ignore_url_failures": true, "max_items_per_url": 20, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }; // Run the Actor and wait for it to finish const run = await client.actor("stealth_mode/kickstarter-project-search-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://www.kickstarter.com/discover/advanced?category_id=7&woe_id=0&sort=magic&seed=2967492&page=4"], "ignore_url_failures": True, "max_items_per_url": 20, "proxy": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], "apifyProxyCountry": "US", }, } # Run the Actor and wait for it to finish run = client.actor("stealth_mode/kickstarter-project-search-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://www.kickstarter.com/discover/advanced?category_id=7&woe_id=0&sort=magic&seed=2967492&page=4" ], "ignore_url_failures": true, "max_items_per_url": 20, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }' | apify call stealth_mode/kickstarter-project-search-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=stealth_mode/kickstarter-project-search-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Kickstarter Project Search Scraper", "description": "Scrape Kickstarter project listings with complete campaign data. Collect 40+ fields including funding goals, pledged amounts, backer counts, creator info, and project metadata — perfect for market research, investment analysis, and competitive intelligence.", "version": "0.0", "x-build-id": "QwDy4vvUpZTTAHFnc" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/stealth_mode~kickstarter-project-search-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-stealth_mode-kickstarter-project-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/stealth_mode~kickstarter-project-search-scraper/runs": { "post": { "operationId": "runs-sync-stealth_mode-kickstarter-project-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/stealth_mode~kickstarter-project-search-scraper/run-sync": { "post": { "operationId": "run-sync-stealth_mode-kickstarter-project-search-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "urls": { "title": "URLs of the project list urls to scrape", "type": "array", "description": "Add the URLs of the project list urls you want to scrape. You can paste URLs one by one, or use the Bulk edit section to add a prepared list.", "items": { "type": "string" } }, "ignore_url_failures": { "title": "Continue running even if some URLs fail to be scraped", "type": "boolean", "description": "If true, the scraper will continue running even if some URLs fail to be scraped." }, "max_items_per_url": { "title": "Max items per URL", "type": "integer", "description": "The maximum number of items to scrape per URL." }, "proxy": { "title": "Proxy configuration", "type": "object", "description": "Select proxies to be used by your scraper." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```