# Controller.com Scraper (`lexis-solutions/controller-com-scraper`) Actor Controller.com Scraper: scrape structured aircraft listings from Controller.com search results, including price, year, manufacturer, model, registration, location, seller contacts, description, specs, images and breadcrumbs for aviation market research. - **URL**: https://apify.com/lexis-solutions/controller-com-scraper.md - **Developed by:** [Lexis Solutions](https://apify.com/lexis-solutions) (community) - **Categories:** E-commerce, AI, Travel - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $19.90 / 1,000 listings This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Controller.com Scraper ![banner](https://i.imgur.com/sEd0IIr.png) Controller.com is an aircraft marketplace for jets, turboprops, piston aircraft, helicopters, and aviation equipment. This actor collects structured aircraft listing data from Controller.com search result pages. ### Introduction The Controller.com scraper starts from search listing URLs, paginates through results, and extracts structured aircraft listing data such as title, price, listing type, year, manufacturer, model, serial number, registration number, location, seller contact details, description, specifications, images, and breadcrumbs. ### Use Cases - **Market research**: Track aircraft availability, asking prices, locations, and aircraft categories. - **Inventory monitoring**: Watch new and updated listings for selected aircraft types, manufacturers, or keywords. - **Lead generation**: Build structured datasets of sellers and aircraft listings for sales workflows. - **Analytics pipelines**: Feed BI tools, dashboards, and internal warehousing. ### Input Provide the following fields: - `startUrls` (array, required): Controller.com search or listing URLs. - `maxItems` (integer, optional): Maximum number of listing items to extract. - `proxyConfiguration` (object, optional): Apify proxy settings. Notes: - Crawling stops when `maxItems` is reached or when no more result items are found. ### Input Examples **1) Start URLs** ```json { "startUrls": [ { "url": "https://www.controller.com/listings/search?ListingType=For%20Lease&page=1" } ], "maxItems": 5 } ```` ### Output Each dataset item contains fields like: ```json { "url": "https://www.controller.com/listing/for-lease/250038063/1995-bombardier-challenger-601-3r-jet-aircraft", "listingId": "250038063", "title": "1995 BOMBARDIER CHALLENGER 601-3R", "price": "Call for price", "listingType": "For Lease", "year": "1995", "manufacturer": "BOMBARDIER", "model": "CHALLENGER 601-3R", "serialNumber": "5177", "registrationNumber": "N770WW", "category": "CHALLENGER 601-3R", "location": "Venice, Florida", "sellerName": "International Aircraft Marketing & Sales", "sellerPhone": "(941) 726-8953", "description": "Exceptionally maintained Challenger 601-3R...", "specifications": {}, "images": ["https://media.sandhills.com/img.axd?id=..."], "breadcrumbs": [ "FIND AIRCRAFT FOR SALE >", "JET AIRCRAFT FOR LEASE >", "BOMBARDIER >" ] } ``` The scraper paginates through listing results and stops when `maxItems` is reached or when no more result items are found. ### Why use the Controller.com Scraper? - **Focused**: Built specifically for Controller.com aircraft listing flows. - **Structured output**: Ready-to-use JSON records for automation and analysis. - **Pagination support**: Collects data across result pages until the item limit is reached. - **Flexible input**: Supports lease, sale, and keyword search listing URLs. - **Apify-native**: Works with Apify datasets, request queue, and proxy config. ### FAQ - **How many listings can it extract?**\ Controlled by `maxItems`. - **Do I need proxies?**\ No. The default input runs without a proxy. You can still configure proxies for your own network requirements. - **Can I start from a listing detail URL?**\ The actor can classify detail URLs, but it is primarily designed for search/listing URLs. - **What if Controller.com changes their website structure?**\ The actor may require updates to keep extraction stable. ### Need to scrape other automotive or marketplace platforms? Check out our other scrapers: - [Napaonline](https://apify.com/lexis-solutions/napaonline-scraper). - [AutoZone](https://apify.com/lexis-solutions/auto-zone-com). - [CARFAX](https://apify.com/lexis-solutions/carfax-com). - [CarGurus](https://apify.com/lexis-solutions/cargurus-com). *** **Need help or want a custom solution?** Lexis Solutions is a certified Apify Partner. We can help with custom data extraction projects. Contact us over [Email](mailto:scraping@lexis.solutions) or [LinkedIn](https://www.linkedin.com/company/lexis-solutions). ### Support Our Work If you're happy with our work and scrapers, you're welcome to leave us a company review [here](https://apify.com/partners/find/lexis-solutions/review) and leave a review for the scrapers you're subscribed to. ### Image Credit Image credit: controller.com. # Actor input Schema ## `startUrls` (type: `array`): Controller.com search or listing URLs to scrape. ## `maxItems` (type: `integer`): Maximum number of listings to scrape. ## `proxyConfiguration` (type: `object`): Proxy settings for the scraper. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.controller.com/listings/search?ListingType=For%20Lease&page=1" } ], "maxItems": 5, "proxyConfiguration": { "useApifyProxy": false } } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.controller.com/listings/search?ListingType=For%20Lease&page=1" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("lexis-solutions/controller-com-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.controller.com/listings/search?ListingType=For%20Lease&page=1" }] } # Run the Actor and wait for it to finish run = client.actor("lexis-solutions/controller-com-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.controller.com/listings/search?ListingType=For%20Lease&page=1" } ] }' | apify call lexis-solutions/controller-com-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=lexis-solutions/controller-com-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Controller.com Scraper", "description": "Controller.com Scraper: scrape structured aircraft listings from Controller.com search results, including price, year, manufacturer, model, registration, location, seller contacts, description, specs, images and breadcrumbs for aviation market research.", "version": "1.0", "x-build-id": "DgDjlYG2WziNfuLfc" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/lexis-solutions~controller-com-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-lexis-solutions-controller-com-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/lexis-solutions~controller-com-scraper/runs": { "post": { "operationId": "runs-sync-lexis-solutions-controller-com-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/lexis-solutions~controller-com-scraper/run-sync": { "post": { "operationId": "run-sync-lexis-solutions-controller-com-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "Controller.com search or listing URLs to scrape.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "maxItems": { "title": "Max items", "type": "integer", "description": "Maximum number of listings to scrape.", "default": 5 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Proxy settings for the scraper.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```