# ArcGIS FeatureServer Extractor (`datamule/arcgis-featureserver-extractor`) Actor Point at ANY Esri ArcGIS REST layer (FeatureServer/MapServer) behind US cities, counties, DOTs, HUD & USGS. Pages a layer's /query via resultOffset honoring exceededTransferLimit, or enumerates a service root. Flat rows: every attribute as a column + geometry + lon/lat + raw. Pay per feature. - **URL**: https://apify.com/datamule/arcgis-featureserver-extractor.md - **Developed by:** [Datamule](https://apify.com/datamule) (community) - **Categories:** Developer tools, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.35 / 1,000 features This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js/docs.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python/docs.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## ArcGIS FeatureServer Extractor **Point at ANY Esri ArcGIS REST layer and get clean, flat feature rows.** The **ArcGIS REST API** (`…/FeatureServer//query` and `…/MapServer//query`) is the single most common government / civic GIS surface in North America. Practically every US **city, county, DPW, state DOT, MPO, HUD, USGS office and utility** publishes its open data through an Esri **ArcGIS Server** or **ArcGIS Online** instance — that's **thousands of layers** behind one uniform protocol. The Apify Store has only per-instance clones; this is the **generic runner**. One actor turns any ArcGIS layer into structured rows — no per-site scraper. ### What it does 1. **Accepts a layer query URL, a layer URL, or a service root.** Give it `…/FeatureServer/0/query`, `…/FeatureServer/0`, or a bare `…/FeatureServer` / `…/MapServer` root — a root is **enumerated** into all of its layers automatically. 2. **Pages the layer** via the standard `resultOffset` + `resultRecordCount`, honoring the layer's `maxRecordCount` and following `exceededTransferLimit` until the result set is exhausted or your cap is hit. `f=json` is always sent explicitly. 3. **Flattens every feature** into one row: **every attribute becomes its own column**, plus the Esri geometry (`_geometry`), a computed bounding box (`_bbox`), `_longitude`/`_latitude` for point layers (reprojected from Web Mercator to WGS84 when needed), provenance (`_serviceUrl`, `_layerId`, `_layerName`, `_objectId`), and a lossless `_raw` copy of the original Esri feature. ### Modes - **Layer catalog** — turn on *List layers only* and give a **service root**: the actor reads the service descriptor and emits one row per layer (id, name, geometry type, min/max scale, query URL). A cheap map of what a service exposes — then point at a specific layer's `/query`. - **Features** — give one or more layer query URLs (or a root, which expands to all layers), optionally a `where` clause and an `outFields` list, and it pages every matching feature. ### Input | Field | Description | |-------|-------------| | **ArcGIS REST URL(s)** (required) | One or more layer query URLs, layer URLs, or service roots. A root is enumerated into its layers. Pre-existing query params (e.g. a `token`) are preserved. | | **WHERE clause** | SQL-style filter, e.g. `STATE = 'CA'` or `POP > 100000`. Default `1=1` (all rows). | | **Output fields** | Comma-separated field names, e.g. `OBJECTID,NAME,POP`. Default `*` (all fields). | | **Return geometry** | Include the Esri geometry, `_bbox` and derived lon/lat. Default on. | | **List layers only** | Discovery: enumerate a service root's layers, fetch no features. | | **Max records (total)** | Cap across all layers/pages. One billable event per feature. | | **Page size** | Server-side records per `/query` call (`resultRecordCount`). | | **ArcGIS token** | Optional `?token=` for secured services. Never logged. | | **Bearer token / Extra headers** | Optional auth for proxied deployments. Never logged. | ### Output One row per feature. Every source attribute is promoted to a top-level column; derived and provenance fields are `_`-prefixed so a source column can never collide with them: ```json { "OBJECTID": 1, "PROPERTY_NAME_TEXT": "Capitol Oaks Senior Residences", "HUB_NAME_TEXT": "Atlanta", "PLACED_BASE_CITY_NAME_TEXT": "Atlanta", "_serviceUrl": "https://services.arcgis.com/VTyQ9soqVukalItT/arcgis/rest/services/Multifamily_Properties_Assisted/FeatureServer/0/query", "_layerId": "0", "_objectId": 1, "_geometryType": "esriGeometryPoint", "_spatialReferenceWkid": 3857, "_longitude": -84.4241, "_latitude": 33.7182, "_bbox": [-9398049.15, 3991019.62, -9398049.15, 3991019.62], "_attributeKeys": ["HUB_NAME_TEXT", "OBJECTID", "PLACED_BASE_CITY_NAME_TEXT", "PROPERTY_NAME_TEXT"], "_attributeCount": 4, "_geometry": { "x": -9398049.1585, "y": 3991019.6226 }, "_raw": { } } ```` Point geometries are reprojected to WGS84 `_longitude`/`_latitude`; polygon/polyline features get a computed `_bbox` (in the layer's native SR) and `_longitude`/`_latitude` of `null`. Catalog rows (`_mode: "layer"`) carry `_layerName`, `geometryType`, `type`, `minScale`/`maxScale` and `queryUrl` instead. ### Resilience Per-layer, like a batch harvester. ArcGIS returns **HTTP 200 with an `{"error": …}` body** on a bad query — that is detected (not mistaken for success) and the offending layer is a **skip-with-warning** while the run continues. A dead / 403 / 404 service is skipped too; if **every** target fails the run exits non-zero (91) so nothing broken ships. A reachable layer whose `where` matches nothing yields **0 rows and a clean exit** — the actor never fabricates rows. A server that ignores `resultOffset` (repeats the first record) is detected and paging stops to avoid a duplicate loop. > Many government ArcGIS hosts sit behind a WAF that blocks obvious bot User-Agents. The > actor sends a standard browser User-Agent so it works across the widest range of > public deployments. ### Pricing **Pay-per-event:** one `feature` charge per emitted row (feature, or layer in catalog mode). Aggressive subscription-tier volume discounts apply. ### Examples **US HUD Multifamily Assisted Properties** (ArcGIS Online, 23,781 point features): ```json { "serviceUrls": ["https://services.arcgis.com/VTyQ9soqVukalItT/arcgis/rest/services/Multifamily_Properties_Assisted/FeatureServer/0/query"], "where": "1=1", "maxRecords": 500 } ``` **Enumerate a service root, then extract** (City of Chicago ArcGIS Server): ```json { "serviceUrls": ["https://gisapps.chicago.gov/arcgis/rest/services/SampleWorldCities/MapServer"], "listLayersOnly": true } ``` # Actor input Schema ## `serviceUrls` (type: `array`): One or more Esri ArcGIS REST URLs. Each can be: (a) a LAYER QUERY endpoint — e.g. https://services.arcgis.com/VTyQ9soqVukalItT/arcgis/rest/services/Multifamily\_Properties\_Assisted/FeatureServer/0/query ; (b) a LAYER URL without /query — e.g. .../FeatureServer/0 ; or (c) a SERVICE ROOT — e.g. .../FeatureServer or .../MapServer — which the actor enumerates into all of its layers. Any pre-existing query string (except the reserved query controls) is preserved and re-sent. Works with both ArcGIS Online (services.arcgis.com/*) and self-hosted ArcGIS Server (…/arcgis/rest/services/*). ## `where` (type: `string`): SQL-style WHERE filter applied to every layer, e.g. STATE = 'CA' or POP > 100000 or a date literal. Default 1=1 (all rows). The exact SQL dialect follows the target ArcGIS server. A valid clause that matches nothing returns 0 records and a clean exit. ## `outFields` (type: `string`): Comma-separated list of attribute field names to return, e.g. OBJECTID,NAME,POP. Default \* (all fields). Each returned field becomes its own column in the output row. Tip: run with "List layers only" first, or query one layer with \* to discover the exact field names a layer exposes. ## `returnGeometry` (type: `boolean`): When on (default), each feature's Esri geometry is fetched and stored in \_geometry (plus a computed \_bbox, and \_longitude/\_latitude for point layers, reprojected from Web Mercator when needed). Turn OFF to fetch attributes only — faster, smaller, cheaper for non-spatial use. ## `listLayersOnly` (type: `boolean`): When on, and a SERVICE ROOT (…/FeatureServer or …/MapServer) is given, the actor only reads the service descriptor and returns one row per layer (id, name, geometry type, min/max scale, capabilities, query URL) — it does NOT fetch any features. Use this to map what a service exposes, then point at a specific layer's /query. Ignored for URLs that already reference a specific layer. ## `maxRecords` (type: `integer`): Maximum total number of features to pull across ALL layers and pages (the actor auto-paginates via resultOffset + resultRecordCount, honoring the layer's maxRecordCount and exceededTransferLimit, until this cap or the result set is exhausted). Each returned feature is one billable event. Default 1000. ## `pageSize` (type: `integer`): Server-side records requested per /query call (resultRecordCount). The actor auto-follows pages regardless. Most ArcGIS layers cap this at their maxRecordCount (commonly 1000–2000); asking for more just returns the layer's max. Leave at the default unless you have a reason to change it. ## `arcgisToken` (type: `string`): Optional ArcGIS access token for secured (token-gated) services — sent as the standard ?token= query parameter on every request. NOT required for public open-data services (the vast majority). Never logged. ## `bearerToken` (type: `string`): Optional OAuth2 bearer token for deployments fronted by an auth proxy — sent as Authorization: Bearer \*\*\*. Distinct from the ArcGIS token above. Not required for public services — leave empty. Never logged. ## `extraHeaders` (type: `object`): Optional extra HTTP headers to send with every request, as a JSON object, e.g. {"x-api-key": "..."} for a service that takes an API key in a header. Leave empty for public services. ## Actor input object example ```json { "serviceUrls": [ "https://services.arcgis.com/VTyQ9soqVukalItT/arcgis/rest/services/Multifamily_Properties_Assisted/FeatureServer/0/query" ], "where": "1=1", "outFields": "*", "returnGeometry": true, "listLayersOnly": false, "maxRecords": 1000, "pageSize": 1000 } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "serviceUrls": [ "https://services.arcgis.com/VTyQ9soqVukalItT/arcgis/rest/services/Multifamily_Properties_Assisted/FeatureServer/0/query" ], "where": "1=1", "outFields": "*", "maxRecords": 1000, "pageSize": 1000 }; // Run the Actor and wait for it to finish const run = await client.actor("datamule/arcgis-featureserver-extractor").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "serviceUrls": ["https://services.arcgis.com/VTyQ9soqVukalItT/arcgis/rest/services/Multifamily_Properties_Assisted/FeatureServer/0/query"], "where": "1=1", "outFields": "*", "maxRecords": 1000, "pageSize": 1000, } # Run the Actor and wait for it to finish run = client.actor("datamule/arcgis-featureserver-extractor").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "serviceUrls": [ "https://services.arcgis.com/VTyQ9soqVukalItT/arcgis/rest/services/Multifamily_Properties_Assisted/FeatureServer/0/query" ], "where": "1=1", "outFields": "*", "maxRecords": 1000, "pageSize": 1000 }' | apify call datamule/arcgis-featureserver-extractor --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=datamule/arcgis-featureserver-extractor", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "ArcGIS FeatureServer Extractor", "description": "Point at ANY Esri ArcGIS REST layer (FeatureServer/MapServer) behind US cities, counties, DOTs, HUD & USGS. Pages a layer's /query via resultOffset honoring exceededTransferLimit, or enumerates a service root. Flat rows: every attribute as a column + geometry + lon/lat + raw. Pay per feature.", "version": "0.1", "x-build-id": "ocmZgnLda1VZEYxNd" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/datamule~arcgis-featureserver-extractor/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-datamule-arcgis-featureserver-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/datamule~arcgis-featureserver-extractor/runs": { "post": { "operationId": "runs-sync-datamule-arcgis-featureserver-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/datamule~arcgis-featureserver-extractor/run-sync": { "post": { "operationId": "run-sync-datamule-arcgis-featureserver-extractor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "serviceUrls" ], "properties": { "serviceUrls": { "title": "ArcGIS REST URL(s)", "type": "array", "description": "One or more Esri ArcGIS REST URLs. Each can be: (a) a LAYER QUERY endpoint — e.g. https://services.arcgis.com/VTyQ9soqVukalItT/arcgis/rest/services/Multifamily_Properties_Assisted/FeatureServer/0/query ; (b) a LAYER URL without /query — e.g. .../FeatureServer/0 ; or (c) a SERVICE ROOT — e.g. .../FeatureServer or .../MapServer — which the actor enumerates into all of its layers. Any pre-existing query string (except the reserved query controls) is preserved and re-sent. Works with both ArcGIS Online (services.arcgis.com/*) and self-hosted ArcGIS Server (…/arcgis/rest/services/*).", "items": { "type": "string" } }, "where": { "title": "WHERE clause", "type": "string", "description": "SQL-style WHERE filter applied to every layer, e.g. STATE = 'CA' or POP > 100000 or a date literal. Default 1=1 (all rows). The exact SQL dialect follows the target ArcGIS server. A valid clause that matches nothing returns 0 records and a clean exit.", "default": "1=1" }, "outFields": { "title": "Output fields", "type": "string", "description": "Comma-separated list of attribute field names to return, e.g. OBJECTID,NAME,POP. Default * (all fields). Each returned field becomes its own column in the output row. Tip: run with \"List layers only\" first, or query one layer with * to discover the exact field names a layer exposes.", "default": "*" }, "returnGeometry": { "title": "Return geometry", "type": "boolean", "description": "When on (default), each feature's Esri geometry is fetched and stored in _geometry (plus a computed _bbox, and _longitude/_latitude for point layers, reprojected from Web Mercator when needed). Turn OFF to fetch attributes only — faster, smaller, cheaper for non-spatial use.", "default": true }, "listLayersOnly": { "title": "List layers only (discovery)", "type": "boolean", "description": "When on, and a SERVICE ROOT (…/FeatureServer or …/MapServer) is given, the actor only reads the service descriptor and returns one row per layer (id, name, geometry type, min/max scale, capabilities, query URL) — it does NOT fetch any features. Use this to map what a service exposes, then point at a specific layer's /query. Ignored for URLs that already reference a specific layer.", "default": false }, "maxRecords": { "title": "Max records (total)", "minimum": 1, "type": "integer", "description": "Maximum total number of features to pull across ALL layers and pages (the actor auto-paginates via resultOffset + resultRecordCount, honoring the layer's maxRecordCount and exceededTransferLimit, until this cap or the result set is exhausted). Each returned feature is one billable event. Default 1000.", "default": 1000 }, "pageSize": { "title": "Page size", "minimum": 1, "type": "integer", "description": "Server-side records requested per /query call (resultRecordCount). The actor auto-follows pages regardless. Most ArcGIS layers cap this at their maxRecordCount (commonly 1000–2000); asking for more just returns the layer's max. Leave at the default unless you have a reason to change it.", "default": 1000 }, "arcgisToken": { "title": "ArcGIS token (optional)", "type": "string", "description": "Optional ArcGIS access token for secured (token-gated) services — sent as the standard ?token= query parameter on every request. NOT required for public open-data services (the vast majority). Never logged." }, "bearerToken": { "title": "Bearer token (optional)", "type": "string", "description": "Optional OAuth2 bearer token for deployments fronted by an auth proxy — sent as Authorization: Bearer ***. Distinct from the ArcGIS token above. Not required for public services — leave empty. Never logged." }, "extraHeaders": { "title": "Extra request headers", "type": "object", "description": "Optional extra HTTP headers to send with every request, as a JSON object, e.g. {\"x-api-key\": \"...\"} for a service that takes an API key in a header. Leave empty for public services." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```