# SEC Investment Adviser Public Disclosure Scraper (`automation-lab/sec-investment-adviser-public-disclosure-scraper`) Actor Extract SEC IAPD adviser firm profiles, Form ADV dates, registration statuses, addresses, disclosure flags, and profile URLs. - **URL**: https://apify.com/automation-lab/sec-investment-adviser-public-disclosure-scraper.md - **Developed by:** [Stas Persiianenko](https://apify.com/automation-lab) (community) - **Categories:** Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per event This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## SEC Investment Adviser Public Disclosure Scraper Extract SEC IAPD investment adviser firm records from the public SEC Investment Adviser Public Disclosure database. The actor searches `adviserinfo.sec.gov`, fetches public firm profile JSON, and saves normalized adviser firm records with SEC numbers, registration status, Form ADV filing dates, office addresses, disclosure flags, notice filings, and source profile URLs. ### What does SEC Investment Adviser Public Disclosure Scraper do? SEC Investment Adviser Public Disclosure Scraper turns public IAPD adviser search results into a clean Apify dataset. It can: - ๐Ÿ”Ž Search adviser firms by keyword or firm name - ๐Ÿงพ Fetch direct adviser profiles by SEC IAPD firm / CRD-style ID - ๐Ÿ›๏ธ Extract registration status and jurisdiction rows - ๐Ÿ“„ Capture Form ADV filing dates and compilation metadata - ๐Ÿ“ Normalize office address data - ๐Ÿšฉ Preserve disclosure flags and profile URLs - ๐Ÿ“ฆ Export results as JSON, CSV, Excel, XML, RSS, or via API ### Who is it for? This scraper is built for teams that work with registered investment adviser data. - Compliance analysts checking RIA status and disclosure signals - Due-diligence teams screening financial advisers and wealth managers - Wealth-tech vendors enriching adviser firm databases - KYC and vendor-risk teams validating public registration information - Market-mapping teams building lists of advisory firms by keyword or region - Data providers monitoring SEC IAPD and Form ADV metadata ### Why use it? SEC IAPD is public, but exporting repeatable, normalized search results is inconvenient. This actor gives you an automation-ready dataset instead of manual browser checks. Benefits: - Repeatable searches with the same input - Structured output with stable field names - Direct links back to source profiles - Detail enrichment from the same public JSON used by the IAPD site - Works without a login, browser session, or private credentials - Suitable for scheduled monitoring workflows ### Data source The actor uses the public SEC IAPD web application and its public JSON endpoints: - Website: `https://adviserinfo.sec.gov/` - Search endpoint family: `https://api.adviserinfo.sec.gov/search/firm` - Profile endpoint family: `https://api.adviserinfo.sec.gov/search/firm/{firmId}` The actor does not bypass authentication because no authentication is required for the public firm records it extracts. ### How much does it cost to extract SEC IAPD adviser firms? This actor uses pay-per-event pricing. You pay a small start fee for each run and a per-record fee for each adviser firm saved to the dataset. The exact price is visible on the Apify actor page before you run it. Cost depends mainly on: - Number of adviser firms requested in `maxItems` - Whether detail enrichment is enabled - How many search terms you provide - SEC response speed during the run Use a small `maxItems` value for your first run, then scale up once the output matches your workflow. ### Input overview You can provide broad searches, direct firm IDs, or both. | Field | Type | Description | | --- | --- | --- | | `searchQueries` | array | Firm-name or keyword searches such as `BlackRock`, `capital`, or `wealth management`. | | `firmName` | string | Convenience single firm-name search. | | `crdNumbers` | array | Exact SEC IAPD firm/source IDs to fetch directly. | | `secNumbers` | array | SEC adviser numbers searched as terms. | | `state` | string | Optional two-letter US state filter, e.g. `NY` or `CA`. | | `maxItems` | integer | Maximum adviser firm records to save. | | `includeDetails` | boolean | Fetch profile details for registration, ADV, and jurisdiction fields. | | `requestDelayMs` | integer | Polite delay between detail requests. | ### Example input ```json { "searchQueries": ["capital", "wealth management"], "firmName": "BlackRock", "crdNumbers": ["106614"], "state": "NY", "maxItems": 50, "includeDetails": true, "requestDelayMs": 100 } ```` ### Output overview Each dataset item represents one SEC IAPD adviser firm record. | Field | Description | | --- | --- | | `firmId` | SEC IAPD firm/source ID used in profile URLs. | | `firmName` | Registered adviser firm name. | | `otherNames` | Alternate names listed by IAPD. | | `iaScope` | IAPD investment adviser scope/status text. | | `isIAFirm` | IAPD IA firm flag. | | `secNumber` | SEC adviser number without prefix. | | `secNumberType` | SEC number prefix, for example `801` or `802`. | | `fullSecNumber` | Combined SEC adviser number. | | `advFilingDate` | Latest Form ADV filing date shown in profile data. | | `disclosureFlag` | Search-level disclosure flag when available. | | `branchesCount` | Branch count from search results when available. | | `officeAddress` | Main office address object. | | `registrationStatuses` | SEC/state registration status rows. | | `noticeFilings` | Notice filing rows by jurisdiction. | | `exemptReportingAdvisers` | ERA status rows where present. | | `orgScopeStatusFlags` | Scope flags from the profile JSON. | | `brochuresCount` | Number of Part 2 brochure detail rows. | | `compilationData` | Form ADV compilation metadata rows. | | `profileUrl` | Public SEC IAPD profile URL. | | `sourceQuery` | Search term or direct ID that produced the record. | | `scrapedAt` | ISO timestamp for the extraction. | ### Example output ```json { "firmId": 106614, "firmName": "BLACKROCK ADVISORS, LLC", "otherNames": ["BLACKROCK", "BLACKROCK ADVISORS, LLC"], "iaScope": "ACTIVE", "isIAFirm": "Y", "secNumber": "47710", "secNumberType": "801", "fullSecNumber": "801-47710", "advFilingDate": "05/15/2026", "officeAddress": { "street1": "50 HUDSON YARDS", "city": "NEW YORK", "state": "NY", "country": "United States", "postalCode": "10001" }, "profileUrl": "https://adviserinfo.sec.gov/firm/summary/106614", "sourceQuery": "BlackRock", "scrapedAt": "2026-06-27T00:00:00.000Z" } ``` ### How to scrape SEC IAPD adviser firms 1. Open the actor on Apify. 2. Enter one or more firm names or search keywords. 3. Optionally add direct IAPD firm IDs in `crdNumbers`. 4. Set `maxItems` to the number of firms you want. 5. Keep `includeDetails` enabled for compliance workflows. 6. Run the actor. 7. Download the dataset or connect it to your API pipeline. ### Search tips - Use broad business terms such as `capital`, `wealth management`, or `advisors` for larger lists. - Use exact firm names for targeted due diligence. - Use direct firm IDs when you already have known IAPD profile IDs. - Use state filters for region-specific market mapping. - Keep `requestDelayMs` at the default unless you need faster runs. ### Direct firm ID mode If you know a profile URL like: `https://adviserinfo.sec.gov/firm/summary/106614` then `106614` is the firm ID. Add it to `crdNumbers` and the actor will fetch that profile directly. This is useful when you maintain an internal list of adviser IDs and want refreshed public profile fields. ### Detail enrichment When `includeDetails` is enabled, the actor fetches the profile JSON for every saved firm. Detail enrichment adds: - Form ADV filing date - Registration status rows - Notice filings - Exempt reporting adviser status - Organization scope flags - Compilation metadata - Brochure counts when available Disable it only when you need faster search-level exports. ### Integrations Use this actor in workflows such as: - Daily RIA monitoring into Google Sheets - Compliance enrichment in Snowflake or BigQuery - CRM enrichment for adviser firm accounts - Vendor onboarding checks - KYC screening pipelines - Due-diligence research notebooks - Webhook alerts when scheduled runs finish Apify integrations can send results to Make, Zapier, Slack, Google Drive, S3, or your own API. ### API usage #### Node.js ```js import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: process.env.APIFY_TOKEN }); const run = await client.actor('automation-lab/sec-investment-adviser-public-disclosure-scraper').call({ searchQueries: ['capital'], maxItems: 25, includeDetails: true }); const { items } = await client.dataset(run.defaultDatasetId).listItems(); console.log(items); ``` #### Python ```python from apify_client import ApifyClient client = ApifyClient('YOUR_APIFY_TOKEN') run = client.actor('automation-lab/sec-investment-adviser-public-disclosure-scraper').call(run_input={ 'searchQueries': ['wealth management'], 'maxItems': 25, 'includeDetails': True, }) items = client.dataset(run['defaultDatasetId']).list_items().items print(items) ``` #### cURL ```bash curl -X POST "https://api.apify.com/v2/acts/automation-lab~sec-investment-adviser-public-disclosure-scraper/runs?token=$APIFY_TOKEN" \ -H 'Content-Type: application/json' \ -d '{"searchQueries":["capital"],"maxItems":25,"includeDetails":true}' ``` ### MCP usage You can use this actor through Apify MCP in Claude Desktop or Claude Code. MCP server URL: `https://mcp.apify.com/?tools=automation-lab/sec-investment-adviser-public-disclosure-scraper` Claude Code setup: ```bash claude mcp add apify-sec-iapd "https://mcp.apify.com/?tools=automation-lab/sec-investment-adviser-public-disclosure-scraper" ``` Claude Desktop JSON config: ```json { "mcpServers": { "apify-sec-iapd": { "url": "https://mcp.apify.com/?tools=automation-lab/sec-investment-adviser-public-disclosure-scraper" } } } ``` Example prompts: - "Run the SEC IAPD scraper for BlackRock and summarize adviser registration statuses." - "Find 25 investment adviser firms matching wealth management in CA." - "Fetch SEC IAPD profile fields for firm ID 106614." ### Data quality notes The actor returns public data exactly as exposed by SEC IAPD profile JSON. Some fields may be empty for exempt reporting advisers, foreign firms, or firms without a given section. Always use `profileUrl` for source verification when making compliance decisions. ### FAQ #### Why did I get zero results? Try a broader `searchQueries` value, remove the `state` filter, or verify that a direct firm ID exists on the public IAPD website. #### Why are some arrays empty? Not every adviser firm has notice filings, exempt reporting adviser rows, brochure rows, or all registration sections. Empty arrays mean the public profile JSON did not include rows for that section. #### Why does the run take longer with details enabled? Detail mode sends one profile request per saved firm. Increase `requestDelayMs` for politeness or disable details for quick search-level exports. ### Legality This actor extracts public information from SEC IAPD. You are responsible for using the data lawfully and respecting applicable compliance, privacy, and securities-industry rules. Do not use the actor to make decisions that require professional review without validating source records. ### Related scrapers Explore related automation-lab actors on Apify: - https://apify.com/automation-lab/sec-edgar-scraper - https://apify.com/automation-lab/sec-filings-scraper - https://apify.com/automation-lab/finra-brokercheck-scraper - https://apify.com/automation-lab/company-registry-scraper ### Changelog #### 0.1 - Initial release candidate with SEC IAPD firm search, direct firm IDs, profile detail enrichment, and normalized adviser firm output. # Actor input Schema ## `searchQueries` (type: `array`): Firm-name or keyword searches to run against SEC IAPD, for example BlackRock, Vanguard, wealth management, or capital. ## `firmName` (type: `string`): Optional single firm name or keyword. It is combined with Search queries. ## `crdNumbers` (type: `array`): Optional exact SEC IAPD firm IDs / CRD-style source IDs to fetch directly, e.g. 106614 for BlackRock Advisors LLC. ## `secNumbers` (type: `array`): Optional SEC adviser numbers to search, such as 801-47710 or 47710. ## `state` (type: `string`): Optional two-letter US state abbreviation for IAPD search filtering, for example NY or CA. ## `maxItems` (type: `integer`): Maximum number of adviser firm records to save to the dataset. ## `includeDetails` (type: `boolean`): Fetch each firm's SEC IAPD profile JSON for registration status, notice filings, Form ADV filing date, flags, and address data. ## `requestDelayMs` (type: `integer`): Politeness delay between SEC API detail requests. Increase if SEC temporarily throttles requests. ## Actor input object example ```json { "searchQueries": [ "capital" ], "firmName": "BlackRock", "state": "NY", "maxItems": 20, "includeDetails": true, "requestDelayMs": 100 } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchQueries": [ "capital" ], "firmName": "BlackRock", "state": "NY", "maxItems": 20, "includeDetails": true, "requestDelayMs": 100 }; // Run the Actor and wait for it to finish const run = await client.actor("automation-lab/sec-investment-adviser-public-disclosure-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchQueries": ["capital"], "firmName": "BlackRock", "state": "NY", "maxItems": 20, "includeDetails": True, "requestDelayMs": 100, } # Run the Actor and wait for it to finish run = client.actor("automation-lab/sec-investment-adviser-public-disclosure-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchQueries": [ "capital" ], "firmName": "BlackRock", "state": "NY", "maxItems": 20, "includeDetails": true, "requestDelayMs": 100 }' | apify call automation-lab/sec-investment-adviser-public-disclosure-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=automation-lab/sec-investment-adviser-public-disclosure-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "SEC Investment Adviser Public Disclosure Scraper", "description": "Extract SEC IAPD adviser firm profiles, Form ADV dates, registration statuses, addresses, disclosure flags, and profile URLs.", "version": "0.1", "x-build-id": "wV4TyC3tmgnc1vKWS" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/automation-lab~sec-investment-adviser-public-disclosure-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-automation-lab-sec-investment-adviser-public-disclosure-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/automation-lab~sec-investment-adviser-public-disclosure-scraper/runs": { "post": { "operationId": "runs-sync-automation-lab-sec-investment-adviser-public-disclosure-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/automation-lab~sec-investment-adviser-public-disclosure-scraper/run-sync": { "post": { "operationId": "run-sync-automation-lab-sec-investment-adviser-public-disclosure-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "searchQueries": { "title": "Search queries", "type": "array", "description": "Firm-name or keyword searches to run against SEC IAPD, for example BlackRock, Vanguard, wealth management, or capital.", "items": { "type": "string" } }, "firmName": { "title": "Single firm name", "type": "string", "description": "Optional single firm name or keyword. It is combined with Search queries." }, "crdNumbers": { "title": "CRD / SEC IAPD firm IDs", "type": "array", "description": "Optional exact SEC IAPD firm IDs / CRD-style source IDs to fetch directly, e.g. 106614 for BlackRock Advisors LLC.", "items": { "type": "string" } }, "secNumbers": { "title": "SEC numbers", "type": "array", "description": "Optional SEC adviser numbers to search, such as 801-47710 or 47710.", "items": { "type": "string" } }, "state": { "title": "US state filter", "type": "string", "description": "Optional two-letter US state abbreviation for IAPD search filtering, for example NY or CA." }, "maxItems": { "title": "Maximum adviser firms", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of adviser firm records to save to the dataset.", "default": 20 }, "includeDetails": { "title": "Fetch detailed profile data", "type": "boolean", "description": "Fetch each firm's SEC IAPD profile JSON for registration status, notice filings, Form ADV filing date, flags, and address data.", "default": true }, "requestDelayMs": { "title": "Delay between detail requests (ms)", "minimum": 0, "maximum": 5000, "type": "integer", "description": "Politeness delay between SEC API detail requests. Increase if SEC temporarily throttles requests.", "default": 100 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```