# Annuity Product Scraper (`constant_quadruped/annuity-product-scraper`) Actor Scrapes annuity product data from major insurance carriers including fees, riders, surrender schedules, index options, and CUSIP identifiers. Supports RILA, fixed indexed, variable, MYGA, and other annuity types via Playwright and SEC EDGAR. - **URL**: https://apify.com/constant\_quadruped/annuity-product-scraper.md - **Developed by:** [CQ](https://apify.com/constant_quadruped) (community) - **Categories:** Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Annuity Product Data Scraper Extract annuity product details including riders, surrender schedules, and base contract fees from major insurance carriers. ### Features - **Comprehensive Carrier Coverage**: Supports 20 major annuity carriers including Allianz, Athene, Jackson, Lincoln, Nationwide, Pacific Life, Prudential, and more - **Product Types**: Fixed, Fixed Indexed (FIA), Variable (VA), RILA, MYGA, SPIA, DIA - **SEC EDGAR Integration**: Variable annuity data extracted from official 485BPOS prospectus filings - **Rider Extraction**: GLWB, GMIB, GMAB, Death Benefits, LTC Waivers with fee details - **Surrender Schedules**: Year-by-year surrender charge extraction - **Fee Analysis**: M&E charges, admin fees, rider costs, and total cost calculations - **Index Options**: S&P 500, Russell 2000, NASDAQ-100, MSCI EAFE, and more - **State Availability**: Check product availability by state ### Supported Carriers | Carrier | Product Types | Status | |---------|---------------|--------| | Allianz | FIA, VA | Active | | American Equity | FIA, MYGA | Active | | Athene | FIA, MYGA, VA | Active | | Brighthouse | VA, FIA | Active | | Equitable | VA, RILA | Active | | Fidelity & Guaranty | FIA | Active | | Global Atlantic | FIA | Active | | Great American | FIA | Active | | Jackson | VA, RILA | Active | | John Hancock | VA | Active | | Lincoln | VA, FIA | Active | | MassMutual | FIA | Active | | Nationwide | VA, FIA | Active | | North American | FIA | Active | | Pacific Life | VA, FIA | Active | | Protective | VA | Active | | Prudential | VA | Active | | Security Benefit | FIA, VA | Active | | Symetra | FIA | Active | | Transamerica | VA, FIA | Active | ### Input Parameters | Parameter | Type | Required | Description | |-----------|------|----------|-------------| | searchType | enum | Yes | Search method: `carrier`, `productName`, `productType`, `cusip`, `all` | | carriers | array | No | Carrier codes to search (e.g., `["JACKSON", "LINCOLN"]`). Leave empty for all carriers | | productName | string | No | Product name to search (partial match supported) | | productTypes | array | No | Product types to filter: `FIXED`, `FIXED_INDEXED`, `VARIABLE`, `RILA`, `MYGA`, `SPIA`, `DIA` (default: `["FIXED_INDEXED", "VARIABLE", "RILA"]`) | | cusip | string | No | Product CUSIP identifier | | includeRiders | boolean | No | Include rider information (default: true) | | includeSurrenderSchedule | boolean | No | Include surrender schedule (default: true) | | includeBaseFees | boolean | No | Include base contract fees (default: true) | | includeIndexOptions | boolean | No | Include index crediting options (default: true) | | includeSubaccounts | boolean | No | Include subaccount listings for VAs (default: false) | | stateAvailability | string | No | Check product availability in specific state (2-letter code) | | maxResults | integer | No | Maximum products to retrieve (default: 50, max: 500) | | proxyConfiguration | object | No | Proxy settings for requests | ### Output Format Each product is pushed as a separate dataset item. Example item: ```json { "carrier": "JACKSON", "carrierName": "Jackson National", "productName": "Perspective II", "productType": "VARIABLE", "cusip": "46647M102", "dataSource": "SEC_EDGAR", "dataSourceVerified": true, "secFiling": { "accessionNumber": "0001193125-25-123456", "filingDate": "2025-12-15", "documentUrl": "https://www.sec.gov/Archives/...", "formType": "485BPOS" }, "fees": { "annualContractFee": 30, "adminFee": 0.20, "meRiskFee": 1.30, "totalAnnualFees": 1.53 }, "surrenderSchedule": [ { "year": 1, "chargePercent": 8 }, { "year": 2, "chargePercent": 8 } ], "surrenderYears": 7, "riders": [ { "name": "LifeGuard Freedom Flex", "type": "GLWB", "annualFee": 1.15, "feeType": "percent_of_benefit_base", "description": "Guaranteed Lifetime Withdrawal Benefit - provides guaranteed income for life" } ], "indexOptions": [], "subaccountCount": 85, "dataQuality": { "hasRiders": true, "hasSurrenderSchedule": true, "hasBaseFees": true, "hasIndexOptions": false, "completenessScore": "100%" }, "scrapedAt": "2026-01-02T12:00:00.000Z" } ```` ### Example Use Cases #### 1. Find All GLWB Riders for FIA Products ```json { "searchType": "productType", "productTypes": ["FIXED_INDEXED"], "includeRiders": true, "includeBaseFees": true } ``` #### 2. Compare Jackson Products ```json { "searchType": "carrier", "carriers": ["JACKSON"], "includeRiders": true, "includeSurrenderSchedule": true, "includeBaseFees": true } ``` #### 3. Search by Product Name ```json { "searchType": "productName", "productName": "Perspective", "includeRiders": true } ``` #### 4. Get All RILA Products ```json { "searchType": "productType", "productTypes": ["RILA"], "includeIndexOptions": true, "includeBaseFees": true } ``` ### Data Sources 1. **SEC EDGAR (Variable Annuities)**: 485BPOS prospectus filings from the SEC containing legally-required fee disclosures, surrender schedules, and rider information 2. **Static Product Database (RILA/FIA/MYGA)**: Curated product data for non-variable annuity types that do not file SEC 485BPOS forms ### Rider Types Explained | Type | Description | Typical Fee Range | |------|-------------|-------------------| | GLWB | Guaranteed Lifetime Withdrawal Benefit - Income for life | 0.75% - 1.50% | | GMIB | Guaranteed Minimum Income Benefit - Annuitization guarantee | 0.50% - 1.00% | | GMAB | Guaranteed Minimum Accumulation Benefit - Principal protection | 0.25% - 0.75% | | DEATH\_BENEFIT | Enhanced death benefit options | 0.10% - 0.50% | | LTC\_WAIVER | Nursing home/long-term care surrender waiver | Often free | | BONUS | Premium bonus credits | N/A (built into product) | ### Fee Categories | Category | Description | Typical Range | |----------|-------------|---------------| | M\&E Risk | Mortality & Expense charge | 0.50% - 1.50% | | Admin Fee | Administrative fee | 0.10% - 0.35% | | Annual Fee | Flat contract fee | $0 - $50 | | Fund Expense | Subaccount costs (VA only) | 0.50% - 2.00% | | Spread | Index strategy spread (FIA/RILA) | 0% - 2.00% | ### Limitations - Variable annuity data depends on SEC EDGAR filing availability and HTML parsing accuracy - RILA/FIA product data is from a static database and may not reflect the most recent product changes - Subaccount listings may be incomplete for older products - State availability information may require verification with carrier ### Support For questions or issues, please open an issue in the repository or contact the actor maintainer. ### License MIT License # Actor input Schema ## `searchType` (type: `string`): How to search for annuity products ## `carriers` (type: `array`): Select carriers to search (leave empty for all) ## `productName` (type: `string`): Search by product name (partial match supported) ## `productTypes` (type: `array`): Filter by annuity type ## `cusip` (type: `string`): Search by specific CUSIP identifier ## `includeRiders` (type: `boolean`): Extract available rider options (GLWB, GMIB, death benefits, etc.) ## `includeSurrenderSchedule` (type: `boolean`): Extract surrender charge schedule by year ## `includeBaseFees` (type: `boolean`): Extract M\&E, admin fees, fund expenses ## `includeIndexOptions` (type: `boolean`): Extract available index crediting strategies (for FIA/RILA) ## `includeSubaccounts` (type: `boolean`): Extract available subaccount/fund options (for VA) ## `stateAvailability` (type: `string`): Check product availability in specific state (2-letter code) ## `maxResults` (type: `integer`): Maximum products to retrieve ## `proxyConfiguration` (type: `object`): Proxy settings for requests ## Actor input object example ```json { "searchType": "carrier", "carriers": [], "productTypes": [ "FIXED_INDEXED", "VARIABLE", "RILA" ], "includeRiders": true, "includeSurrenderSchedule": true, "includeBaseFees": true, "includeIndexOptions": true, "includeSubaccounts": false, "maxResults": 50 } ``` # Actor output Schema ## `datasetUrl` (type: `string`): Link to the full dataset with all extracted annuity products ## `productCount` (type: `string`): Number of annuity products extracted with carrier, product type, fees, riders, and surrender schedules # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("constant_quadruped/annuity-product-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("constant_quadruped/annuity-product-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call constant_quadruped/annuity-product-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=constant_quadruped/annuity-product-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Annuity Product Scraper", "description": "Scrapes annuity product data from major insurance carriers including fees, riders, surrender schedules, index options, and CUSIP identifiers. Supports RILA, fixed indexed, variable, MYGA, and other annuity types via Playwright and SEC EDGAR.", "version": "1.0", "x-build-id": "Z1QHqjdlHKUlzj91T" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/constant_quadruped~annuity-product-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-constant_quadruped-annuity-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/constant_quadruped~annuity-product-scraper/runs": { "post": { "operationId": "runs-sync-constant_quadruped-annuity-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/constant_quadruped~annuity-product-scraper/run-sync": { "post": { "operationId": "run-sync-constant_quadruped-annuity-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "searchType" ], "properties": { "searchType": { "title": "Search Type", "enum": [ "carrier", "productName", "productType", "cusip", "all" ], "type": "string", "description": "How to search for annuity products", "default": "carrier" }, "carriers": { "title": "Insurance Carriers", "type": "array", "description": "Select carriers to search (leave empty for all)", "items": { "type": "string", "enum": [ "ALLIANZ", "AMERICAN_EQUITY", "ATHENE", "BRIGHTHOUSE", "EQUITABLE", "FIDELITY_GUARANTY", "GLOBAL_ATLANTIC", "GREAT_AMERICAN", "JACKSON", "JOHN_HANCOCK", "LINCOLN", "MASS_MUTUAL", "NATIONWIDE", "NORTH_AMERICAN", "PACIFIC_LIFE", "PRUDENTIAL", "PROTECTIVE", "SECURITY_BENEFIT", "SYMETRA", "TRANSAMERICA" ] }, "default": [] }, "productName": { "title": "Product Name", "type": "string", "description": "Search by product name (partial match supported)" }, "productTypes": { "title": "Product Types", "type": "array", "description": "Filter by annuity type", "items": { "type": "string", "enum": [ "FIXED", "FIXED_INDEXED", "VARIABLE", "RILA", "MYGA", "SPIA", "DIA" ] }, "default": [ "FIXED_INDEXED", "VARIABLE", "RILA" ] }, "cusip": { "title": "CUSIP", "type": "string", "description": "Search by specific CUSIP identifier" }, "includeRiders": { "title": "Include Riders", "type": "boolean", "description": "Extract available rider options (GLWB, GMIB, death benefits, etc.)", "default": true }, "includeSurrenderSchedule": { "title": "Include Surrender Schedule", "type": "boolean", "description": "Extract surrender charge schedule by year", "default": true }, "includeBaseFees": { "title": "Include Base Contract Fees", "type": "boolean", "description": "Extract M&E, admin fees, fund expenses", "default": true }, "includeIndexOptions": { "title": "Include Index Options", "type": "boolean", "description": "Extract available index crediting strategies (for FIA/RILA)", "default": true }, "includeSubaccounts": { "title": "Include Subaccounts", "type": "boolean", "description": "Extract available subaccount/fund options (for VA)", "default": false }, "stateAvailability": { "title": "State Availability", "type": "string", "description": "Check product availability in specific state (2-letter code)" }, "maxResults": { "title": "Max Results", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum products to retrieve", "default": 50 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Proxy settings for requests" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```