US Financial Data Search

Apify Actor that queries the SIP Public Data Gateway over HTTPS — no browser, no web scraping. You provide search terms; the Actor calls 24 official US financial data products in parallel and returns normalized rows enriched with source metadata.

What it does

• Search across 24 US financial data products from agencies including FDIC, SEC, US Treasury, CFTC, FINRA, CFPB, FEMA, CoinGecko, and New York State.
• All queries run in parallel using asyncio.gather, so even searching 24 sources takes roughly the same time as one.
• Toggle product categories (Banking, Markets, Treasury, Consumer Protection, NY State) to narrow the result set.
• Results are enriched with _product_id, _source, _search_term, and _collected_at for downstream processing and deduplication.
• Pure HTTP client using httpx — no Playwright, no Puppeteer, no browser overhead.

Data sources

Category	Sources	SIP Product IDs
Banking	FDIC Institutions	us_finance_fdic_institutions
	FDIC Branch Locations	us_finance_fdic_locations
	FDIC Financial Reports	us_finance_fdic_financials
	FDIC Bank Failures	us_finance_fdic_failures
	FINRA BrokerCheck	us_finance_finra_brokercheck
Markets	SEC Filings Search	us_finance_sec_filings_search
	CFTC Commitments of Traders	us_finance_cftc_cot_report
	CFTC Disaggregated CoT	us_finance_cftc_disaggregated
	CFTC Financial Futures	us_finance_cftc_financial_futures
	CFTC Futures & Options	us_finance_cftc_futures_options
	CoinGecko Crypto Markets	us_finance_coingecko_markets
Treasury	Treasury Debt	us_finance_treasury_debt
	Treasury Exchange Rates	us_finance_treasury_exchange_rates
	Treasury Fiscal Reports	us_finance_treasury_fiscal_report
	Treasury Interest Rates	us_finance_treasury_interest_rates
Consumer Protection	CFPB Consumer Complaints	us_finance_cfpb_complaints
	FEMA Disaster Declarations	us_finance_fema_disasters
	FEMA Housing Assistance	us_finance_fema_housing_assistance
	FEMA NFIP Flood Claims	us_finance_fema_nfip_claims
NY State	NY ATM Locations	us_finance_ny_atm_locations
	NY Economic Incentives	us_finance_ny_economic_incentives
	NY IDA Projects	us_finance_ny_ida_projects
	NY Insurance Premiums	us_finance_ny_insurance_premiums
	NY SONYMA Loans	us_finance_ny_sonyma_loans

Use cases

Due diligence on financial institutions

Search a bank or broker name across FDIC institution data, FINRA BrokerCheck, SEC filings, and CFPB complaint records simultaneously. Get a complete picture of a firm's regulatory standing, complaint history, and financial health in a single Actor run.

Risk analysis and monitoring

Track exposure to counterparties by searching their names across CFTC futures position data, Treasury instruments, and FDIC financial reports. Useful for portfolio risk teams monitoring large positions or concentration risk.

Market research

Search a commodity, cryptocurrency, or financial instrument across CFTC CoT reports and CoinGecko market data. Cross-reference with SEC filings to understand institutional ownership and public disclosure.

Compliance screening

Search individuals or entities across FINRA BrokerCheck, CFPB complaints, and SEC filings for AML/KYC workflows. Combine with FEMA disaster data to assess geographic risk for insurance or credit portfolios.

Input

Field	Type	Default	Description
searchTerms	string[]	required	Names or keywords to search, e.g. ["Goldman Sachs", "JPMorgan"]. Each term queries all enabled sources in parallel.
includeBanking	boolean	true	FDIC institutions, locations, financials, failures + FINRA BrokerCheck (5 products).
includeMarkets	boolean	true	SEC filings, 4 CFTC CoT reports, CoinGecko crypto markets (6 products).
includeTreasury	boolean	true	Treasury debt, exchange rates, fiscal reports, interest rates (4 products).
includeConsumerProtection	boolean	false	CFPB consumer complaints + 3 FEMA datasets (4 products).
includeNYState	boolean	false	NY ATMs, economic incentives, IDA projects, insurance premiums, SONYMA loans (5 products).
maxResultsPerSource	integer	50	Max records per SIP search call. Gateway caps at 200.

Example input

{
  "searchTerms": ["Goldman Sachs", "Morgan Stanley"],
  "includeBanking": true,
  "includeMarkets": true,
  "includeTreasury": true,
  "includeConsumerProtection": false,
  "includeNYState": false,
  "maxResultsPerSource": 100
}

Output

Each dataset item is a record from a SIP financial product, enriched with Actor metadata fields.

Metadata fields (always present)

Field	Description
_product_id	SIP product identifier (e.g. us_finance_fdic_institutions)
_source	Human-readable source label (e.g. fdic_institutions, sec_filings)
_search_term	The search query that produced this row
_collected_at	ISO 8601 timestamp (UTC) when the row was fetched

Example record (FDIC institution)

{
  "name": "GOLDMAN SACHS BANK USA",
  "cert": "33124",
  "city": "NEW YORK",
  "stname": "New York",
  "asset": 370000000,
  "repdte": "20231231",
  "active": 1,
  "_product_id": "us_finance_fdic_institutions",
  "_source": "fdic_institutions",
  "_search_term": "Goldman Sachs",
  "_collected_at": "2026-04-08T09:00:00Z"
}

Example record (SEC filing)

{
  "company_name": "GOLDMAN SACHS GROUP INC",
  "cik": "0000886982",
  "form_type": "10-K",
  "filed_at": "2024-02-26",
  "period_of_report": "20231231",
  "_product_id": "us_finance_sec_filings_search",
  "_source": "sec_filings",
  "_search_term": "Goldman Sachs",
  "_collected_at": "2026-04-08T09:00:00Z"
}

Example record (CFPB complaint)

{
  "complaint_id": "5123456",
  "product": "Checking or savings account",
  "issue": "Problem with a lender or other company charging your account",
  "company": "GOLDMAN SACHS BANK USA",
  "state": "NY",
  "date_received": "2023-11-15",
  "_product_id": "us_finance_cfpb_complaints",
  "_source": "cfpb_complaints",
  "_search_term": "Goldman Sachs",
  "_collected_at": "2026-04-08T09:00:00Z"
}

Configuration

Set the SIP gateway key as an Apify Actor environment variable (mark as secret):

Variable	Required	Description
SIP_API_KEY	Yes	SIP X-API-Key value. Mark as secret in Apify console.
SIP_API_BASE	No	Override gateway root. Default: https://sip.myskillstore.dev/api/v1/data.

For local testing only, you may pass sipApiKey in the Actor input JSON. On Apify, always use environment variables — keys stored in run input are visible in the run log.

Pricing reference

Approximate positioning: small per-run base fee plus per-result pricing at roughly ~$3 per 1,000 results across all sources. Configure exact USD amounts in the Apify Actor Pricing tab; this README does not lock prices.

With default settings (15 products × 50 results × 1 search term), a typical run returns up to 750 rows.

Local development

cd "/Users/kane/Projects/Apify Actors/sip-us-finance-search"
python3.13 -m venv .venv
.venv/bin/pip install -r requirements.txt
export SIP_API_KEY="your-key"
mkdir -p storage/key_value_stores/default
echo '{"searchTerms":["Goldman Sachs"],"includeBanking":true,"includeMarkets":true,"includeTreasury":true,"maxResultsPerSource":5}' \
  > storage/key_value_stores/default/INPUT.json
apify run

Or run directly:

$SIP_API_KEY=your-key python -m src

(With INPUT.json under storage/key_value_stores/default/ for Apify CLI conventions.)

Deploy to Apify

apify login
apify push

Use APIFY_TOKEN or CLI login. Never commit tokens or API keys to version control.

After pushing, set SIP_API_KEY under Actor → Settings → Environment Variables in the Apify console and mark it as secret.

Legal disclaimer

This Actor is an API client to the SIP Public Data Gateway. It is unofficial and not affiliated with, endorsed by, or sponsored by any US government agency, including the FDIC, SEC, US Treasury, CFTC, FINRA, CFPB, FEMA, or the State of New York.

You are responsible for:

• Complying with SIP terms of use
• Complying with Apify terms of service
• Ensuring lawful use of downstream data under applicable data protection, financial privacy, and securities laws
• Appropriate handling of any personally identifiable information (PII) that may appear in complaint or loan records

Data is sourced from official public government datasets but accuracy and completeness depend on the upstream agencies and SIP's normalization pipeline. Do not use for trading decisions without independent verification.

Use as MCP Tool (AI Agent Integration)

This Actor works as an MCP tool — AI agents (Claude, GPT, Cursor) can discover and run it automatically.

Quick setup (Claude Desktop / Cursor / VS Code)

Add to your MCP config:

{
  "mcpServers": {
    "apify": {
      "url": "https://mcp.apify.com",
      "headers": {
        "Authorization": "Bearer YOUR_APIFY_TOKEN"
      }
    }
  }
}

Then ask your AI: "Search for Goldman Sachs in US financial databases"

Direct API call

from apify_client import ApifyClient
client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("lentic_clockss/us-finance-search").call(
    run_input={"searchTerms": ["Goldman Sachs"], "maxResultsPerSource": 50}
)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

Other Data API Actors

• EU Financial Data API
• UK Government Data API
• Australia Government Data API