# Nonprofit Financial Data Scraper (ProPublica) (`crawlerbros/lawyers-nonprofit-financial-scraper`) Actor Scrape nonprofit organizations and their IRS financial filings from ProPublica's Nonprofit Explorer - revenue, expenses, assets, liabilities, tax returns, and executive compensation. - **URL**: https://apify.com/crawlerbros/lawyers-nonprofit-financial-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Automation, Lead generation, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Nonprofit Financial Data Scraper (ProPublica) Extract nonprofit organization profiles and IRS financial filings from [ProPublica's Nonprofit Explorer](https://projects.propublica.org/nonprofits/) — the most comprehensive free database of US nonprofit financial records. No API key or proxy required. ### What data can you extract? - Organization name, EIN, address, city, state, ZIP - NTEE category code and major group label (Arts, Education, Health, Legal, etc.) - Revenue, asset amounts, tax filing period - IRS subsection code, ruling date, deductibility code - Direct link to ProPublica profile page - Optional: full IRS 990 filing data — total revenue, expenses, assets, liabilities, net assets, officer compensation percentage ### Use cases - Nonprofit research and due diligence - Grant prospecting — find organizations in a specific sector or geography - Competitive analysis of nonprofits by NTEE category - Financial benchmarking across peer organizations - Legal and compliance research - Academic research on nonprofit sector finances ### Modes #### `searchOrganizations` (default) Search nonprofits by keyword with optional state and NTEE category filters. **Input:** ```json { "mode": "searchOrganizations", "query": "food bank", "state": "CA", "nteeGroup": "K", "maxItems": 50 } ```` #### `organizationDetails` Fetch full financial details for specific organizations by EIN (Employer Identification Number). Optionally include annual IRS 990 filing data. **Input:** ```json { "mode": "organizationDetails", "eins": ["13-1837418", "52-1234567"], "includeFilings": true, "maxItems": 20 } ``` #### `browseByNtee` Browse nonprofits by NTEE major group category (A=Arts, B=Education, E=Health, I=Legal, etc.). **Input:** ```json { "mode": "browseByNtee", "nteeGroup": "I", "state": "NY", "query": "legal aid", "maxItems": 100 } ``` ### Input parameters | Parameter | Type | Description | |---|---|---| | `mode` | string | One of `searchOrganizations`, `organizationDetails`, `browseByNtee` | | `query` | string | Keyword to search (organization name or topic) | | `state` | string | US state abbreviation filter (e.g., CA, NY, TX) | | `nteeGroup` | string | NTEE major group letter (A–Z) | | `eins` | array | List of EIN numbers for `organizationDetails` mode | | `includeFilings` | boolean | Include IRS 990 filing data (for `organizationDetails`) | | `maxItems` | integer | Maximum results to return (1–500, default 20) | ### NTEE major group codes | Code | Category | |---|---| | A | Arts, Culture & Humanities | | B | Education | | C | Environment | | D | Animal-Related | | E | Health Care | | F | Mental Health | | G | Disease Research | | H | Medical Research | | I | Crime & Legal | | J | Employment | | K | Food/Agriculture | | L | Housing | | M | Public Safety | | N | Recreation & Sports | | O | Youth Development | | P | Human Services | | Q | International | | R | Civil Rights | | S | Community Improvement | | T | Philanthropy | | U | Science & Technology | | V | Social Sciences | | W | Public Affairs | | X | Religion | | Y | Mutual Benefit | | Z | Unknown | ### Sample output ```json { "recordType": "nonprofitFinancial", "ein": "131837418", "strein": "13-1837418", "name": "Legal Aid Society", "city": "New York", "state": "NY", "zipCode": "10007", "nteeCode": "I71", "nteeGroup": "Crime & Legal", "revenueAmount": 150000000, "assetAmount": 80000000, "subsectionCode": "3", "taxPeriod": "202212", "rulingDate": "194908", "deductibilityCode": "1", "profileUrl": "https://projects.propublica.org/nonprofits/organizations/131837418", "sourceUrl": "https://projects.propublica.org/nonprofits/organizations/131837418", "scrapedAt": "2024-01-15T10:30:00+00:00" } ``` #### With `includeFilings: true` ```json { "ein": "521234567", "name": "Example Foundation", "latestFiling": { "taxYear": 2022, "pdfUrl": "https://pp-990.s3.amazonaws.com/2022/...", "totalRevenue": 5400000000, "totalExpenses": 3200000000, "totalAssets": 53000000000, "totalLiabilities": 2100000000, "netAssets": 50900000000, "officerCompensationPct": 0.08 } } ``` ### Output fields reference | Field | Type | Description | |---|---|---| | `ein` | string | Employer Identification Number (9 digits) | | `strein` | string | Formatted EIN with hyphen (XX-XXXXXXX) | | `name` | string | Organization name | | `subName` | string | Sub-name or care-of name | | `city` | string | City | | `state` | string | US state abbreviation | | `zipCode` | string | ZIP code | | `address` | string | Street address | | `nteeCode` | string | NTEE classification code (e.g., I71) | | `nteeGroup` | string | NTEE major group label (e.g., Crime & Legal) | | `revenueAmount` | integer | Annual revenue in USD | | `assetAmount` | integer | Total assets in USD | | `subsectionCode` | string | IRS subsection code (3 = 501(c)(3)) | | `taxPeriod` | string | Tax period in YYYYMM format | | `rulingDate` | string | IRS ruling date in YYYYMM format | | `deductibilityCode` | string | Deductibility code | | `profileUrl` | string | ProPublica Nonprofit Explorer URL | | `sourceUrl` | string | Source URL | | `latestFiling.taxYear` | integer | Tax year of most recent 990 filing | | `latestFiling.pdfUrl` | string | PDF download URL for 990 form | | `latestFiling.totalRevenue` | number | Total revenue from 990 | | `latestFiling.totalExpenses` | number | Total functional expenses from 990 | | `latestFiling.totalAssets` | number | Total assets at end of year | | `latestFiling.totalLiabilities` | number | Total liabilities at end of year | | `latestFiling.netAssets` | number | Net assets (fund balance) | | `latestFiling.officerCompensationPct` | number | Officer compensation as % of expenses | ### Data source Data is sourced from [ProPublica's Nonprofit Explorer API](https://projects.propublica.org/nonprofits/api) — a free, public API containing data on more than 1.8 million nonprofits compiled from IRS 990 filings. No API key, proxy, or login is required. ### Frequently asked questions **How many nonprofits are in the database?** ProPublica's Nonprofit Explorer contains over 1.8 million US nonprofit organizations with IRS 990 filing data going back many years. **How current is the data?** ProPublica updates its database as new IRS filings become available, typically reflecting filings up to 1–2 years prior to the current date. **Can I filter by both state and NTEE category?** Yes. All three modes support simultaneous state + NTEE filtering. **What is an EIN?** An Employer Identification Number (EIN) is a 9-digit tax ID assigned by the IRS to identify nonprofit organizations. Format: XX-XXXXXXX. **What does NTEE stand for?** National Taxonomy of Exempt Entities — a classification system used by the IRS and other organizations to categorize nonprofits by their primary activity (Arts, Education, Health, etc.). **Are the 990 PDF files accessible?** Yes — when `includeFilings` is enabled, the `latestFiling.pdfUrl` field contains a direct link to the IRS Form 990 PDF hosted on ProPublica's AWS S3. **What is the rate limit?** ProPublica's API is publicly accessible with no authentication. The scraper uses a 0.3–0.5 second delay between requests to be a good API citizen. # Actor input Schema ## `mode` (type: `string`): What to fetch from ProPublica Nonprofit Explorer. ## `query` (type: `string`): Keyword to search for (organization name or keyword). ## `state` (type: `string`): Filter by US state abbreviation (e.g., CA, NY, TX). ## `nteeGroup` (type: `string`): NTEE major group letter (A=Arts, B=Education, C=Environment, E=Health, I=Crime/Legal, etc.). ## `eins` (type: `array`): List of EIN (employer identification numbers) for organizationDetails mode. ## `includeFilings` (type: `boolean`): For organizationDetails mode, include annual IRS 990 filing data. ## `maxItems` (type: `integer`): Maximum number of organizations to return. ## Actor input object example ```json { "mode": "searchOrganizations", "query": "foundation", "state": "", "nteeGroup": "", "includeFilings": false, "maxItems": 20 } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "mode": "searchOrganizations", "query": "foundation", "state": "", "nteeGroup": "", "includeFilings": false, "maxItems": 20 }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/lawyers-nonprofit-financial-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "mode": "searchOrganizations", "query": "foundation", "state": "", "nteeGroup": "", "includeFilings": False, "maxItems": 20, } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/lawyers-nonprofit-financial-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "mode": "searchOrganizations", "query": "foundation", "state": "", "nteeGroup": "", "includeFilings": false, "maxItems": 20 }' | apify call crawlerbros/lawyers-nonprofit-financial-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/lawyers-nonprofit-financial-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Nonprofit Financial Data Scraper (ProPublica)", "description": "Scrape nonprofit organizations and their IRS financial filings from ProPublica's Nonprofit Explorer - revenue, expenses, assets, liabilities, tax returns, and executive compensation.", "version": "0.1", "x-build-id": "ZvX9YVpoklRjCwyvC" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~lawyers-nonprofit-financial-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-lawyers-nonprofit-financial-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~lawyers-nonprofit-financial-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-lawyers-nonprofit-financial-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~lawyers-nonprofit-financial-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-lawyers-nonprofit-financial-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode" ], "properties": { "mode": { "title": "Mode", "enum": [ "searchOrganizations", "organizationDetails", "browseByNtee" ], "type": "string", "description": "What to fetch from ProPublica Nonprofit Explorer.", "default": "searchOrganizations" }, "query": { "title": "Search keyword", "type": "string", "description": "Keyword to search for (organization name or keyword).", "default": "foundation" }, "state": { "title": "State", "enum": [ "", "AL", "AK", "AZ", "AR", "CA", "CO", "CT", "DE", "FL", "GA", "HI", "ID", "IL", "IN", "IA", "KS", "KY", "LA", "ME", "MD", "MA", "MI", "MN", "MS", "MO", "MT", "NE", "NV", "NH", "NJ", "NM", "NY", "NC", "ND", "OH", "OK", "OR", "PA", "RI", "SC", "SD", "TN", "TX", "UT", "VT", "VA", "WA", "WV", "WI", "WY", "DC" ], "type": "string", "description": "Filter by US state abbreviation (e.g., CA, NY, TX).", "default": "" }, "nteeGroup": { "title": "NTEE major group", "enum": [ "", "A", "B", "C", "D", "E", "F", "G", "H", "I", "J", "K", "L", "M", "N", "O", "P", "Q", "R", "S", "T", "U", "V", "W", "X", "Y", "Z" ], "type": "string", "description": "NTEE major group letter (A=Arts, B=Education, C=Environment, E=Health, I=Crime/Legal, etc.).", "default": "" }, "eins": { "title": "EIN numbers", "type": "array", "description": "List of EIN (employer identification numbers) for organizationDetails mode.", "items": { "type": "string" } }, "includeFilings": { "title": "Include financial filings", "type": "boolean", "description": "For organizationDetails mode, include annual IRS 990 filing data.", "default": false }, "maxItems": { "title": "Max items", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum number of organizations to return.", "default": 20 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```