# USAspending Federal Awards Scraper (`haketa/usaspending-scraper`) Actor Extract US federal contracts, grants, loans, and IDV awards from USAspending — with recipient UEI, business categories, full addresses, NAICS, executive compensation, set-aside type, and awarding agency. 8M+ awards. No API key. - **URL**: https://apify.com/haketa/usaspending-scraper.md - **Developed by:** [Haketa](https://apify.com/haketa) (community) - **Categories:** Lead generation, Developer tools - **Stats:** 3 total users, 2 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $2.50 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## USAspending Scraper — Federal Contracts, Grants & Recipients **Turn 8,000,000+ US federal awards into a ready-to-use database.** Extract every federal contract, grant, loan, IDV, and direct payment ever recorded — with the recipient company's **UEI, full registered address, business categories (small business / 8(a) / WOSB / HUBZone / SDVOSB), NAICS hierarchy, set-aside type, executive compensation, place of performance, awarding agency, and competition details** — clean JSON / CSV / Excel. **No API key. No login. No paid subscription.** The richest open federal-spending dataset on Apify, packaged into a single point-and-click actor. If you've ever paid for **GovWin IQ, Bloomberg Government, Deltek GovWin, FedScout, or B2Gnow**, this scraper delivers a superset of that data for a fraction of the cost — and exports straight to your CRM. --- ### ⭐ Why this scraper US federal spending is the largest single procurement pool on the planet — over **$7 trillion in annual outlays**, recorded transparently down to the individual award level. Every Department of Defense contract, every NIH grant, every Department of Energy loan is sitting in the public record. The data is gold for: - **B2G (business-to-government) sales teams** prospecting federal contractors and finding cross-sell opportunities - **GovTech & B2G SaaS founders** building lead lists of agencies and prime contractors with known budgets - **M&A & private equity teams** screening federal-contractor acquisition targets by revenue proxy (obligated amount × recent awards) - **Compliance & due-diligence teams** verifying vendor relationships, set-aside qualifications, and audit trails - **Investigative journalists & policy researchers** tracing federal spending patterns, agency budgets, and vendor concentration - **Defense, healthcare, and energy industry analysts** monitoring contract awards by NAICS code, sub-agency, or set-aside - **Lobbyists, government-affairs teams, and trade associations** tracking who's winning contracts in their member industries - **Subcontractors and prime contractors** mapping the federal supply chain to find teaming partners - **Small businesses, 8(a) firms, WOSB / HUBZone / SDVOSB enterprises** finding set-aside opportunities by NAICS and agency If you've tried Apollo, ZoomInfo, or Crunchbase to find federal contractor leads — you'll quickly notice they don't carry **set-aside status**, **NAICS codes**, **award history**, **federal agency relationships**, or **executive compensation under FFATA**. This scraper does — straight from the public source of truth. --- ### 🔑 SEO / keyword reference This scraper is the answer for: **USAspending data export**, **federal contracts database**, **federal grant scraper**, **government contractor leads**, **B2G lead generation**, **federal procurement data**, **NAICS contract search**, **set-aside contract scraper**, **small business federal contracts**, **8(a) contract database**, **WOSB contracts**, **HUBZone contracts**, **SDVOSB contracts**, **veteran-owned business contracts**, **DoD contracts scraper**, **Department of Defense contractors**, **HHS grants database**, **NASA contracts**, **DOE awards scraper**, **federal recipient UEI lookup**, **prime contractor scraper**, **subaward database**, **GovWin alternative**, **Deltek alternative**, **Bloomberg Government alternative**, **federal spending analysis**, **CFDA grant search**, **PSC code search**, **executive compensation FFATA**, **government sales prospecting**. --- ### 🎯 What you get — per federal award record #### 🟢 Award identity & financials - **Award ID** (PIID / FAIN — the official identifier the agency uses) - **Award type** + human-readable description (contract / IDV / grant / loan / direct payment / other assistance, with subtype like "Definitive Contract", "Block Grant", "BPA Call") - **Description** — what was procured (free-text) - **Award amount** + **total obligation** + **base & all options ceiling** - **Total outlay** (actual money paid to date) - **Date signed** - **Period of performance** — start date + current end date + potential end date - **Subaward count** + **total subaward dollar amount** - **Public detail URL** — direct link to the official award page #### 🟢 Recipient (contractor / grantee) - **Recipient name** + **UEI** (12-character Unique Entity Identifier — the modern replacement for DUNS) - **Parent recipient name** + **parent UEI** (corporate hierarchy) - **Business categories** — every applicable flag: Small Business, 8(a), WOSB, HUBZone, SDVOSB, Veteran-Owned, Minority-Owned, Sole Proprietor, Foreign-Owned, Non-Profit, Educational Institution, etc. - **Full registered address** — street, city, state, ZIP-5 + ZIP-4, county, country, **congressional district code** #### 🟢 Place of performance - City, state, county, ZIP, country, **congressional district code** #### 🟢 Awarding agency hierarchy - **Top-tier agency** — name + code + abbreviation (e.g. "Department of Defense" / 097 / "DOD") - **Sub-tier agency** — name + code (e.g. "Defense Health Agency") - **Office agency name** (when reported) - **Funding agency** — separate top-tier + sub-tier (funding source can differ from awarder) #### 🟢 Industry classification - **NAICS hierarchy** — base code + description, mid-tier code + description, top-tier code + description (so you can roll up by 2 / 4 / 6 digit) - **PSC** (Product / Service Code) — code + description (federal-specific industry taxonomy) #### 🟢 Procurement details (contract awards) - **Set-aside type** — code + description (Small Business, 8(a), WOSB, EDWOSB, HUBZone, SDVOSBC, VSA, IEE, or "No Set Aside Used") - **Competition details** — extent competed (Full & Open / Sole Source / Limited Competition), number of offers received, solicitation procedures #### 🟢 Executive compensation (FFATA disclosures) - **Top officers + their declared compensation** — when the recipient meets the FFATA disclosure threshold. Up to 5 named executives per recipient with compensation in USD. **Pure sales gold** for any B2G outreach because these are named, public-record decision-makers. --- ### 💰 Real-world use cases — money-making scenarios #### 1. Build a federal-contractor cold-outreach list segmented by NAICS You sell cybersecurity tooling and want every prime contractor under NAICS 541512 (Computer Systems Design) doing federal work. Run: ```json { "awardTypeCategories": ["contracts"], "naicsCodes": ["541512"], "timePeriodStart": "2024-01-01", "minAwardAmount": 1000000, "maxRecords": 5000 } ```` → 5,000 prime contractors with UEI, address, business categories, set-aside status, and named executives — ready to import into Apollo / Salesforce / HubSpot / Smartlead. #### 2. Hand-picked enterprise targets — Department of Defense large primes You sell enterprise services to defense contractors. Filter by Department of Defense + min $10M awards: ```json { "agencyNames": ["Department of Defense"], "minAwardAmount": 10000000, "scrapeAwardDetails": true } ``` → Every multi-million-dollar DoD prime with executive contacts — instant ABM list. #### 3. Find small business / 8(a) / WOSB / HUBZone teaming partners You're a prime looking for set-aside-eligible subcontractors to win federal work: ```json { "setAsideTypes": ["8A", "WOSB", "HUBZ", "SDVOSBC"], "naicsCodes": ["541330", "541512"], "recipientLocationStates": ["VA", "MD", "DC"] } ``` → Pre-qualified teaming partners by NAICS + geography + set-aside type. #### 4. M\&A target screening — federal contractor rollups You're a PE firm acquiring B2G services rollups. Pull every contractor with $5M–$50M annual federal revenue in a specific NAICS: ```json { "naicsCodes": ["541330"], "minAwardAmount": 5000000, "maxAwardAmount": 50000000, "timePeriodStart": "2023-01-01" } ``` → Sortable acquisition target list with revenue proxies and executive disclosures. #### 5. Compete intelligence — track competitor federal wins You're a B2G analyst. Schedule weekly runs with `recipientSearchText: "Booz Allen"` (or any competitor name) → know every new contract they sign, by agency, by NAICS, by dollar amount. Real-time competitive radar. #### 6. State-level federal investment dashboards You're a state economic-development office. Pull every award where `placeOfPerformanceStates: ["TX"]` — instant federal-spending dashboard by city / county / industry / agency for your state. #### 7. Investigative journalism / policy research Track who's actually receiving Department of X funding over time. Filter by agency + time period + NAICS → discover concentration patterns, vendor-agency relationships, recurring beneficiaries. #### 8. Lookalike modeling for SaaS sales Your best 50 customers are federal IT primes. Pull every similar contractor by NAICS + set-aside + state + revenue band → instant lookalike pipeline with executive contact disclosures. #### 9. Grant database for non-profits & researchers Filter by `awardTypeCategories: ["grants"]` + agency (HHS, NSF, DOE, ED) → research-funding intelligence for grant writers and academic prospectors. #### 10. Programmatic SEO — "Top N federal contractors in \[state/industry]" pages Pull every state × NAICS combination → generate hundreds of programmatic SEO landing pages ranking contractors by federal revenue. #### 11. Subcontracting opportunity mapping Pull every prime + subaward stats → understand which primes routinely subcontract and what's left for smaller firms to win. #### 12. Compliance / due diligence For any vendor your company is evaluating: pull their full federal contract history by `recipientSearchText: ""` → audit-grade record in seconds. *** ### ⚙️ Input — what you give | Field | What it does | Example | |---|---|---| | `awardTypeCategories` | Pick categories: contracts, IDVs, grants, loans, direct payments, other assistance | `["contracts", "grants"]` | | `timePeriodStart` / `timePeriodEnd` | Restrict to awards in this date range (YYYY-MM-DD) | `"2024-01-01"` / `"2024-12-31"` | | `keywords` | Free-text search across award descriptions | `["cybersecurity", "cloud migration"]` | | `agencyNames` | Filter by top-tier awarding agency | `["Department of Defense", "Department of Energy"]` | | `recipientSearchText` | Substring match on contractor name | `"Lockheed"` | | `naicsCodes` | Filter by NAICS industry codes | `["541512", "541330"]` | | `recipientLocationStates` | Contractors HQ'd in these US states | `["VA", "MD", "DC"]` | | `placeOfPerformanceStates` | Awards performed in these US states | `["TX", "CA"]` | | `setAsideTypes` | Small-business set-aside codes | `["SBA", "8A", "WOSB", "HUBZ", "SDVOSBC"]` | | `minAwardAmount` / `maxAwardAmount` | Dollar-value filters | `1000000` | | `scrapeAwardDetails` | Fetch the deep record per award (UEI, address, executives) | `true` | | `sortBy` / `sortOrder` | Order results | `"Award Amount"` / `"desc"` | | `maxRecords` | Total cap | `100` | | `maxConcurrency` / `requestDelay` | Performance tuning | `5` / `250` | | `proxyConfiguration` | Default: no proxy (the source is direct-friendly) | *(Apify proxy editor)* | #### Sensible defaults Defaults pull the **last fiscal year of contracts**, sorted by award amount descending — perfect first run. *** ### 📤 Output — what you get Every run pushes records to a structured **dataset** exportable from the Apify Console as: | Format | When to use | |---|---| | **JSON** | Direct API / programmatic ingestion, full nested data preserved | | **CSV** | Open in Excel / Google Sheets, import to Salesforce, HubSpot, Pipedrive, Apollo, Clay, Outreach | | **XLSX** | Hand off to non-technical stakeholders | | **Awards view** | Compact one-row-per-award table — recommended for outbound | | **Recipients view** | One row per (award × executive) — outbound-ready with named decision makers | #### Example output — full award record ```json { "awardId": "HT940216C0001", "internalAwardId": "CONT_AWD_HT940216C0001_9700_-NONE-_-NONE-", "category": "contract", "type": "D", "typeDescription": "DEFINITIVE CONTRACT", "description": "IGF::OT::IGF Managed Healthcare Services for TRICARE", "awardAmount": 51269205263.03, "totalObligation": 51269205263.03, "baseAndAllOptions": 56620536577.19, "totalOutlay": 50100123456.78, "dateSigned": "2016-07-29", "periodOfPerformance": { "startDate": "2016-08-01", "currentEndDate": "2025-12-31", "potentialEndDate": "2026-12-31" }, "awardingAgency": { "toptierName": "Department of Defense", "toptierCode": "097", "toptierAbbrev": "DOD", "subtierName": "Defense Health Agency", "subtierCode": "97DH", "officeName": "DEFENSE HEALTH AGENCY" }, "fundingAgency": { "toptierName": "Department of Defense", "subtierName": "Defense Health Agency" }, "recipient": { "name": "HUMANA GOVERNMENT BUSINESS INC", "uei": "ZE6ZM6NKSV43", "parentName": "HUMANA GOVERNMENT BUSINESS INC", "parentUei": "ZE6ZM6NKSV43", "businessCategories": [ "Category Business", "Corporate Entity Not Tax Exempt", "Not Designated a Small Business", "Special Designations", "U.S.-Owned Business" ], "location": { "addressLine1": "500 W Main St", "city": "Louisville", "state": "Kentucky", "stateCode": "KY", "country": "United States", "countryCode": "USA", "zip5": "40202", "zip4": "2946", "county": "Jefferson", "congressionalCode": "03" } }, "placeOfPerformance": { "city": "Louisville", "state": "Kentucky", "stateCode": "KY", "country": "United States", "countryCode": "USA", "county": "Jefferson", "zip5": "40201", "congressionalCode": "03" }, "naics": { "code": "524114", "description": "Direct Health and Medical Insurance Carriers", "midtierCode": "5241", "midtierDescription": "Insurance Carriers", "toptierCode": "52", "toptierDescription": "Finance and Insurance" }, "psc": { "code": "Q201", "description": "MEDICAL- MANAGED HEALTHCARE" }, "setAside": { "code": "NONE", "description": "NO SET ASIDE USED." }, "competition": { "extentCompeted": "A", "extentCompetedDescription": "FULL AND OPEN COMPETITION", "numberOfOffers": "4", "solicitationProcedures": "NP" }, "subawardCount": 145, "subawardTotalAmount": 1079551766.05, "executiveCompensation": [ { "name": "KAREN MORAN", "amount": 1409718.0 }, { "name": "KEVIN REGENHOLD", "amount": 607266.0 }, { "name": "MELANIE BUEHLER", "amount": 604450.0 }, { "name": "MATT PAYNTER", "amount": 621345.0 }, { "name": "BILL DERECH", "amount": 578390.0 } ], "awardDetailUrl": "https://www.usaspending.gov/award/CONT_AWD_HT940216C0001_9700_-NONE-_-NONE-/", "scrapedAt": "2026-05-19T14:00:00.000Z" } ``` *** ### 📊 Data quality | Field | Coverage | Notes | |---|---|---| | Award identifier + amount + dates | **100%** | Every record | | Awarding agency hierarchy | **100%** | Top-tier + sub-tier + office | | Recipient name + **UEI** | **~99%** | UEI only missing for legacy pre-2022 awards using old DUNS | | Recipient full address | **~98%** | Street, city, state, ZIP, county, congressional district | | Recipient business categories | **100%** | Small business / 8(a) / WOSB / HUBZone / SDVOSB flags | | NAICS hierarchy (3-tier) | **~95%** | Base + mid-tier + top-tier | | PSC code + description | **~95%** | Contracts only | | Set-aside type | **100%** | (incl. "No Set Aside Used") | | Competition details | **~90%** | Contracts only — extent competed, offers, procedures | | Place of performance | **~99%** | City + state + county + ZIP + congressional district | | Subaward stats (count + amount) | **100%** | Total subaward count and dollar amount | | **Executive compensation** | **~30–60%** | Only for recipients above the FFATA disclosure threshold | | Total outlay | **~90%** | Actual money paid to date | **Translation:** every record you receive is a **fully structured federal award** with the recipient's identifier (UEI), full address, business-type flags, and the agency they got the money from. Outbound-ready in one export. *** ### 🌐 Coverage The dataset covers the full historical record of US federal awards: - **Contracts** — definitive contracts, BPAs, delivery orders, purchase orders - **IDVs** — indefinite delivery vehicles (parent contracts, IDIQs, GWACs) - **Grants** — block grants, project grants, formula grants - **Loans** — direct loans and loan guarantees - **Direct payments** — Social Security, SNAP, etc. (aggregate level) - **Other financial assistance** — cooperative agreements, scholarships, etc. **Geographic scope:** all 50 US states, DC, territories, and foreign awards. Filter by recipient state, place-of-performance state, or both. **Time range:** awards from approximately fiscal year 2008 forward, updated continuously by federal agencies. **Agencies:** every Cabinet department, every independent agency, every quasi-government entity that reports federal spending. *** ### 💡 Tips & best practices #### Outbound sales - **Start narrow.** Run `maxRecords: 100` with your top 1–2 filters first. Validate the data on your real ICP before scaling. - **Always run `scrapeAwardDetails: true`** for outbound — listing rows alone miss the recipient UEI, full address, business categories, and executives. - **Combine `naicsCodes` + `recipientLocationStates` + `setAsideTypes`** to laser in on your ICP. - **Sort by `Award Amount` descending** for biggest-fish-first prospecting. #### Subcontracting / teaming - Filter by `setAsideTypes: ["8A", "WOSB", "HUBZ", "SDVOSBC"]` + your NAICS to find set-aside-eligible primes to team with. #### M\&A & PE - Pull 24-month windows of awards by NAICS + state → estimate recipient revenue from federal sources alone. - Use `executiveCompensation` to flag larger firms — only FFATA-threshold recipients disclose. #### Competitive intelligence - Run `recipientSearchText: ""` on a weekly cron → real-time alerts when they sign new contracts. #### Compliance & vendor verification - Pass a single vendor name to `recipientSearchText` → audit-grade history of every federal dollar they've received. #### Speed / cost optimization - `scrapeAwardDetails: false` → ultra-fast listing-only mode (5–10× faster, cheaper) for bulk discovery. - `scrapeAwardDetails: true` (default) → full per-award detail for real outreach. #### Pagination - Each listing page returns 100 records. Set `maxRecords` to a multiple of 100 for clean pagination. - For huge runs (50K+), schedule overnight runs with `maxConcurrency: 5`. *** ### ❓ FAQ **Is the data fresh?** Federal agencies update their reporting on rolling schedules — typically weekly to monthly. Run this scraper on any cadence to capture deltas. Award amounts and outlays update over time as contracts are modified or executed. **Do I need any login or API key?** No. Public data, no authentication, no rate-limit token required. **Can I scrape a specific federal contract by its ID?** Pass the contract identifier (PIID) as `recipientSearchText` or use a relevant agency + NAICS filter. The full detail record includes the official PIID and internal award ID. **Can I export to my CRM?** Yes — the dataset exports to **CSV, XLSX, or JSON**, and Apify's API lets you pipe it directly into Salesforce, HubSpot, Pipedrive, Apollo, Clay, Outreach, Smartlead, Lemlist, GovTribe, or any custom stack. **Will the same award appear twice?** No — each award has a unique internal ID and we deduplicate before pushing. **Can I filter by award size (dollar range)?** Yes — `minAwardAmount: 1000000`, `maxAwardAmount: 50000000`, or both. **Can I get only small-business / 8(a) / WOSB awards?** Yes — `setAsideTypes: ["SBA", "8A", "WOSB", "HUBZ", "SDVOSBC"]` (combine any). **Can I limit to a specific state?** Yes — `recipientLocationStates: ["VA"]` for contractor HQ, `placeOfPerformanceStates: ["TX"]` for where work happens. **Does this include subawards (subcontracts)?** The aggregate subaward count + total subaward dollar amount are in each award record. For a full subaward breakdown per record, contact us — we can ship a subawards-mode extension. **Are grants included?** Yes — set `awardTypeCategories: ["grants"]` (or combine with contracts). **Are loan awards included?** Yes — `awardTypeCategories: ["loans"]`. **Can I get executive names + compensation?** Yes — when the recipient meets the FFATA disclosure threshold (~$25K minimum across federal funding), top 5 officers + compensation are included. **Can I schedule daily/weekly runs?** Absolutely — Apify's built-in scheduler handles any cron expression. Pair with webhooks to fire on new awards matching your filters. **Is there a free tier?** Yes — the **first 100 records per run are free**. Plenty for validating the data on your ICP before scaling. **How does this compare to GovWin IQ / Bloomberg Government / Deltek?** Those paid platforms (often $10K–$50K/year) layer analytics on top of the same underlying public dataset this scraper pulls from. You get the raw, structured data here at a small fraction of the cost. **Does this work outside the US?** This scraper is US federal-specific. For non-US procurement data, see our other actors (UK Companies House, EU TED, etc. coming soon). *** ### 💸 Pricing This scraper uses **Pay-per-result** pricing — you pay only for the records you actually receive. No subscriptions, no monthly minimums. Fresh federal-spending data at a fraction of GovWin / Bloomberg Government / Deltek pricing. The **first 100 results per run are free** so you can validate on your real ICP first. *** ### 🚀 Related actors by the same team Pair this with the rest of our B2B + B2G intelligence suite: - **GoodFirms Scraper** — `haketa/goodfirms-scraper` 110,000+ B2B agencies + SaaS products with hourly rates, employees, founded, headquarters, contacts, verified reviews. - **DesignRush Scraper** — `haketa/designrush-scraper` 40,000+ premium B2B agencies with minimum project budget, hourly rate, full address, email, phone, and inline verified reviews. Stronger on creative / branding firms. - **ProductHunt Launches & Makers Scraper** — `haketa/producthunt-launches-scraper` Every Product Hunt product launch with founders, vote counts, reviews, and topic tags. VC sourcing and recruiter pipelines. - **Y Combinator Companies Scraper** — `haketa/ycombinator-companies-scraper` Every YC company across all batches with industry, location, and team. The canonical YC alumni database. - **BuiltIn Tech Companies + Tech Stack Scraper** — `haketa/builtin-tech-companies-scraper` Tech companies + their declared tech stack. Ideal for selling developer tools and finding companies hiring in your stack. - **H1B Visa Database Scraper** — `haketa/h1b-visa-database-scraper` Visa sponsor employers + salary records. Recruiter and immigration-research gold. - **NPPES NPI Registry Scraper** — `haketa/nppes-npi-registry-scraper` Every US healthcare provider with NPI, specialty, address, and phone. Healthcare GTM in a single dataset. - **Levels.fyi Scraper** — `haketa/levels-fyi-scraper` Tech compensation database — recruiter and talent benchmarking. - **US License-board scrapers** (state-level professional licensing) — `haketa/california-dca-license-scraper`, `tsbp-license-scraper`, `ohio-elicense-scraper`, `illinois-idfpr-license-scraper`, `arizona-roc-contractor-license-scraper`, `colorado-professional-license-scraper`, `nc-licensing-board-for-general-contractors-scraper`, `washington-li-contractor-license-scraper`, `virginia-dpor-license-scraper`, `minnesota-dli-license-scraper`, `ttb-alcohol-permittee-scraper`. - **Healthcare & medical scrapers** — `haketa/whatclinic-scraper`, `haketa/bookimed-scraper`, `haketa/nppes-npi-registry-scraper`. - **Real-estate scrapers** — `haketa/apartments-com-scraper`, `rent-com-scraper`, `realtor-ca-scraper`, `domain-com-au-scraper`, `trademe-scraper`, `zameen-scraper`, `kijiji-scraper`, `lamudi-scraper`, `realestate-com-kh-scraper`, `immoweb-scraper`, `vivareal-scraper`, `zapimoveis-scraper`, `yallamotor-scraper`. - **Classifieds & marketplaces** — `haketa/kleinanzeigen-scraper`, `marktplaats-scraper`, `mourjan-scraper`, `offerup-scraper`, `lelong-my-scraper`, `seek-scraper`, `chotot-scraper`. - **Trust & verification** — `haketa/bbb-scraper` (Better Business Bureau). *** ### ✅ Status & support Maintained actively. Update notes shipped via the Apify build log. For feedback, new filter requests, or edge cases, leave a review on the actor page. *** ### ⚖️ Disclaimer This scraper collects **publicly available US federal spending data** that the US government publishes in the public interest. The data is released under public-domain rules and is freely usable for commercial and non-commercial purposes. The user is responsible for compliance with applicable laws (CAN-SPAM, TCPA, GDPR for non-US recipients, etc.) when using the data — especially for outbound email, SMS, or call campaigns. Cold-outreach laws vary by jurisdiction; please check your local regulations. *** Built for **B2G sales teams, GovTech founders, M\&A analysts, compliance & due-diligence teams, investigative journalists, policy researchers, industry analysts, lobbyists, subcontractors, prime contractors, and set-aside small businesses** who want federal-spending intelligence faster, cheaper, and more flexible than GovWin / Bloomberg Government / Deltek can deliver — without writing a line of code. # Actor input Schema ## `awardTypeCategories` (type: `array`): Which categories of federal spending to pull. Pick one or more: 'contracts', 'idvs' (indefinite delivery vehicles), 'grants', 'loans', 'other\_financial\_assistance', 'direct\_payments'. ## `timePeriodStart` (type: `string`): Restrict to awards signed/active on/after this date (YYYY-MM-DD). Leave empty for default last fiscal year. ## `timePeriodEnd` (type: `string`): Restrict to awards signed/active on/before this date (YYYY-MM-DD). Leave empty for today. ## `keywords` (type: `array`): Free-text keyword search across award descriptions. Useful for finding specific contract topics (e.g. 'cybersecurity', 'cloud migration', 'AI', 'logistics'). ## `agencyNames` (type: `array`): Filter by top-tier awarding agencies. Examples: 'Department of Defense', 'Department of Health and Human Services', 'National Aeronautics and Space Administration', 'Department of Energy', 'General Services Administration'. ## `recipientSearchText` (type: `string`): Substring match against recipient company names (e.g. 'Lockheed', 'Booz Allen', 'Microsoft'). ## `naicsCodes` (type: `array`): Filter by NAICS industry codes (2 / 4 / 6 digit). Examples: '541512' (Computer Systems Design), '541330' (Engineering Services), '336411' (Aircraft Manufacturing), '236220' (Commercial Building Construction). ## `recipientLocationStates` (type: `array`): Filter to contractors headquartered in these US state codes (2-letter, e.g. 'VA', 'CA', 'TX', 'NY', 'DC', 'MD'). ## `placeOfPerformanceStates` (type: `array`): Filter to awards performed in these US state codes (2-letter). ## `setAsideTypes` (type: `array`): Filter by small-business set-aside codes. Examples: 'SBA' (Small Business), '8A' (8(a) Program), 'WOSB' (Women-Owned), 'EDWOSB', 'HUBZ' (HUBZone), 'SDVOSBC' (Service-Disabled Veteran-Owned), 'VSA' (Veteran-Owned), 'IEE' (Indian Economic Enterprise). ## `minAwardAmount` (type: `integer`): Filter to awards >= this dollar value. 0 = no minimum. ## `maxAwardAmount` (type: `integer`): Filter to awards <= this dollar value. 0 = no maximum. ## `scrapeAwardDetails` (type: `boolean`): Pull the full award record for each result — adds recipient UEI, full address, NAICS hierarchy, set-aside type, executive compensation, place of performance, subaward stats. Turn OFF for ultra-fast bulk discovery. ## `sortBy` (type: `string`): How to order results. ## `sortOrder` (type: `string`): Ascending or descending. ## `maxRecords` (type: `integer`): Total cap on records to push. 0 = unlimited (warning: tens of millions of awards exist). ## `requestDelay` (type: `integer`): Politeness delay between requests. ## `maxConcurrency` (type: `integer`): Parallel detail-fetch concurrency. The source is rate-limited per IP. ## `proxyConfiguration` (type: `object`): Default: no proxy. The data source is fast and reliable from direct connections — only enable a proxy if you're running enormous volumes and hitting per-IP rate limits. ## Actor input object example ```json { "awardTypeCategories": [ "contracts" ], "timePeriodStart": "2024-10-01", "timePeriodEnd": "", "keywords": [], "agencyNames": [], "recipientSearchText": "", "naicsCodes": [], "recipientLocationStates": [], "placeOfPerformanceStates": [], "setAsideTypes": [], "minAwardAmount": 0, "maxAwardAmount": 0, "scrapeAwardDetails": true, "sortBy": "Award Amount", "sortOrder": "desc", "maxRecords": 100, "requestDelay": 250, "maxConcurrency": 5, "proxyConfiguration": { "useApifyProxy": false } } ``` # Actor output Schema ## `allAwards` (type: `string`): Full dataset — choose JSON / CSV / Excel in the export menu. ## `awardsView` (type: `string`): Compact lead-gen table. ## `recipientsView` (type: `string`): Flattened to executive-level — one row per (award × executive). # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "awardTypeCategories": [ "contracts" ], "timePeriodStart": "2024-10-01", "timePeriodEnd": "", "keywords": [], "agencyNames": [], "recipientSearchText": "", "naicsCodes": [], "recipientLocationStates": [], "placeOfPerformanceStates": [], "setAsideTypes": [], "scrapeAwardDetails": true, "sortBy": "Award Amount", "sortOrder": "desc", "maxRecords": 100, "proxyConfiguration": { "useApifyProxy": false } }; // Run the Actor and wait for it to finish const run = await client.actor("haketa/usaspending-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "awardTypeCategories": ["contracts"], "timePeriodStart": "2024-10-01", "timePeriodEnd": "", "keywords": [], "agencyNames": [], "recipientSearchText": "", "naicsCodes": [], "recipientLocationStates": [], "placeOfPerformanceStates": [], "setAsideTypes": [], "scrapeAwardDetails": True, "sortBy": "Award Amount", "sortOrder": "desc", "maxRecords": 100, "proxyConfiguration": { "useApifyProxy": False }, } # Run the Actor and wait for it to finish run = client.actor("haketa/usaspending-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "awardTypeCategories": [ "contracts" ], "timePeriodStart": "2024-10-01", "timePeriodEnd": "", "keywords": [], "agencyNames": [], "recipientSearchText": "", "naicsCodes": [], "recipientLocationStates": [], "placeOfPerformanceStates": [], "setAsideTypes": [], "scrapeAwardDetails": true, "sortBy": "Award Amount", "sortOrder": "desc", "maxRecords": 100, "proxyConfiguration": { "useApifyProxy": false } }' | apify call haketa/usaspending-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=haketa/usaspending-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "USAspending Federal Awards Scraper", "description": "Extract US federal contracts, grants, loans, and IDV awards from USAspending — with recipient UEI, business categories, full addresses, NAICS, executive compensation, set-aside type, and awarding agency. 8M+ awards. No API key.", "version": "0.0", "x-build-id": "KjQ844pWYUMzGPS7P" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/haketa~usaspending-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-haketa-usaspending-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/haketa~usaspending-scraper/runs": { "post": { "operationId": "runs-sync-haketa-usaspending-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/haketa~usaspending-scraper/run-sync": { "post": { "operationId": "run-sync-haketa-usaspending-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "awardTypeCategories": { "title": "Award Type Categories", "type": "array", "description": "Which categories of federal spending to pull. Pick one or more: 'contracts', 'idvs' (indefinite delivery vehicles), 'grants', 'loans', 'other_financial_assistance', 'direct_payments'.", "items": { "type": "string", "enum": [ "contracts", "idvs", "grants", "loans", "other_financial_assistance", "direct_payments" ], "enumTitles": [ "Contracts", "IDVs (Indefinite Delivery)", "Grants", "Loans", "Other Financial Assistance", "Direct Payments" ] }, "default": [ "contracts" ] }, "timePeriodStart": { "title": "Time Period — Start Date", "type": "string", "description": "Restrict to awards signed/active on/after this date (YYYY-MM-DD). Leave empty for default last fiscal year.", "default": "" }, "timePeriodEnd": { "title": "Time Period — End Date", "type": "string", "description": "Restrict to awards signed/active on/before this date (YYYY-MM-DD). Leave empty for today.", "default": "" }, "keywords": { "title": "Keywords", "type": "array", "description": "Free-text keyword search across award descriptions. Useful for finding specific contract topics (e.g. 'cybersecurity', 'cloud migration', 'AI', 'logistics').", "default": [], "items": { "type": "string" } }, "agencyNames": { "title": "Awarding Agency Names", "type": "array", "description": "Filter by top-tier awarding agencies. Examples: 'Department of Defense', 'Department of Health and Human Services', 'National Aeronautics and Space Administration', 'Department of Energy', 'General Services Administration'.", "default": [], "items": { "type": "string" } }, "recipientSearchText": { "title": "Recipient Name Search", "type": "string", "description": "Substring match against recipient company names (e.g. 'Lockheed', 'Booz Allen', 'Microsoft').", "default": "" }, "naicsCodes": { "title": "NAICS Codes", "type": "array", "description": "Filter by NAICS industry codes (2 / 4 / 6 digit). Examples: '541512' (Computer Systems Design), '541330' (Engineering Services), '336411' (Aircraft Manufacturing), '236220' (Commercial Building Construction).", "default": [], "items": { "type": "string" } }, "recipientLocationStates": { "title": "Recipient Location — US States", "type": "array", "description": "Filter to contractors headquartered in these US state codes (2-letter, e.g. 'VA', 'CA', 'TX', 'NY', 'DC', 'MD').", "default": [], "items": { "type": "string" } }, "placeOfPerformanceStates": { "title": "Place of Performance — US States", "type": "array", "description": "Filter to awards performed in these US state codes (2-letter).", "default": [], "items": { "type": "string" } }, "setAsideTypes": { "title": "Set-Aside Types", "type": "array", "description": "Filter by small-business set-aside codes. Examples: 'SBA' (Small Business), '8A' (8(a) Program), 'WOSB' (Women-Owned), 'EDWOSB', 'HUBZ' (HUBZone), 'SDVOSBC' (Service-Disabled Veteran-Owned), 'VSA' (Veteran-Owned), 'IEE' (Indian Economic Enterprise).", "default": [], "items": { "type": "string" } }, "minAwardAmount": { "title": "Minimum Award Amount (USD)", "minimum": 0, "type": "integer", "description": "Filter to awards >= this dollar value. 0 = no minimum.", "default": 0 }, "maxAwardAmount": { "title": "Maximum Award Amount (USD)", "minimum": 0, "type": "integer", "description": "Filter to awards <= this dollar value. 0 = no maximum.", "default": 0 }, "scrapeAwardDetails": { "title": "Scrape Full Award Details", "type": "boolean", "description": "Pull the full award record for each result — adds recipient UEI, full address, NAICS hierarchy, set-aside type, executive compensation, place of performance, subaward stats. Turn OFF for ultra-fast bulk discovery.", "default": true }, "sortBy": { "title": "Sort By", "enum": [ "Award Amount", "Start Date", "End Date", "Recipient Name", "Award ID" ], "type": "string", "description": "How to order results.", "default": "Award Amount" }, "sortOrder": { "title": "Sort Order", "enum": [ "desc", "asc" ], "type": "string", "description": "Ascending or descending.", "default": "desc" }, "maxRecords": { "title": "Max Records", "minimum": 0, "type": "integer", "description": "Total cap on records to push. 0 = unlimited (warning: tens of millions of awards exist).", "default": 100 }, "requestDelay": { "title": "Request Delay (ms)", "minimum": 0, "type": "integer", "description": "Politeness delay between requests.", "default": 250 }, "maxConcurrency": { "title": "Max Concurrency", "minimum": 1, "maximum": 20, "type": "integer", "description": "Parallel detail-fetch concurrency. The source is rate-limited per IP.", "default": 5 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Default: no proxy. The data source is fast and reliable from direct connections — only enable a proxy if you're running enormous volumes and hitting per-IP rate limits." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```