Public Procurement Intelligence Hub

🏛️ Public Procurement Intelligence Hub is a powerful Apify Actor designed to discover, analyze, and monitor Public Procurement Intelligence opportunities from USASpending.gov. This tool provides comprehensive Public Procurement Intelligence including government contracts, awards, vendors, values, timelines, and detailed procurement classifications. Whether you're bidding for government contracts, tracking procurement trends, or conducting competitive intelligence, the Public Procurement Intelligence Hub delivers actionable Public Procurement Intelligence opportunities efficiently.

With USASpending.gov API integration, multi-source data enrichment, comprehensive classification codes (NAICS, PSC), detailed award tracking, vendor intelligence, and data deduplication, the Public Procurement Intelligence Hub ensures complete Public Procurement Intelligence discovery and analysis. It focuses on key Public Procurement Intelligence signals including contract values, agency details, vendor information, and procurement classifications, making it an essential tool for Public Procurement Intelligence research and government contracting.

---

📋 Table of Contents

• Features
• Data Source
• How It Works
• Input
• Output
• Technical Stack
• Data Fields
• Classification Codes
• Award Types
• Use Cases
• Quick Start
• Configuration
• Performance
• Billing
• Important Notes
• Keywords
• Changelog
• Support

---

🔥 Features

• USASpending.gov Integration – Direct API access to official U.S. government spending database for Public Procurement Intelligence.
• Keyword Search – Search Public Procurement Intelligence by contract keyword, topic, or product/service.
• Contract Discovery – Discovers government contracts and awards matching search criteria.
• Multiple Award Types – Searches across A, B, C, D award type codes (contracts, grants, loans, direct payments).
• Time Period Support – Configurable date range for historical and current procurement data.
• Detailed Award Information – Fetches comprehensive details for each contract from award detail API.
• Buyer Identification – Identifies awarding agency and sub-agency for each contract.
• Vendor Information – Captures winning vendor name and UEI (Unique Entity Identifier).
• Contract Values – Extracts award amounts, total obligations, and base+options values.
• Performance Timeline – Records contract start and end dates.
• Location Tracking – Captures place of performance (city, state, country).
• NAICS Classification – Includes industry classification codes (NAICS).
• PSC Classification – Includes product/service classification codes (PSC).
• Set-Aside Programs – Identifies small business set-asides and other set-aside programs.
• Competition Metrics – Tracks number of offers received for contract.
• URL Generation – Provides direct links to contract details on USASpending.
• Deduplication – Removes duplicate contracts from results.
• Sorting – Results sorted by award amount (highest first).
• Summary Generation – Generates procurement intelligence summary.
• Multi-Field Extraction – Intelligently pulls data from search results and detail API.
• PPE Billing Integration – Pay-per-event billing (batch processing, not per-contract charged).
• Proxy Support – Apify residential proxy support for reliability.
• Real-Time Dataset Push – Pushes results to Apify Dataset with metadata.
• Detailed Logging – Comprehensive logging of search and processing.
• Asyncio-Friendly – Non-blocking async/await architecture.

---

📊 Data Source

USASpending.gov

• Authority: Official U.S. Government spending transparency database (DATA Act compliant)
• Coverage: All federal contracts, grants, loans, and direct payments
• Data: Comprehensive procurement information from all federal agencies
• Updates: Near real-time updates as contracts are awarded
• APIs: Official REST API with extensive data fields
• Historical Data: Multiple years of historical contract data
• Scope: Over $6 trillion in federal spending tracked

---

⚙️ How It Works

The Public Procurement Intelligence Hub accepts a keyword to search for government contracts. It queries the USASpending.gov API with the keyword across all major award types (A, B, C, D) and configurable time period. For each contract found, it fetches detailed award information to enrich the dataset with additional fields not in the search results. It extracts comprehensive data including buyer, vendor, value, timeline, location, and classifications. Results are deduplicated by award ID and pushed to the dataset in batch. A summary of findings is logged.

Key Processing Steps:

1. Input Parsing – Accept keyword and search parameters
2. Proxy Setup – Configure Apify residential proxy
3. Payload Building – Build search query with filters
4. API Search – Query USASpending.gov awards search API
5. Result Parsing – Parse initial search results
6. Detail Fetching – Fetch full details for each contract
7. Field Extraction – Extract all relevant fields from search + detail
8. Data Enrichment – Intelligently merge search and detail data
9. Formatting – Format amounts, dates, and text fields
10. Location Compilation – Build location strings
11. Deduplication – Remove duplicates by award ID
12. Dataset Push – Push unique leads in batch
13. Summary Reporting – Log statistics

Key Benefits:

• Discover government contracts matching your expertise
• Understand procurement trends and opportunities
• Identify agencies and spending patterns
• Research competitor contract wins
• Build target company lists for business development
• Monitor procurement market segments

---

📥 Input

The Actor accepts the following input parameters:

Field	Type	Default	Description
keyword	string	required	Search keyword for Public Procurement Intelligence (e.g., "software", "IT services")
limit	integer	25	Maximum contracts to return (1-100)
useApifyProxy	boolean	true	Enable Apify residential proxies
apifyProxyGroups	array	["RESIDENTIAL"]	Proxy group configuration

Example Input:

{
  "keyword": "cloud computing",
  "limit": 50,
  "useApifyProxy": true
}

Search for IT Contracts:

{
  "keyword": "information technology",
  "limit": 75
}

Search for Specific Services:

{
  "keyword": "consulting services",
  "limit": 100
}

---

📤 Output

The Actor pushes Public Procurement Intelligence lead records with the following structure:

Procurement Lead Record:

Field	Type	Description
title	string	Contract title/description
award_id	string	Unique award identifier
award_type	string	Award type (Contract, Grant, Loan, etc.)
buyer	string	Awarding agency (top-tier)
sub_agency	string	Awarding sub-agency
vendor	string	Winning vendor/contractor name
vendor_uei	string	Vendor Unique Entity Identifier
value	string	Contract award amount (formatted)
start_date	string	Performance start date (YYYY-MM-DD)
end_date	string	Performance end date (YYYY-MM-DD)
location	string	Place of performance (city, state, country)
naics_code	string	Industry classification code
naics_desc	string	NAICS description
psc_code	string	Product/Service classification code
psc_desc	string	PSC description
set_aside	string	Set-aside program (e.g., small business)
offers	string	Number of competing offers
detail_url	string	Direct link to USASpending contract details
source	string	Data source (USASpending.gov)
keyword	string	Search keyword used
scraped_at	string	ISO 8601 scrape timestamp

Example Procurement Lead Record:

{
  "title": "Cloud Infrastructure Services Platform Implementation and Operations",
  "award_id": "9023847592834",
  "award_type": "Contract",
  "buyer": "General Services Administration",
  "sub_agency": "Federal Acquisition Service",
  "vendor": "Amazon Web Services, Inc.",
  "vendor_uei": "1234567890AB",
  "value": "$250,000,000",
  "start_date": "2024-01-15",
  "end_date": "2029-01-14",
  "location": "Arlington, VA, USA",
  "naics_code": "541511",
  "naics_desc": "Custom Computer Programming Services",
  "psc_code": "D310",
  "psc_desc": "Information Technology and Telecommunications",
  "set_aside": "None",
  "offers": "8",
  "detail_url": "https://www.usaspending.gov/award/9023847592834",
  "source": "USASpending.gov",
  "keyword": "cloud computing",
  "scraped_at": "2025-02-14T12:00:00"
}

Example Multiple Leads (Batch):

[
  {
    "title": "Software Development and Integration Services",
    "award_id": "9012345678901",
    "award_type": "Contract",
    "buyer": "Department of Defense",
    "sub_agency": "Air Force",
    "vendor": "Raytheon Technologies Corp",
    "vendor_uei": "0987654321XY",
    "value": "$150,000,000",
    "start_date": "2023-03-01",
    "end_date": "2027-02-28",
    "location": "Fort Worth, TX, USA",
    "naics_code": "541512",
    "naics_desc": "Computer Systems Design Services",
    "psc_code": "D301",
    "psc_desc": "Automatic Data Processing and Office Automation",
    "set_aside": "None",
    "offers": "5",
    "detail_url": "https://www.usaspending.gov/award/9012345678901",
    "source": "USASpending.gov",
    "keyword": "defense technology",
    "scraped_at": "2025-02-14T12:00:00"
  }
]

---

🧰 Technical Stack

• API Source: USASpending.gov REST API
• HTTP Client: httpx for async HTTP requests
• Data Parsing: JSON and regex for text processing
• Async: asyncio for non-blocking operations
• Rate Limiting: Polite delays between detail API calls (300ms)
• Deduplication: Set-based tracking by award ID
• Proxy: Apify Proxy with RESIDENTIAL configuration
• Logging: Apify Actor logging system
• Platform: Apify Actor serverless environment
• Billing: Batch push (not per-contract PPE)

---

📊 Data Fields Explained

Contract Identification

• award_id: Unique contract identifier
• title: Contract description/scope
• award_type: Contract, grant, loan, or direct payment

Procurement Parties

• buyer: Awarding federal agency
• sub_agency: Specific sub-agency within buyer
• vendor: Winning contractor/vendor
• vendor_uei: Unique Entity Identifier for vendor

Financial Details

• value: Contract award value (formatted)

Timeline

• start_date: Performance start
• end_date: Performance completion

Classification

• naics_code: Industry classification
• psc_code: Product/service classification
• set_aside: Small business or special program

Competitive Intelligence

• offers: Number of companies that competed
• location: Work location

---

🏛️ Classification Codes

NAICS (North American Industry Classification System)

Examples relevant to procurement:

• 541511: Custom Computer Programming Services
• 541512: Computer Systems Design Services
• 541519: Other Computer Related Services
• 336411: Aircraft Manufacturing
• 334613: Magnetic and Optical Recording Media Manufacturing

PSC (Product/Service Code)

Examples:

• D301: Automatic Data Processing (ADP)
• D310: Information Technology and Telecommunications
• J006: Maintenance, Repair and Renovation of Real Property
• R299: Consultant and Professional Services, Other
• S799: Other Supplies and Services

---

🏆 Award Types

The Actor searches across all award types:

• Type A: IDV (Indefinite Delivery) contracts
• Type B: Federal Agency contracts
• Type C: Grants and cooperative agreements
• Type D: Loans and other financial assistance

---

🎯 Use Cases

• Business Development – Identify Public Procurement Intelligence contract opportunities
• Competitive Intelligence – Track competitor contract wins
• Market Research – Analyze government spending trends
• Target Identification – Build list of federal agencies for business development
• Proposal Planning – Research similar contracts before bidding
• Vendor Analysis – Understand competitor wins and contracts
• Compliance Tracking – Monitor regulatory and compliance contracts
• Industry Analysis – Understand government spending by industry
• Contract Intelligence – Research contract values and scopes
• Opportunity Pipeline – Build pipeline of upcoming/active contracts
• Pricing Benchmarking – Compare contract values across similar scopes
• Agency Intelligence – Understand which agencies buy specific services
• Capability Matching – Find contracts matching your capabilities
• Timeline Analysis – Understand contract durations and schedules
• Geographic Analysis – Identify geographic procurement hotspots

---

🚀 Quick Start

1. Prepare Input

Go to Apify Console and enter:

{
  "keyword": "cybersecurity",
  "limit": 50,
  "useApifyProxy": true
}

2. Run the Actor

Click Start button. The Actor will:

• Connect to USASpending.gov API
• Search for contracts matching keyword
• Fetch detailed information for each contract
• Extract comprehensive procurement data
• Deduplicate and push to Dataset

3. Monitor Progress

Console shows:

[USASpending.gov] Searching for procurement leads matching: 'cybersecurity'
Apify Proxy string built and integrated successfully.
Found 48 raw matching contract listings.
Fetching deeper nested award details...
Successfully processed and stored 45 unique procurement leads!

4. View & Download Results

• Results Tab: All procurement contracts with full details
• Export: JSON, CSV, Excel
• Filter: By agency, value, or date
• Sort: By contract value or date

---

⚙️ Configuration

Search Scope

Specific service:

{
  "keyword": "managed IT services"
}

Broader category:

{
  "keyword": "professional services"
}

Result Limits

Quick scan:

{
  "limit": 25
}

Comprehensive:

{
  "limit": 100
}

---

📈 Performance

Processing Speed

• ~2-3 seconds per contract detail fetch
• ~25-100 contracts per search
• Detail fetching dominates processing time
• Rate-limited to 300ms between API calls

Resource Usage

• Memory: ~100-200MB
• CPU: ~30-40% during processing
• Network: ~3-5MB per search
• API calls: 1 search + N details (where N = # results)

---

💰 Billing

Batch Billing

• Billing Model: Batch push (not per-contract PPE)
• Typical Cost: Single operation per search
• Efficiency: High efficiency, bulk processing

---

⚠️ Important Notes

Legal & Compliance

• Fair Use: Respects USASpending.gov ToS and rate limits
• Attribution: Public domain government data
• Accuracy: Data as maintained by federal agencies
• Verification: Information as of database update time
• Rate Limiting: Includes delays to respect API

Data Quality

• Freshness: Near real-time updates from USASpending
• Completeness: Varies by agency reporting quality
• Accuracy: As accurate as federal agency data
• Reliability: Highly reliable, official source
• Verification: Always verify with agency if needed

Best Practices

• Use residential proxies
• Respect API rate limits
• Verify contract details with agencies
• Check vendor UEI validity
• Confirm performance locations
• Review contract modifications
• Subscribe to SAM.gov for bidding
• Register DUNS/UEI before bidding
• Follow FedBizOpps for RFPs
• Understand NAICS/PSC codes
• Comply with small business classifications
• Maintain current registrations

---

---

📦 Changelog

Initial Release:

• USASpending.gov API integration
• Multi-award-type search (A, B, C, D codes)
• Configurable time period search (2023-2026)
• Keyword-based contract search
• Detail API fetching for field enrichment
• Intelligent field extraction from search + detail
• Contract value extraction and formatting
• Performance timeline extraction
• Location compilation (city, state, country)
• NAICS code and description extraction
• PSC code and description extraction
• Set-aside program identification
• Number of offers extraction
• Vendor information extraction (name, UEI)
• Buyer agency extraction (top-tier and sub-agency)
• Award type determination
• Direct USASpending detail URL generation
• Deduplication by award ID
• Results sorted by value (highest first)
• Rate limiting (300ms between detail calls)
• Batch dataset push
• Detailed progress logging
• Comprehensive error handling
• Asyncio executor support

---

🧑‍💻 Support & Feedback

• Issues: Submit via Apify console with keyword
• Documentation: Check Actor details page
• Community: Apify forum discussions
• Feature Requests: Suggest improvements
• Bug Reports: Include keyword and error details

---

💾 Apify Integration

Automatic Features

📄 License & Legal

Terms of Use:

• Use for legitimate business and research
• Respect USASpending.gov ToS
• Public domain data (no copyright restrictions)
• Use data ethically and responsibly
• Comply with federal procurement regulations

Disclaimer: Public Procurement Intelligence Hub is provided as-is for research purposes. Users are responsible for compliance with USASpending.gov ToS and applicable procurement regulations. Always verify contract details with official sources and USASpending.gov database.

---

🎉 Get Started Today

Deploy now for Public Procurement Intelligence research!

Use for:

• 📊 Opportunity Discovery
• 🔍 Competitive Intelligence
• 💡 Market Research
• 📈 Trend Analysis
• 🎯 Business Development

Perfect for:

• Contractors
• Consultants
• Business Development
• Market Researchers
• Procurement Analysts

---

Last Updated: February 2025
Version: 1.0.0
Status: Production Ready
Platform: Apify Actor
Architecture: Async/Await
Python: 3.8+
API Source: USASpending.gov

---

📚 Related Tools

• Product Recall Monitor
• SaaS Launch Monitor
• Grants & Funding Opportunities Harvester
• News Mention Alert Engine

Your complete Apify-powered Public Procurement Intelligence research solution! 🚀✨

---

🏛️ Procurement Intelligence Excellence

This Actor is optimized for Public Procurement Intelligence research with:

• ✅ USASpending.gov API integration
• ✅ Multi-source data enrichment
• ✅ Comprehensive classification codes
• ✅ Vendor intelligence extraction
• ✅ Competitive intelligence tracking
• ✅ Batch processing efficiency
• ✅ Real-time Dataset push
• ✅ Error recovery
• ✅ Production-ready code

Discover government contracts effortlessly! 💎🚀