Government Bid Opportunity Scraper

Government Bid Opportunity Scraper turns official public procurement feeds into normalized, scored government bid and contract opportunity signals.

It reads structured government open-data sources, normalizes source-specific rows into one schema, applies deterministic scoring, and returns opportunities with deadline urgency, vendor-fit tags, buyer-fit triage fields, contact fields when source-provided, source health, and a run summary.

The Actor uses public structured sources only. It does not submit bids, guarantee eligibility, verify award likelihood, enrich contacts, send outreach, or replace procurement/legal review.

Why Use It

Procurement portals are valuable but slow to monitor manually. Government Bid Opportunity Scraper is built for vendors, consultants, agencies, and revenue teams that want a repeatable watchlist of fresh public opportunities without scraping portal pages by hand.

Each result is designed to answer practical first-pass questions:

• What is the opportunity?
• Which public source did it come from?
• Which agency posted it?
• When was it posted?
• When is it due?
• What category or procurement type does it appear to fit?
• Is there a source-provided contact?
• How urgent or complete is the record?

What It Does

• Fetches current public solicitations and open bid opportunities from selected official sources.
• Filters out opportunities with already-passed due dates.
• Normalizes agency, title, category, procurement type, status, posted date, due date, contact, and opportunity URL fields.
• Tags likely vendor-fit categories such as construction, IT, professional services, transportation, facilities, supplies, and staffing.
• Scores records by deadline fit, freshness, category fit, completeness, and source confidence.
• Adds optional deterministic buyer-fit triage by buyer profile, preferred tags, and deadline preference.
• Returns ranked opportunity signals with score reasons and risk flags.
• Produces a run summary with per-source health and aggregate counts.

Supported Sources

source id	source	type
nyc_current_solicitations	NYC Current Solicitations	city procurement
la_ramp_open_bids	LA RAMP Open Bid Opportunities	regional procurement

Output Fields

Each dataset item can include:

• opportunityId
• sourceId, sourceName, sourceType, jurisdiction
• sourceRecordId
• agencyName
• title
• category
• procurementType
• status
• postedDate
• dueDate
• daysUntilDue
• contactName, contactEmail, contactPhone
• opportunityUrl
• description
• vendorFitTags
• scoreReasons
• riskFlags
• deadlineScore, freshnessScore, categoryFitScore, completenessScore, sourceConfidenceScore
• opportunityScore
• buyerProfile
• buyerFitScore
• buyerFitBand
• buyerFitReasons
• deadlineFitBand
• qualificationWarnings

A RUN_SUMMARY key-value-store record is also created with selected sources, record counts, source health, category/agency/deadline bands, average score, buyer-fit aggregate fields, qualification warnings, and top vendor-fit tags.

Example Use Cases

• Monitor fresh city and regional procurement opportunities.
• Find open bids by category, agency, or keyword.
• Build a daily or weekly RFP watchlist around supported public feeds.
• Surface deadlines and contact fields from structured official sources.
• Compare open opportunities across supported jurisdictions.
• Feed a downstream procurement research, CRM, or alerting workflow.

Input Fields

field	type	default	description
sources	string array	all supported sources	Official public procurement sources to query.
postedDaysBack	integer	30	Return opportunities posted within this many days where supported.
dueDaysAhead	integer	120	Return opportunities due within this many days where supported.
keywords	string array	none	Optional title/description keywords applied after fetch.
categories	string array	none	Optional category/type filters applied after fetch.
agencies	string array	none	Optional agency/department filters applied after fetch.
maxResultsPerSource	integer	100	Maximum source rows to fetch per selected source.
minOpportunityScore	number	none	Optional minimum deterministic opportunity score.
buyerProfile	string	general_vendor	Optional buyer type for deterministic first-pass fit scoring.
preferredVendorFitTags	string array	none	Optional vendor-fit tags to favor in buyer-fit scoring.
deadlinePreference	string	standard	Optional deadline preference: urgent, standard, or long_horizon.
minimumBuyerFitScore	number	none	Optional minimum buyer-fit score applied after buyer-fit scoring.
includeRawRecord	boolean	false	Include the original source row on each normalized record.

Example Input

{
  "sources": ["nyc_current_solicitations", "la_ramp_open_bids"],
  "postedDaysBack": 30,
  "dueDaysAhead": 120,
  "maxResultsPerSource": 25,
  "buyerProfile": "general_vendor",
  "deadlinePreference": "standard",
  "includeRawRecord": false
}

Pricing Hypothesis

This Actor should be priced higher than generic civic data because each result has explicit procurement timing and budget intent.

Launch recommendation after private validation and a larger local quality review: $0.02/result.

Conservative fallback: $0.01/result if lower-friction first adoption is preferred.

What It Does Not Do

• It does not submit bids.
• It does not guarantee vendor eligibility.
• It does not predict award likelihood.
• It does not enrich decision makers or private contacts.
• It does not send outreach.
• It does not sync CRMs.
• It does not cover all procurement portals.
• It does not provide legal, compliance, or procurement advice.

Government Bid Opportunity Scraper provides public procurement opportunity signals, not qualified bid recommendations.

Claim Boundary

This is an official-source opportunity signal product. buyerFitScore is deterministic first-pass triage based on visible public-source fields, not eligibility, compliance, award likelihood, or advice. Buyers still need to verify eligibility, portal requirements, bid documents, addenda, deadlines, and procurement rules directly with the source agency or portal.