# BidNet Direct Government Bids Scraper (`jungle_synthesizer/bidnetdirect-government-bids-scraper`) Actor Scrape government bid solicitations from BidNet Direct — the US public procurement portal. Filter by keyword, status (open/closed/awarded), and location. Exports bid title, URL, location, publication date, closing date, bid ID, and days remaining. Built for procurement monitoring. - **URL**: https://apify.com/jungle\_synthesizer/bidnetdirect-government-bids-scraper.md - **Developed by:** [BowTiedRaccoon](https://apify.com/jungle_synthesizer) (community) - **Categories:** Automation, Business - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per event This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## BidNet Direct Government Bids Scraper Scrape open, closed, and awarded government bid solicitations from [BidNet Direct](https://www.bidnetdirect.com) — the public procurement portal serving US state, local, and federal agencies. Filter by keyword, status, and location. Export structured bid data for procurement monitoring, vendor research, and deadline tracking. ### What data does it extract? Each record contains the publicly-available fields from the BidNet Direct listing pages: | Field | Description | |-------|-------------| | `bid_id` | Unique numeric solicitation identifier | | `title` | Title of the bid/solicitation | | `detail_url` | Full URL to the bid detail page | | `location` | US state or location of the issuing agency | | `publication_date` | Date the solicitation was published (MM/DD/YYYY) | | `closing_date` | Bid submission deadline (MM/DD/YYYY) | | `days_remaining` | Human-readable time left until closing (e.g. "14 day(s) left") | | `bid_status` | Status: `open`, `closed`, or `awarded` | | `ai_overview` | AI-generated overview of the solicitation (only when `scrapeDetailPages` is enabled) | | `scraped_at` | ISO timestamp of when the record was collected | > **Note:** BidNet Direct requires a paid subscription to access full solicitation details (issuing organization, solicitation number, description, source documents). This actor extracts all publicly-visible fields without requiring login. ### How to use it #### Basic usage — scrape open bids Run with default settings to collect the latest open government bids: ```json { "maxItems": 100, "status": "open" } ```` #### Filter by keyword Find bids matching specific terms like "construction", "IT services", or "road repair": ```json { "keywords": "construction", "status": "open", "maxItems": 50 } ``` #### Scrape closed or awarded bids Change the `status` field to access historical data: ```json { "status": "closed", "maxItems": 200 } ``` #### Use specific URLs Pass BidNet Direct listing or search URLs directly: ```json { "startUrls": ["https://www.bidnetdirect.com/solicitations/open-bids"], "maxItems": 25 } ``` #### Include AI-generated overviews Enable `scrapeDetailPages` to fetch the publicly-visible AI-generated overview from each bid's detail page (doubles the number of requests): ```json { "status": "open", "maxItems": 50, "scrapeDetailPages": true } ``` ### Input parameters | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `maxItems` | integer | 15 | Maximum number of bid records to return | | `status` | string | `open` | Bid status filter: `open`, `closed`, or `awarded` | | `keywords` | string | — | Search keywords to filter bids (e.g. "road construction") | | `startUrls` | array | — | Direct BidNet Direct listing URLs to scrape | | `scrapeDetailPages` | boolean | `false` | Visit each bid's detail page to extract the AI-generated overview | ### Output format Results are saved to the Apify dataset. Each row is a flat JSON object: ```json { "bid_id": "444037408868", "title": "Low VOC Solvent Traffic Paint - 5 Gal pails - white", "detail_url": "https://www.bidnetdirect.com/ohio/solicitations/open-bids/statewide/Low-VOC-Solvent-Traffic-Paint-5-Gal-pails-white/444037408868?origin=0&target=view", "location": "Ohio", "publication_date": "05/26/2026", "closing_date": "06/09/2026", "days_remaining": "14 day(s) left", "bid_status": "open", "ai_overview": null, "scraped_at": "2026-05-26T12:52:13.060Z" } ``` ### Use cases - **Procurement monitoring** — Track new bid opportunities in your industry or region daily - **Vendor research** — Identify government agencies actively procuring goods and services - **Deadline tracking** — Build dashboards showing bids closing within the next N days - **Competitive intelligence** — Monitor awarded contracts to understand market pricing - **Lead generation** — Find agencies seeking vendors in your service area ### Notes - BidNet Direct serves 31,000+ active open solicitations across all US states - Closed bids represent a historical archive useful for pricing research - The actor uses a Chrome browser fingerprint to pass BidNet's user-agent checks - No proxy is required — the site is publicly accessible with a standard browser UA - Full solicitation details (issuing organization, sol#, description, documents) require a BidNet Direct subscription and cannot be extracted by this actor # Actor input Schema ## `sp_intended_usage` (type: `string`): Please describe how you plan to use the data extracted by this crawler. ## `sp_improvement_suggestions` (type: `string`): Provide any feedback or suggestions for improvements. ## `sp_contact` (type: `string`): Provide your email address so we can get in touch with you. ## `maxItems` (type: `integer`): Maximum number of bid records to scrape. Default is 15. ## `keywords` (type: `string`): Search keywords to filter bids (e.g. "construction", "IT services", "road repair"). Leave blank to scrape all bids. ## `status` (type: `string`): Filter by bid status. Options: "open" (default — open solicitations), "closed" (closed/past-deadline bids), "awarded" (awarded contracts). ## `startUrls` (type: `array`): Optional list of specific BidNet Direct listing or search URLs to scrape directly. If provided, the actor scrapes these URLs instead of using the keyword/status filters. ## `scrapeDetailPages` (type: `boolean`): If enabled, the actor visits each bid's detail page to extract the AI-generated overview (when available). This doubles the number of requests but adds richer context. ## Actor input object example ```json { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "maxItems": 10, "status": "open", "startUrls": [ "https://www.bidnetdirect.com/solicitations/open-bids" ], "scrapeDetailPages": false } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "maxItems": 10, "keywords": "", "status": "open", "startUrls": [ "https://www.bidnetdirect.com/solicitations/open-bids" ] }; // Run the Actor and wait for it to finish const run = await client.actor("jungle_synthesizer/bidnetdirect-government-bids-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "maxItems": 10, "keywords": "", "status": "open", "startUrls": ["https://www.bidnetdirect.com/solicitations/open-bids"], } # Run the Actor and wait for it to finish run = client.actor("jungle_synthesizer/bidnetdirect-government-bids-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "sp_intended_usage": "Describe your intended use...", "sp_improvement_suggestions": "Share your suggestions here...", "sp_contact": "Share your email here...", "maxItems": 10, "keywords": "", "status": "open", "startUrls": [ "https://www.bidnetdirect.com/solicitations/open-bids" ] }' | apify call jungle_synthesizer/bidnetdirect-government-bids-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=jungle_synthesizer/bidnetdirect-government-bids-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "BidNet Direct Government Bids Scraper", "description": "Scrape government bid solicitations from BidNet Direct — the US public procurement portal. Filter by keyword, status (open/closed/awarded), and location. Exports bid title, URL, location, publication date, closing date, bid ID, and days remaining. Built for procurement monitoring.", "version": "0.1", "x-build-id": "Jj4T3REu8EWTohnra" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/jungle_synthesizer~bidnetdirect-government-bids-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-jungle_synthesizer-bidnetdirect-government-bids-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/jungle_synthesizer~bidnetdirect-government-bids-scraper/runs": { "post": { "operationId": "runs-sync-jungle_synthesizer-bidnetdirect-government-bids-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/jungle_synthesizer~bidnetdirect-government-bids-scraper/run-sync": { "post": { "operationId": "run-sync-jungle_synthesizer-bidnetdirect-government-bids-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "maxItems" ], "properties": { "sp_intended_usage": { "title": "What is the intended usage of this data?", "minLength": 1, "type": "string", "description": "Please describe how you plan to use the data extracted by this crawler." }, "sp_improvement_suggestions": { "title": "How can we improve this crawler for you?", "minLength": 1, "type": "string", "description": "Provide any feedback or suggestions for improvements." }, "sp_contact": { "title": "Contact Email", "minLength": 1, "type": "string", "description": "Provide your email address so we can get in touch with you." }, "maxItems": { "title": "Max Items", "type": "integer", "description": "Maximum number of bid records to scrape. Default is 15.", "default": 15 }, "keywords": { "title": "Keywords", "type": "string", "description": "Search keywords to filter bids (e.g. \"construction\", \"IT services\", \"road repair\"). Leave blank to scrape all bids." }, "status": { "title": "Bid Status", "enum": [ "open", "closed", "awarded" ], "type": "string", "description": "Filter by bid status. Options: \"open\" (default — open solicitations), \"closed\" (closed/past-deadline bids), \"awarded\" (awarded contracts)." }, "startUrls": { "title": "Start URLs", "type": "array", "description": "Optional list of specific BidNet Direct listing or search URLs to scrape directly. If provided, the actor scrapes these URLs instead of using the keyword/status filters.", "items": { "type": "string" } }, "scrapeDetailPages": { "title": "Scrape Detail Pages", "type": "boolean", "description": "If enabled, the actor visits each bid's detail page to extract the AI-generated overview (when available). This doubles the number of requests but adds richer context.", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```