# BidNet Direct \[Closed 🔴] Bid Opportunities Scraper (`confidential_gnat/bidnetdirect-closed-bid-opportunities-scraper`) Actor Scrapes closed🔴 government bid and RFP solicitations from BidNet Direct, including title, issuing organization, location, publication date, closing date, and days since closing. - **URL**: https://apify.com/confidential\_gnat/bidnetdirect-closed-bid-opportunities-scraper.md - **Developed by:** [ActorFlow](https://apify.com/confidential_gnat) (community) - **Categories:** Developer tools, Automation, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** — the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## BidNet Direct Closed Bid Opportunities Scraper Scrapes closed government bid and RFP solicitations from [BidNet Direct](https://www.bidnetdirect.com), covering both keyword/status search pages and state or agency listing pages. For each closed solicitation it extracts the title, issuing organization, location, solicitation type, description, publication date, closing date, and how many days ago it closed, outputting the results as structured JSON. **This actor only covers closed bids.** For open solicitations, use the companion open-bids actor. https://apify.com/confidential\_gnat/bidnetdirect-open-bid-opportunities-scraper ### ✨ Features - **Closed bid solicitation extraction** — title, bid ID, issuing organization, location, solicitation type, description, publication date, closing date, and days since closing - **Pagination support** — automatically follows listing pages until `maxItems` is reached - **Proxy support** — datacenter proxy by default to avoid blocks ### 🔧 Input Configuration | Field | Type | Required | Default | Description | | --------------------- | ------- | -------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------- | | `startUrls` | array | ✅ | `https://www.bidnetdirect.com/public/solicitations/closed?keywords=water&searchContentGroupId=&solSearchStatus=closedSolicitationsTab&sortBy=&sortDirection=&pageNumberSelect=1` | Search/listing URLs or individual solicitation detail URLs from bidnetdirect.com. | | `maxItems` | integer | — | `5` | Maximum number of solicitations to scrape per start URL. | | `proxyConfiguration` | object | — | Apify residential proxy | Proxy settings used for all requests. | **Supported URL types:** - Keyword/status search pages, e.g. `https://www.bidnetdirect.com/public/solicitations/closed?keywords=water&searchContentGroupId=&solSearchStatus=closedSolicitationsTab&sortBy=&sortDirection=&pageNumberSelect=1` - Individual closed-bid solicitation detail pages, e.g. `https://www.bidnetdirect.com/new-york/riverbaycorporation/solicitations/15056421-Gilmour-Flexogen-5-8-in-x-25-ft-Garden-Hose-Heavy-Duty-Water-Hose-Fle/0000432533` ### 📦 Output One dataset view, **Overview**, gives a compact table of title, bid ID, issuing organization, location, publication date, closing date, status, days since closed, and URL for each solicitation. **Sample output:** ```json { "solicitationTitle": "Gilmour Flexogen 5/8 in x 25 ft Garden Hose, Heavy Duty Water Hose, Fle", "bidId": "0000432533", "referenceNumber": "0000432533", "solicitationNumber": "15056421", "solicitationType": "RFQ - Request for Quote (Informal)", "issuingOrganization": "Riverbay Corporation", "location": "United States, New York, Bronx County", "description": "Gilmour Flexogen 5/8 in x 25 ft Garden Hose, Heavy Duty Water Hose, Flexible and Kink Resistant Outdoor Hose", "publicationDate": "07/31/2026 03:00 PM EDT", "closingDate": "08/04/2026 11:00 AM EDT", "bidStatus": "closed", "daysSinceClosed": 1, "scrapedDate": "2026-08-05T17:56:15.485Z", "searchPageUrl": "https://www.bidnetdirect.com/public/solicitations/closed?keywords=water&searchContentGroupId=&solSearchStatus=closedSolicitationsTab&sortBy=&sortDirection=&pageNumberSelect=1", "url": "https://www.bidnetdirect.com/new-york/riverbaycorporation/solicitations/15056421-Gilmour-Flexogen-5-8-in-x-25-ft-Garden-Hose-Heavy-Duty-Water-Hose-Fle/0000432533?origin=0" } ``` Any field the underlying page does not expose (e.g. `description` on listings without one, or `solicitationType` on a teaser-style page) is returned as `null` rather than an empty string. ### 💡 Uses of This Data - Researching historical award/procurement activity by keyword, agency, or region - Benchmarking typical bid timelines (publication-to-closing windows) for proposal planning - Building a searchable archive of past government solicitations - Identifying recurring buyers and solicitation types for a given product or service category - Feeding closed-bid history into a competitive intelligence or CRM pipeline ### 🚀 How to Use 1. [Sign up](https://apify.com/sign-up) for a free Apify account — includes **$5 monthly credit**. 2. Open the actor page and click **Try for free**. 3. Fill in the **Input** fields (start URL or search query is required). 4. Click **Start** and wait for the run to complete. 5. Download results from the **Output** tab in JSON, CSV, or Excel format. You can also run this actor via the [Apify API](https://docs.apify.com/api/v2) or integrate it directly into your workflows using [Zapier](https://zapier.com/apps/apify), [Make](https://www.make.com/), or [n8n](https://n8n.io/). ### Other Existing Actors | Scraper | Description | |----------|-------------| | [🏛️ BidNet Direct Open Bid Opportunities Scraper](https://apify.com/confidential_gnat/bidnetdirect-open-bid-opportunities-scraper) | Scrapes open government bid and RFP solicitations from BidNet Direct, including title, publication date, closing date and other relevant data. | | [🚗 Cheapest Cars & Bids Scraper](https://apify.com/confidential_gnat/cheapest-carsandbids-scraper) | Scrapes the cheapest vehicle listings from Cars & Bids, making it easy to discover the best-value auction deals. | | [🔍 Incidecoder Scraper](https://apify.com/confidential_gnat/whois-com) | Extracts cosmetic ingredient and product information from Incidecoder for research and analysis. | | [🎟️ Gametime Events Website Scraper](https://apify.com/confidential_gnat/gametime-events-scraper) | Collects event listings, ticket availability, and pricing data from Gametime. | | [🏠 Rightmove Scraper](https://apify.com/confidential_gnat/riccycaunce-rightmove-scrapy) | Extracts property listings, prices, locations, and other real estate details from Rightmove. | ### 📝 Notes - **Proxy recommended for large-scale scraping** — BidNet Direct blocks unproxied traffic at scale, so keep proxy enabled for production runs. - **API integration** — This actor can be called as an API from any automation platform (Zapier, Make, n8n, custom scripts). ### 💬 Support & Contact If you encounter any issues or have questions, please open an issue or reach out via the [Apify Community Forum](https://community.apify.com/). You can also find more actors on the [Apify Store](https://apify.com/store). # Actor input Schema ## `startUrls` (type: `array`): Search/listing URLs or individual solicitation detail URLs from bidnetdirect.com. This actor only covers CLOSED bids — use the open-bids companion actor for open solicitations. The default searches for the keyword "water". ## `maxItems` (type: `integer`): Maximum number of solicitations to scrape per start URL. ## `proxyConfiguration` (type: `object`): BidNet Direct blocks requests without a proxy, so datacenter proxy is used by default. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.bidnetdirect.com/public/solicitations/closed?keywords=water&searchContentGroupId=&solSearchStatus=closedSolicitationsTab&sortBy=&sortDirection=&pageNumberSelect=1" } ], "maxItems": 5, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.bidnetdirect.com/public/solicitations/closed?keywords=water&searchContentGroupId=&solSearchStatus=closedSolicitationsTab&sortBy=&sortDirection=&pageNumberSelect=1" } ], "maxItems": 5, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("confidential_gnat/bidnetdirect-closed-bid-opportunities-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.bidnetdirect.com/public/solicitations/closed?keywords=water&searchContentGroupId=&solSearchStatus=closedSolicitationsTab&sortBy=&sortDirection=&pageNumberSelect=1" }], "maxItems": 5, "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], }, } # Run the Actor and wait for it to finish run = client.actor("confidential_gnat/bidnetdirect-closed-bid-opportunities-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.bidnetdirect.com/public/solicitations/closed?keywords=water&searchContentGroupId=&solSearchStatus=closedSolicitationsTab&sortBy=&sortDirection=&pageNumberSelect=1" } ], "maxItems": 5, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call confidential_gnat/bidnetdirect-closed-bid-opportunities-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,confidential_gnat/bidnetdirect-closed-bid-opportunities-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/av9Gf54nOV1Bhg1IW/builds/dYu0V4ePfNzlUvQaK/openapi.json