# BidNet Direct Scraper | US Government Bids & RFPs (`trev0n/bidnet-direct-scraper`) Actor

Scrape US government bids and RFPs from BidNet Direct. Search open or closed solicitations by keyword, state, category, agency type and publish date. Get title, state, buyer, dates, AI overview and public details. Monitor only new bids.

- **URL**: https://apify.com/trev0n/bidnet-direct-scraper.md
- **Developed by:** [Paweł](https://apify.com/trev0n) (community)
- **Categories:** Lead generation, Automation, Other
- **Features:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $5.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## 🏛️ BidNet Direct Scraper | US Government Bids & RFPs

🎯 **Find every US government bid, RFP and RFQ on BidNet Direct that matches your trade, and get only the new ones every morning.**

Search open and closed solicitations from state, local, federal and member agencies across all 50 states, DC and US territories. For every bid you get the title, state, agency type, publish date, closing date, days left and a direct link, plus the buyer name on closed bids. Turn on bid details for the AI summary, the exact closing time and every field the bid page shows publicly.

### 🚀 What Does It Do?

This scraper automatically searches BidNet Direct and collects **structured, ready-to-use bid data**. No manual browsing, no copying rows into spreadsheets: set your keywords and filters and hit Start.

💡 **Two modes of operation:**

1. **🔍 Discovery Mode**: enter one or more keywords (roofing, janitorial, IT services...) and narrow by status, state, industry category, agency type and publish date. Huge searches are split automatically so you are not stuck at the site's 10,000-result limit.
2. **📋 Direct URL Mode**: paste any BidNet Direct search page or bid page and get exactly those results.

🔔 **Monitoring mode** remembers what you already saw and returns only **new bids** (and bids whose dates changed) on the next run. Schedule it daily and you have a cheap, automatic new-bids feed for your sales team.

### 👥 Who Is This For?

| 🏢 Use Case                           | 💬 How It Helps                                                                                          |
| ------------------------------------- | -------------------------------------------------------------------------------------------------------- |
| 🏗️ **Contractors & subcontractors**   | Get every new roofing, paving, HVAC or construction bid in your states before your competitors notice it |
| 💼 **Government sales teams**         | Feed fresh RFPs into your CRM every morning and never miss a closing date                                |
| 🧾 **Bid-finding services**           | Build daily or weekly bid alerts for your clients by trade and region                                    |
| 📊 **Market researchers**             | Analyse hundreds of thousands of closed bids by state, buyer, category and season                        |
| 🤝 **Consultants & proposal writers** | Spot opportunities for your clients and see which agencies buy what                                      |
| 🧠 **Data & AI teams**                | Collect clean, dated procurement data for dashboards, lead scoring or models                             |

### ✨ Features

- 🔎 **Keyword search**: one search per keyword, matched against the bid title and text, results merged and deduplicated
- 📂 **Open and closed bids**: live opportunities or millions of past solicitations with the buyer name
- 🗺️ **All states and territories**: filter by one or many of 55 locations, or search the whole country
- 🏷️ **Industry categories**: 20 NAICS-based sectors such as Construction, Utilities or Professional Services
- 🏛️ **Agency type**: state & local, federal or BidNet member agencies
- 📅 **Fresh bids only**: limit to bids published in the last 24 hours or 7 days
- 🧩 **No 10,000-result wall**: big searches are split by state and category automatically
- 📄 **Bid details**: AI overview, exact closing time with time zone, issuing organization, solicitation number and type, delivery point, description, question deadline and contact whenever the bid page shows them
- 🔒 **Honest about locked data**: fields the site reserves for registered members are listed in `lockedFields`, never guessed
- 🔔 **New-bid monitoring**: only NEW, CHANGED or REAPPEARED bids on repeat runs, up to 95% cheaper for daily schedules
- ⚡ **Fast & Scalable**: 25 bids per page, thousands of bids per run
- 🧹 **Deduplication**: every bid appears once, even across keywords and split searches
- 📤 **Export Anywhere**: Download results as JSON, CSV, Excel, or push to Google Sheets, Zapier, Make, or your CRM

### 🎛️ Filters & Options

| Option                                   | What It Does                                                               |
| ---------------------------------------- | -------------------------------------------------------------------------- |
| 🔎 **Keywords**                          | One search per keyword; leave empty to list every bid matching the filters |
| 📂 **Bid status**                        | Open bids (accepting responses) or closed bids (history with buyer name)   |
| 🗺️ **States**                            | Only bids from the selected states or territories                          |
| 🏷️ **Categories**                        | Only bids in the selected industry categories                              |
| 🏛️ **Agency type**                       | All, state & local, federal or BidNet member agencies                      |
| 📅 **Published within**                  | Any time, last 24 hours or last 7 days                                     |
| 📄 **Fetch bid details**                 | Open each bid page for the AI overview, exact dates and public details     |
| 🔢 **Max results**                       | Control how many bids to extract per run (0 = no limit)                    |
| 📑 **Max pages per search**              | Stop each search after a number of result pages                            |
| 🧩 **Split very large searches**         | Automatically split searches above 10,000 results                          |
| 🧹 **Skip empty fields**                 | Leave out fields without a value                                           |
| 🔔 **Only new bids (monitoring)**        | Return only bids that are new or changed since the last run                |
| 🗝️ **Monitoring name**                   | Keep one saved baseline under a name you choose                            |
| ♻️ **Also output unchanged bids**        | Monitoring: include bids you have already seen                             |
| ⌛ **Also output bids that disappeared** | Monitoring: include bids that dropped out of the search                    |
| ⚙️ **Speed settings**                    | Parallel requests, requests per minute and retries                         |
| 🛡️ **Proxy**                             | Choose the proxy used for the run                                          |
| 🔗 **Direct URLs**                       | Optionally provide specific BidNet Direct search or bid pages              |

### 📦 What You Get (Output Fields)

Every bid includes:

#### Bid

| Field          | Example                                                                                                                               |
| -------------- | ------------------------------------------------------------------------------------------------------------------------------------- |
| solicitationId | `444239024513`                                                                                                                        |
| title          | `Ralph Richardson Center – Full Site Renovation`                                                                                      |
| url            | `https://www.bidnetdirect.com/california/solicitations/open-bids/statewide/Ralph-Richardson-Center-Full-Site-Renovation/444239024513` |
| status         | `open`                                                                                                                                |
| agencyType     | `State & Local Bids`                                                                                                                  |
| isStatewide    | `true`                                                                                                                                |
| noticeKind     | `notice`                                                                                                                              |

#### Location & Buyer

| Field     | Example                              |
| --------- | ------------------------------------ |
| state     | `California`                         |
| stateSlug | `california`                         |
| buyerName | `Riverbay Corporation` (closed bids) |

#### Dates

| Field         | Example          |
| ------------- | ---------------- |
| publishedDate | `2026-11-17`     |
| closingDate   | `2026-12-15`     |
| daysLeft      | `27`             |
| timeRemaining | `27 day(s) left` |

#### Bid Details (with "Fetch bid details")

| Field               | Example                                                                                                                   |
| ------------------- | ------------------------------------------------------------------------------------------------------------------------- |
| aiOverview          | `The project involves preconstruction services and construction work for a site-wide modernization of seven buildings...` |
| publishedAt         | `2026-11-17T14:42:00-05:00`                                                                                               |
| closingAt           | `2026-12-15T13:00:00-05:00`                                                                                               |
| issuingOrganization | `Riverbay Corporation`                                                                                                    |
| solicitationNumber  | `15057045`                                                                                                                |
| solicitationType    | `RFQ - Request for Quote (Informal)`                                                                                      |
| deliveryPoint       | `175 Dreiser Loop, Bronx, New York 10475`                                                                                 |
| description         | `Paint - PPG Speedhide Semi Bone 6-500 Series, 5Gal`                                                                      |
| questionDeadline    | `2026-11-16T17:00:00-05:00`                                                                                               |
| contactName         | `Doreen Guzman`                                                                                                           |
| documentsCount      | `0`                                                                                                                       |
| lockedFields        | `["Issuing Organization", "Solicitation Number", "Description", "Source"]`                                                |

#### Monitoring & Meta

| Field         | Example                    |
| ------------- | -------------------------- |
| changeType    | `NEW`                      |
| firstSeenAt   | `2026-11-17T20:11:04.532Z` |
| searchKeyword | `roofing`                  |
| contentHash   | `697d35ab745e038a`         |
| scrapedAt     | `2026-11-17T20:11:04.532Z` |

### 📊 Example Output

```json
{
    "solicitationId": "444239024513",
    "title": "Ralph Richardson Center – Full Site Renovation",
    "url": "https://www.bidnetdirect.com/california/solicitations/open-bids/statewide/Ralph-Richardson-Center-Full-Site-Renovation/444239024513",
    "buyerName": null,
    "state": "California",
    "stateSlug": "california",
    "agencyType": "State & Local Bids",
    "isStatewide": true,
    "status": "open",
    "publishedDate": "2026-11-17",
    "closingDate": "2026-12-15",
    "daysLeft": 27,
    "timeRemaining": "27 day(s) left",
    "noticeKind": "notice",
    "searchKeyword": "renovation",
    "aiOverview": "The project involves preconstruction services and construction work for a site-wide modernization of seven buildings and new construction of a three-classroom building with support spaces.",
    "lockedFields": ["Issuing Organization", "Solicitation Number", "Description", "Source"],
    "locationDetail": "California",
    "publishedAt": "2026-11-17T14:42:00-05:00",
    "closingAt": "2026-12-15T13:00:00-05:00",
    "documentsCount": null,
    "issuingOrganizationUrl": null,
    "detailLocked": true,
    "contentHash": "3be0c1f2a9d4e871",
    "scrapedAt": "2026-11-17T20:15:42.118Z"
}
```

### 📋 Dataset Views

The Apify Console gives you **3 ready-made table views** to quickly browse your results:

| View                      | What It Shows                                                                                                                     |
| ------------------------- | --------------------------------------------------------------------------------------------------------------------------------- |
| 📊 **Overview**           | Title, state, agency type, buyer, status, publish and closing dates, days left, keyword and link                                  |
| 📄 **Bid details**        | AI overview, issuing organization, solicitation number and type, exact closing time, description, contact and members-only fields |
| 🔔 **Monitoring changes** | Change type, title, state, dates and when each bid was first seen                                                                 |

### 💡 Example Inputs

🏗️ New roofing and paving bids in Texas and Oklahoma from the last 24 hours:

```json
{
    "keywords": ["roofing", "paving"],
    "states": ["TX", "OK"],
    "publishedWithin": "24h",
    "maxResults": 0
}
```

🔔 Daily feed of new federal janitorial bids (schedule it every morning):

```json
{
    "keywords": ["janitorial"],
    "agencyType": "federal",
    "incremental": true,
    "stateKey": "federal-janitorial",
    "maxResults": 0
}
```

📊 Closed construction bids in California with the buyer name:

```json
{
    "status": "closed",
    "states": ["CA"],
    "categories": ["construction"],
    "maxResults": 5000
}
```

### ❓ FAQ

**🤔 Which bids can I get?**
Every bid listed in the BidNet Direct public search: state and local agencies, federal agencies and BidNet member agencies, open or closed, across all US states, DC, Guam, Puerto Rico and the US Virgin Islands.

**🤔 Why are some detail fields locked?**
BidNet Direct shows the issuing organization, solicitation number, description and documents of many open bids only to registered members. The scraper returns everything the public page shows (including the AI overview and exact closing time) and lists the rest in `lockedFields`. Many closed member-agency bids are fully public and come back with every field.

**🤔 How does "Only new bids" work?**
The first run saves the bids your search returns. Every later run with the same search returns only bids that are new, changed (for example a moved closing date) or back after disappearing. You pay only for those, so daily runs stay cheap.

**🤔 What about searches with more than 10,000 results?**
BidNet Direct lists at most 10,000 results per search. The scraper splits bigger searches by state, and by category when a single state is still too big, so you can collect the whole result set.

**🤔 How fast is it?**
Plan on roughly 5 to 15 minutes per 1,000 bids without details. BidNet Direct often asks visitors to verify themselves, so the scraper keeps a polite pace and, when the site refuses an IP address, switches to another one and carries on; it never solves verification puzzles. Small searches of a few hundred bids usually finish in a minute or two. With bid details on, every bid needs its own page, so allow about one minute per 30 bids.

**🤔 Can I export the data?**
Yes: JSON, CSV, Excel, XML, HTML, RSS. You can also push data directly to Google Sheets, Zapier, Make, or any webhook/API endpoint.

**🤔 How often should I run this?**
For fresh data, run daily or weekly. You can schedule automatic runs on Apify with just a few clicks.

**🤔 Does it work with proxies?**
Yes: the default Apify Proxy works well for this site and is already selected for you.

### 🛠️ Need Custom Filters or Features?

**I'm happy to customize this scraper for your specific needs!** 🤝

Whether you need:

- 🎯 Additional filters (NIGP or NAICS codes, county or city, bid value, specific buyers or purchasing groups)
- 📊 Extra data fields or custom output formats
- 🔄 Integration with your CRM, Google Sheets, or database
- ⏰ Scheduled scraping with automatic deduplication and e-mail or Slack alerts
- 🌐 Scraping from other government bid platforms alongside BidNet Direct

👉 **Don't hesitate to reach out via private message**: I respond quickly and I'm always open to building exactly what you need. No request is too small or too specific!

### ⚖️ Legal & Ethical Use

This scraper collects **only publicly available information** from BidNet Direct. It does not log in, does not access member-only content and does not download bid documents. Please use the data responsibly and in compliance with applicable laws and the platform's terms of service.

# Actor input Schema

## `keywords` (type: `array`):

One search per keyword, matched against the bid title and text (e.g. roofing, janitorial, software). Leave empty to list every bid that matches the filters below.

## `status` (type: `string`):

Open bids are still accepting responses. Closed bids are past solicitations and include the buyer name.

## `states` (type: `array`):

Only bids from these states or territories. Leave empty for the whole US.

## `categories` (type: `array`):

Only bids in these industry categories (NAICS sectors).

## `agencyType` (type: `string`):

Only bids from this kind of buyer.

## `publishedWithin` (type: `string`):

Only bids published recently.

## `startUrls` (type: `array`):

Paste BidNet Direct search result pages (e.g. https://www.bidnetdirect.com/public/solicitations/open?keywords=roof) or individual bid pages. When set, the keyword and filter fields above are ignored.

## `fetchDetails` (type: `boolean`):

Open every bid page for the AI overview, exact closing time with time zone and every public field (issuing organization, solicitation number and type, delivery point, description, contact, question deadline). Fields the site keeps for registered members are listed in lockedFields. One extra page per bid, so slower.

## `maxResults` (type: `integer`):

Maximum number of bids to return across all searches. 0 = no limit.

## `maxPagesPerQuery` (type: `integer`):

Stop each search after this many result pages (25 bids per page). 0 = no limit.

## `splitLargeSearches` (type: `boolean`):

The site shows at most 10,000 results per search. When a search is bigger, it is split automatically by state (and by category if needed) so you can get all of it.

## `compact` (type: `boolean`):

Leave out fields without a value.

## `incremental` (type: `boolean`):

Remember what this search returned last time and output only NEW bids (plus bids whose dates or details changed). Schedule it daily for a cheap new-bids feed. The first run returns everything and saves the baseline.

## `stateKey` (type: `string`):

Optional. Name of the saved baseline. Leave empty to derive it from the search. Use a fixed name to keep the baseline when you tweak the search.

## `emitUnchanged` (type: `boolean`):

Monitoring only. Output bids seen before too, tagged UNCHANGED.

## `emitExpired` (type: `boolean`):

Monitoring only. Output bids that were in the last run but are gone now (closed, cancelled or moved), tagged EXPIRED.

## `maxConcurrency` (type: `integer`):

Parallel requests.

## `maxRequestsPerMinute` (type: `integer`):

Polite rate limit towards the site. BidNet Direct slows down visitors that request pages too fast, so keep this low for big runs.

## `maxRequestRetries` (type: `integer`):

Retries per failed page.

## `proxyConfiguration` (type: `object`):

The default Apify Proxy works for this site. If BidNet Direct refuses an IP address, the scraper switches to another one automatically.

## Actor input object example

```json
{
  "keywords": [
    "roofing"
  ],
  "status": "open",
  "agencyType": "all",
  "publishedWithin": "any",
  "fetchDetails": false,
  "maxResults": 100,
  "maxPagesPerQuery": 0,
  "splitLargeSearches": true,
  "compact": false,
  "incremental": false,
  "emitUnchanged": false,
  "emitExpired": false,
  "maxConcurrency": 2,
  "maxRequestsPerMinute": 30,
  "maxRequestRetries": 8,
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}
```

# Actor output Schema

## `overview` (type: `string`):

No description

## `details` (type: `string`):

No description

## `monitoring` (type: `string`):

No description

## `summary` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "keywords": [
        "roofing"
    ],
    "proxyConfiguration": {
        "useApifyProxy": true
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("trev0n/bidnet-direct-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "keywords": ["roofing"],
    "proxyConfiguration": { "useApifyProxy": True },
}

# Run the Actor and wait for it to finish
run = client.actor("trev0n/bidnet-direct-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "keywords": [
    "roofing"
  ],
  "proxyConfiguration": {
    "useApifyProxy": true
  }
}' |
apify call trev0n/bidnet-direct-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,trev0n/bidnet-direct-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/kVag5HmybUScY6adn/builds/XYVhW0u6AdbFeUsCt/openapi.json
