# WIOA training provider outcomes scraper - US ETP programs (`retrainmap/etp-programs`) Actor

WIOA training provider outcomes for 70,000+ US programs from the Department of Labor's Training Provider Results index (ETA-9171): provider, program, credential, SOC codes, completion and Q2 employment rates, median earnings, costs. Filter by state, SOC code and employment rate. $5 per 1,000 rows.

- **URL**: https://apify.com/retrainmap/etp-programs.md
- **Developed by:** [RetrainMap Team](https://apify.com/retrainmap) (community)
- **Categories:**
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $5.00 / 1,000 program records

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## WIOA training provider outcomes scraper - US ETP programs

**Returns:** one row per US training program from the DOL Training Provider Results index (70,000+): provider, program, credential, SOC codes, completion and Q2 employment rates, median earnings, cost, length — nulls where DOL suppressed a value.
**Input:** `{ "states": ["NC"], "soc_codes": ["31-9092"], "min_q2_employment_pct": 60, "max_records": 500 }` — every field optional; empty `{}` reads the whole index (~2.5 minutes).
**Price:** $5.00 per 1,000 rows ($0.005 per program row) plus $0.10 per run. Pay per event; no subscription.

One row per training program from the U.S. Department of Labor's **Training Provider
Results** index: the states' WIOA Eligible Training Provider performance reports
(form ETA-9171, OMB 1205-0526) that power https://www.trainingproviderresults.gov/.
70,088 programs on 2026-09-02. Filter by state, SOC occupation code and the reported
second-quarter employment rate; get provider, program, credential, occupation codes,
length, exits, completion and employment rates, median earnings and costs — normalised,
with DOL's suppression markers turned into nulls and listed per row.

**Nothing in this dataset decides anyone's eligibility.** Eligibility for WIOA-funded
training (and for a given program) is decided locally by the state and the local
workforce development board through an American Job Center. Use the rows to compare
programs, then confirm locally.

### Data source and status

| | |
|---|---|
| Publisher | U.S. Department of Labor, Employment and Training Administration |
| Site | https://www.trainingproviderresults.gov/ (About page: "Data on this website reflect training programs approved to be on states' ETP list as of June 30, 2025, covering the period from July 1, 2021, through June 30, 2025.") |
| Bulk file of record | https://www.trainingproviderresults.gov/data/DownloadPrograms.xlsx (data dictionary v4.0: https://www.trainingproviderresults.gov/assets/ETP\_Data\_Dictionary.pdf) |
| What this Actor reads | The site's search index, `https://cxsearch.dol.gov/etp/etp_scorecard_programs` — plain GET requests, keyset-paged on the document id (`nid`), 500 documents per request, at most one request per second |
| Refresh cadence | DOL publishes the ETP reports **once a year** (program-year data; the current release is PY 2024, posted spring 2026). The Actor reads live on every run, so a new release appears in the rows automatically; the row field `snapshot_timestamp` is the fetch time |
| Copyright | Works of the United States Government are not subject to copyright in the U.S. (17 U.S.C. §105). The data are public; please cite DOL as the source |
| Known caveats (DOL's own) | "States with known data quality concerns include: Alabama, Colorado, District of Columbia, Illinois, Louisiana, New Jersey, New York, and Puerto Rico." Oklahoma had not submitted PY 2024 data. Values reported as `-1` are suppressed (small sample, not reported or quality issue) — the Actor writes them as `null` and lists the field names in `suppressed_fields` |

Identification: the DOL web application firewall answers 403 to any User-Agent that
carries a product token, so the request uses the plain Python-urllib client token and
carries the operator's contact address in the standard `From:` header.

### Input

| Field | Type | Meaning |
|---|---|---|
| `states` | array of 2-letter codes | Optional. Empty = the whole index (~145 requests, ~2.5 minutes) |
| `soc_codes` | array of strings | Optional. `31-9092` (also `31-9092.00`, `319092`); a prefix such as `31-` matches the major group. Matched against all three occupation codes a program reports |
| `min_q2_employment_pct` | integer 0–100 | Optional. Drops programs below this Q2 employment rate (all participants) and programs whose rate is suppressed |
| `max_records` | integer | Default 1000. Stop after this many matching rows |
| `request_interval_ms` | integer | Default 1000 (floor 500) |
| `contact_email` | string | Sent in the `From:` header |
| `use_local_snapshot_path` | string | Testing only: read a local `programs_<date>.jsonl` snapshot instead of the index (no network) |

Example — Medical Assistants in North Carolina with at least a 60 % Q2 employment rate:

```json
{ "states": ["NC"], "soc_codes": ["31-9092"], "min_q2_employment_pct": 60, "max_records": 500 }
```

### Output (dataset row)

`provider`, `provider_ref`, `program`, `program_id`, `program_uuid`, `city`, `state`, `zip`,
`address`, `lat`, `lon`, `reporting_state`, `credential`, `entity_type`, `program_format`,
`has_prerequisites`, `soc_codes` (O\*NET-SOC spelling, e.g. `31-9092.00`), `cip_code`,
`length_weeks`, `length_hours`, `total_served`, `exited`, `completed`, `credential_attained`,
`employed_q2`, `employed_q4`, `completed_pct`, `employed_q2_pct`, `median_earnings_q2`,
`avg_ita_cost` (average cost per WIOA participant), `non_wioa_tuition`, `non_wioa_supplies`,
`wioa_served`, `wioa_exiters`, `wioa_completed_pct`, `wioa_employed_q2_pct`,
`wioa_credential_pct`, `program_url`, `description` (first 400 characters),
`suppressed_fields`, `snapshot_timestamp`, `source`.

Percentages are 0–100 (the index stores fractions). A run summary (counts, filters, request
count, the index's own count for the requested states) is stored as `RUN_SUMMARY` in the
run's key-value store.

### Pricing (pay per event)

| Event | Price |
|---|---|
| `run-start` — once per run | $0.10 |
| `program-record` — per row written | $0.005 |

A 500-row state/occupation pull costs $2.60; the whole index (70,088 rows) $350.54.
Rows stop when your run's maximum charge is reached; the run summary says so.

### Operator

Steelyard Ventures LLC (RetrainMap) — info@steelyardclinical.com. The Actor writes only
to its own dataset and key-value store; it stores no credentials and sends nothing else.

# Actor input Schema

## `states` (type: `array`):

Two-letter state or territory codes (the program's field\_state), e.g. NC, TX, PR. Leave empty for the whole index (70,088 programs on 2026-09-02; about 145 requests at one per second).

## `soc_codes` (type: `array`):

Six-digit SOC codes such as 31-9092 (also accepted: 31-9092.00, 319092). A shorter prefix such as 31- matches a whole major group. A program matches when any of the up to three occupation codes it reports matches. Leave empty for no occupation filter.

## `min_q2_employment_pct` (type: `integer`):

Keep only programs whose reported employment rate in the second quarter after exit (all participants) is at least this percentage. Programs whose rate is suppressed by DOL (reported as -1) are dropped when this filter is set.

## `max_records` (type: `integer`):

Stop after this many matching programs have been written.

## `request_interval_ms` (type: `integer`):

Politeness delay towards cxsearch.dol.gov. 1000 ms is half the index's 2 requests/second ceiling; the floor is 500 ms.

## `contact_email` (type: `string`):

Sent in the standard From: request header so the data owner can reach the operator (RFC 9110 s10.1.2). The User-Agent stays the plain Python-urllib client token because the DOL WAF rejects product tokens.

## `use_local_snapshot_path` (type: `string`):

Absolute path to a programs\_<date>.jsonl snapshot written by tpr\_snapshot.py (one program per line, index field names). When set, the Actor reads that file and makes no network request. Only meaningful when running locally with `apify run`.

## Actor input object example

```json
{
  "states": [
    "NC"
  ],
  "soc_codes": [
    "31-9092"
  ],
  "max_records": 1000,
  "request_interval_ms": 1000,
  "contact_email": "info@steelyardclinical.com"
}
```

# Actor output Schema

## `results` (type: `string`):

Every matched program as one row: provider, program, credential, occupation codes, length, completion, employment, earnings, cost.

## `results_csv` (type: `string`):

The same rows as a CSV file.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "states": [
        "NC"
    ],
    "soc_codes": [
        "31-9092"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("retrainmap/etp-programs").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "states": ["NC"],
    "soc_codes": ["31-9092"],
}

# Run the Actor and wait for it to finish
run = client.actor("retrainmap/etp-programs").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "states": [
    "NC"
  ],
  "soc_codes": [
    "31-9092"
  ]
}' |
apify call retrainmap/etp-programs --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,retrainmap/etp-programs"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/xQl80qYpeyRkUeNog/builds/btoU0bzZeSBq56eF5/openapi.json