OSHA Inspection & Violation Crawler

OSHA Inspection & Violation Crawler

Extract workplace safety inspection records from the OSHA IMIS database, the official U.S. Department of Labor enforcement data system. This crawler collects structured inspection and violation data covering 4M+ records nationwide, making it ideal for safety compliance research, insurance underwriting, legal analysis, and risk assessment.

What Data Does It Extract?

Each scraped inspection record includes:

Field	Description
activity_nr	OSHA inspection activity number (unique ID)
estab_name	Establishment / company name
site_address	Inspection site street address
site_city	Inspection site city
site_state	Inspection site state abbreviation
site_zip	Inspection site ZIP code
sic_code	Standard Industrial Classification code
naics_code	North American Industry Classification System code
insp_type	Inspection type (Planned, Complaint, Referral, Accident, FollowUp)
insp_scope	Inspection scope (Complete, Partial, Records)
open_date	Inspection opening date
close_date	Inspection case close date
case_status	Case status (Open, Closed)
viol_type	Primary violation type (Serious, Willful, Repeat, Other-than-Serious)
gravity	Violation gravity assessment
initial_penalty	Initial assessed penalty amount in USD
current_penalty	Current penalty amount after adjustments in USD
nr_exposed	Number of employees exposed to the hazard
abate_date	Abatement completion date
owner_type	Establishment owner type (Private, Federal, State, Local)
safety_hlth	Whether the violation is Safety or Health related
union_status	Union status of the establishment
nr_instances	Number of violation instances
standard	OSHA standard cited in the violation

How to Use

Configure the crawler with these input parameters:

{
    "maxItems": 500,
    "states": ["AZ", "CA"],
    "dateFrom": "2025-01-01",
    "dateTo": "2025-06-01",
    "inspectionType": "Complaint"
}

Input Fields

• maxItems: Maximum number of inspection records to return. Default: 500.
• states: Array of US state codes (e.g., ["TX", "CA", "NY"]). Leave empty to crawl all 50 states plus DC.
• inspectionType: Filter by inspection type. Options: Planned, Complaint, Referral, Accident, FollowUp. Leave empty for all types.
• dateFrom: Start date for inspection date range filter in YYYY-MM-DD format. Leave empty for no lower bound.
• dateTo: End date for inspection date range filter in YYYY-MM-DD format. Leave empty for no upper bound.
• sicCode: Filter by Standard Industrial Classification code. Leave empty for all industries.

How It Works

The crawler uses a two-phase approach:

1. Listing Discovery: Visits OSHA's industry search pages for each selected state, extracting inspection IDs from result tables and following pagination links.
2. Detail Extraction: For each inspection ID, visits the inspection detail page to extract the full record including violation summaries, penalty amounts, cited standards, and abatement dates.

Data is sourced from the OSHA IMIS (Integrated Management Information System) database, the official federal record system for workplace safety inspections.

Output Example

{
    "activity_nr": "1234567",
    "estab_name": "ABC Manufacturing LLC",
    "site_address": "123 Industrial Blvd",
    "site_city": "Phoenix",
    "site_state": "AZ",
    "site_zip": "85001",
    "sic_code": "3599",
    "naics_code": "332710",
    "insp_type": "Complaint",
    "insp_scope": "Complete",
    "open_date": "2025-03-15",
    "close_date": "2025-06-20",
    "case_status": "Closed",
    "viol_type": "Serious",
    "gravity": null,
    "initial_penalty": 15000,
    "current_penalty": 12500,
    "nr_exposed": 45,
    "abate_date": "2025-05-01",
    "owner_type": "Private",
    "safety_hlth": "Safety",
    "union_status": "NonUnion",
    "nr_instances": 3,
    "standard": "19100147 A01"
}

Important Notes

• Government Site: OSHA's IMIS database is a public government website with no authentication required. Proxies are generally not needed.
• Rate Limiting: The crawler uses conservative concurrency (2-3 concurrent requests) to be respectful of government infrastructure.
• Coverage: The OSHA IMIS database contains 4M+ inspection records spanning decades across all 50 US states and DC, covering every federally-regulated workplace.
• Data Freshness: Records are updated as inspections are opened, violations are cited, and cases are closed. Recent inspections may have incomplete violation data if the case is still open.

Ideal Use Cases

• Insurance Underwriting: Assess workplace safety risk for prospective clients by reviewing their OSHA inspection history and violation severity.
• Safety Consulting: Identify companies with recurring violations to target compliance improvement services.
• Legal Research: Find inspection and penalty data for workplace injury litigation and OSHA citation appeals.
• Regulatory Analysis: Track enforcement trends by region, industry code, or inspection type over time.
• Due Diligence: Screen acquisition targets for workplace safety liabilities and outstanding violations.