US SEC EDGAR Filings Scraper

Apify Actor that scrapes SEC EDGAR filings for US public companies. Supports 10-K (annual), 10-Q (quarterly), 8-K (current events), Form 4 (insider trading), 13F-HR (institutional holdings), 13D/13G (activist stakes), and any other SEC form type.

Features

• Search by ticker, CIK, or company name
• XBRL financial data enrichment (revenue, net income, total assets, EPS)
• Form 4 insider trades (owner, relationship, transactions with shares/price)
• 13F institutional holdings (top 50 positions with CUSIP, value, shares)
• 8-K item parsing (extracted item codes and titles)
• AI summaries (optional, powered by OpenAI gpt-4o-mini)
• PostgreSQL persistence with upsert by accession number
• Rate-limited to comply with SEC's 10 req/s policy

Data source

SEC EDGAR (https://www.sec.gov/edgar) -- fully public, no API key required.

SEC requires a User-Agent header with contact info. Set via SEC_USER_AGENT env var or defaults to datamon/1.0 (datamon@example.com).

Usage

Local runner

cd actors/us-sec-edgar
pip install -r requirements.txt

# Basic: search by ticker (no database)
python runner.py --no-db --ticker AAPL --form-types 10-K --max-results 5

# XBRL financial data
python runner.py --no-db --ticker TSLA --form-types 10-K,10-Q --include-xbrl --max-results 3

# Form 4 insider trades
python runner.py --no-db --ticker AAPL --form-types 4 --include-form-data --max-results 5

# 13F institutional holdings (Berkshire Hathaway)
python runner.py --no-db --cik 0001067983 --form-types 13F-HR --include-form-data --max-results 2

# 8-K with parsed items
python runner.py --no-db --ticker AAPL --form-types 8-K --include-form-data --max-results 3

# AI summaries (requires OPENAI_API_KEY)
OPENAI_API_KEY=sk-... python runner.py --no-db --ticker AAPL --form-types 10-K --include-ai-summary --max-results 1

# All enrichments combined
python runner.py --no-db --ticker AAPL --form-types 10-K,10-Q,8-K,4 \
    --include-xbrl --include-form-data --max-results 10

# Search by company name
python runner.py --no-db --search-query "Microsoft" --form-types 10-K --max-results 10

# With database persistence
DATABASE_URL="postgresql+asyncpg://datamon:pass@host:5432/datamon_us_sec_edgar" \
    python runner.py --ticker AAPL --form-types 10-K --max-results 50

Apify run

{
    "ticker": "AAPL",
    "form_types": ["10-K", "4", "8-K"],
    "date_from": "2024-01-01",
    "date_to": "2025-12-31",
    "include_xbrl": true,
    "include_form_data": true,
    "include_ai_summary": false,
    "max_results": 50
}

$apify run --purge

Example output

10-K with XBRL

{
    "cik": "0000320193",
    "company_name": "Apple Inc.",
    "ticker": "AAPL",
    "form_type": "10-K",
    "filing_date": "2024-11-01",
    "accession_number": "0000320193-24-000123",
    "filing_url": "https://www.sec.gov/Archives/edgar/data/320193/...",
    "revenue": 394328000000,
    "net_income": 99803000000,
    "total_assets": 352583000000,
    "eps_basic": 6.15
}

Form 4 (insider trade)

{
    "form_type": "4",
    "insider_data": {
        "owner_name": "WILLIAMS JEFFREY E",
        "owner_cik": "0001214128",
        "is_director": false,
        "is_officer": true,
        "officer_title": "Chief Operating Officer",
        "transactions": [
            {
                "date": "2024-04-01",
                "type": "S",
                "type_label": "Sale",
                "shares": 100000,
                "price_per_share": 170.50,
                "shares_after": 489944,
                "security_title": "Common Stock"
            }
        ]
    }
}

13F (institutional holdings)

{
    "form_type": "13F-HR",
    "holdings_data": {
        "total_value": 347691992000,
        "total_holdings": 41,
        "top_holdings": [
            {
                "issuer": "APPLE INC",
                "cusip": "037833100",
                "value": 91200000000,
                "shares": 400000000,
                "share_type": "SH"
            }
        ]
    }
}

8-K (current report items)

{
    "form_type": "8-K",
    "items_data": {
        "items": [
            {"code": "2.02", "title": "Results of Operations and Financial Condition"},
            {"code": "9.01", "title": "Financial Statements and Exhibits"}
        ]
    }
}

Database

• Database: datamon_us_sec_edgar
• Table: filings
• Upsert key: accession_number (unique per filing across all of EDGAR)

Environment variables

Variable	Required	Description
SEC_USER_AGENT	Recommended	User-Agent for SEC requests
DATABASE_URL	For persistence	PostgreSQL connection string
OPENAI_API_KEY	For AI summaries	OpenAI API key

Pricing

$0.40 / 1,000 results