SEC EDGAR Scraper

Overview

The SEC EDGAR Scraper is an Apify Actor that automatically retrieves company filings from the U.S. Securities and Exchange Commission (SEC) EDGAR database. It accepts stock tickers or company names, looks up the corresponding CIK (Central Index Key), and fetches recent filings (e.g., 10-K, 10-Q, 8-K) with direct links to the full documents. Whether you need to analyze financial disclosures, monitor regulatory updates, or build a dataset of corporate filings, this actor provides structured data in a reliable, scalable way.

---

Features

• CIK Lookup – Automatically resolves ticker symbols or company names to SEC CIK numbers.
• Multiple Form Types – Configurable list of filing forms (e.g., ["10-K", "10-Q", "8-K"]).
• Batch Processing – Process multiple queries (tickers/names) in a single run.
• Direct Document Links – Returns a URL to the primary filing document (HTML or text).
• Rate-Limit Friendly – Respects SEC's 10 requests/second limit with random delays.
• Proxy Support – Optionally use Apify residential proxies to avoid IP blocking.
• Dataset Integration – Automatically pushes each filing to the Apify dataset for easy export.
• Error Handling – Logs errors and continues processing remaining queries.

---

How It Works

1. Input – Provide a list of stock tickers or company names (e.g., AAPL, Microsoft).
2. CIK Lookup – The actor fetches the SEC company tickers file and matches the input to a CIK number.
3. Submissions Fetch – It requests the company's submissions JSON from data.sec.gov/submissions/CIK{CIK}.json.
4. Filter Filings – It scans recent filings and selects those matching the configured form types.
5. Build Results – For each matching filing, it constructs a URL to the primary document and pushes the data to the dataset.
6. Repeat – Processes all queries with a polite delay between requests.

---

Input

Field	Type	Default	Description
queries	Array of strings	["AAPL", "TSLA"]	List of ticker symbols or company names to search.
form_types	Array of strings	["10-K", "10-Q", "8-K"]	SEC form types to include (e.g., "10-K", "10-Q", "8-K", "20-F").
limit	Integer	40	Maximum number of filings per company.
proxyConfiguration	Object	{}	Apify proxy configuration (e.g., { "proxyGroups": ["RESIDENTIAL"] }).

Example input:

{
  "queries": ["AAPL", "MSFT", "TSLA"],
  "form_types": ["10-K", "10-Q"],
  "limit": 20,
  "proxyConfiguration": {
    "proxyGroups": ["RESIDENTIAL"]
  }
}

---

Output

Each filing is pushed as a separate dataset item with the following fields:

Field	Type	Description
company_name	string	Full company name as listed in SEC data.
ticker	string	Stock ticker symbol (uppercase).
cik	string	SEC Central Index Key (10-digit).
form_type	string	Filing form type (e.g., "10-K").
filing_date	string	Date of filing (YYYY-MM-DD).
filing_url	string	Direct URL to the primary filing document.
accession_no	string	SEC accession number.

Example output:

{
  "company_name": "Apple Inc.",
  "ticker": "AAPL",
  "cik": "0000320193",
  "form_type": "10-K",
  "filing_date": "2024-11-01",
  "filing_url": "https://www.sec.gov/Archives/edgar/data/320193/000032019324000123/aapl-20240928.htm",
  "accession_no": "0000320193-24-000123"
}

---

Use Cases

• Financial Analysis – Extract 10-K and 10-Q filings for fundamental analysis.
• Regulatory Monitoring – Track new filings for companies in your portfolio.
• Data Science – Build datasets of corporate disclosures for machine learning.
• Compliance Research – Quickly locate SEC filings without manual navigation.
• Investment Research – Automate retrieval of financial statements and risk factors.
• Academic Research – Gather structured filings for economic or accounting studies.

---

Quick Start

1. Open on Apify – Visit the actor page and click Try for free.
2. Set Input – Enter ticker symbols or company names in the queries field. Adjust form_types and limit as needed.
3. Enable Proxy (Optional) – Configure proxy groups to avoid rate limiting.
4. Run the Actor – Start the run and monitor progress in the logs.
5. Download Results – Export the dataset as JSON, CSV, or Excel once finished.

You can also call this actor programmatically via the Apify SDK or REST API for integration into your own applications.

---

Technical Stack

• API Endpoints – SEC EDGAR JSON APIs (company_tickers.json, submissions/CIK{CIK}.json)
• HTTP Client – requests with custom headers and optional proxy support
• Proxy – Apify Proxy (residential or datacenter) for reliable access
• Platform – Apify Actor — serverless, scalable, integrated with Dataset and Key-Value Store

---

Changelog

v1.0.0 – Initial Release

• Ticker/CIK lookup via SEC company tickers file
• Fetch recent filings from submissions endpoint
• Filter by form type and limit
• Proxy configuration support
• Dataset integration
• Respects SEC rate limits with random delays

---

Pricing

• Free for basic usage on Apify (up to certain compute limits).
• Paid plans available for higher limits, priority support, and longer runs.
• Proxy credits consumed if residential proxies are enabled.

---

Support & Feedback

• Issues & Ideas – Open a ticket on the Apify Actor issue tracker.
• Documentation – Visit Apify Docs for platform guides.
• SEC API Notes – Do not exceed 10 requests per second. Built-in delays help maintain compliance.

---

Related Tools

Actor	Description
Stock Price Scraper	Fetches real-time and historical stock prices for any ticker symbol.
Financial News Scraper	Extracts financial news headlines and articles from major sources like Reuters, Bloomberg, and Yahoo Finance.
SEC Insider Trading Scraper	Retrieves insider trading filings (Form 3, 4, 5) from SEC EDGAR for any company.
SEC Full-Text Search Scraper	Searches SEC EDGAR full-text search API for keywords across all public filings.
Earnings Calendar Scraper	Tracks upcoming and historical earnings reports for public companies.
Yahoo Finance Scraper	Scrapes financial data, analyst ratings, and company profiles from Yahoo Finance.

---

Disclaimer: This actor accesses publicly available SEC EDGAR data. Please ensure your usage complies with the SEC's website terms and conditions. This actor is intended for research and informational purposes only.