💰 OpenPayments Data Scraper

🚀 Supercharge your healthcare payment research with our comprehensive OpenPayments scraper! Automate collection of detailed payment data between healthcare providers and medical companies including research payments, general payments, and ownership/investment interests. Get complete financial relationship data from CMS Open Payments database with support for individual providers, teaching hospitals, and companies. Perfect for healthcare researchers, compliance officers, and transparency advocates who need accurate, up to date payment information without manual work.

Target Audience: Healthcare researchers, compliance officers, transparency advocates, medical journalists, healthcare policy analysts, pharmaceutical company researchers
Primary Use Cases: Payment transparency research, compliance verification, conflict of interest analysis, healthcare financial relationship tracking, medical research funding analysis

📊 What Does OpenPayments Data Scraper Do?

This tool collects comprehensive payment and financial relationship data from the CMS Open Payments database (https://openpaymentsdata.cms.gov/), supporting searches for Individual Providers, Teaching Hospitals, and Companies. It delivers:

• Provider Information: Names, NPI numbers, specialties, addresses, license states
• Payment Details: Transaction amounts, dates, payment types, nature of payments
• Hospital Data: Hospital names, CCN numbers, locations, alternate names
• Company Information: Company names, countries, states, alternate names
• Financial Summaries: Payment summaries by year, filtered summaries, natures of payment
• Additional Parties: Top additional parties involved in transactions
• Complete Profiles: Full entity details with links to official CMS pages

Business Value: Track financial relationships in healthcare, verify compliance, analyze payment patterns, and ensure transparency in medical industry financial interactions. Essential for researchers studying conflicts of interest, compliance officers verifying reporting accuracy, and journalists investigating healthcare financial relationships.

📋 Input

To start OpenPayments web scraping, you have two options:

🔗 Option 1: Use Start URL (Recommended)

Simply copy a search URL from the Open Payments website and paste it into the Start URL field. The scraper will automatically convert the web page URL to the correct API format and extract all parameters including filters and sorting.

How to get a Start URL:

1. Go to https://openpaymentsdata.cms.gov/search
2. Select your search type (Provider, Hospital, or Company)
3. Fill in your desired filters (Country, Name, City, etc.)
4. Click "Search"
5. Copy the URL from your browser's address bar
6. Paste it into the Start URL field in the scraper

Example Start URL:

https://openpaymentsdata.cms.gov/search?searchType=Provider&Country=UNITED+STATES&FirstName=John&LastName=Smith

🔍 Option 2: Use Filter Fields

Alternatively, you can configure filters directly in the input form:

• Search Type - Choose from 👨‍⚕️ Individual Provider, 🏥 Teaching Hospital, or 🏢 Company
• 👨‍⚕️ Individual Provider Filters:
  • Country (dropdown with predefined countries)
  • First Name, Last Name
  • City, Zip Code
  • Provider Type (Physician or Non-Physician Practitioner)
  • NPI (National Provider Identifier)
• 🏥 Teaching Hospital Filters:
  • Hospital Name
  • City
  • Zip Code
• 🏢 Company Filters:
  • Company Name
  • Country (dropdown with predefined countries)
• Max Items - Maximum number of records to collect (required for free users, max 50; optional for paid users, max 1,000,000)

Important: You cannot use both Start URL and filter fields together. Choose one approach.

Here's an example input in JSON format:

{
    "searchType": "individualProvider",
    "individualProviderCountry": "UNITED STATES",
    "individualProviderFirstName": "John",
    "individualProviderLastName": "Smith",
    "maxItems": 100
}

📊 Output

After the Actor finishes its run, you'll get a dataset with the output. The length of the dataset depends on the amount of results you've set. You can download those results as an Excel, HTML, XML, JSON, and CSV document.

The scraper provides three optimized views for different use cases:

👨‍⚕️ Individual Provider View

Perfect for researching payments to specific doctors and healthcare providers. Includes:

• Profile ID and details URL
• Name (First, Last)
• NPI number
• Provider type and specialty
• Location (City, State, Zip, Country)
• Address lines
• Alternate names (as arrays)
• License state codes (as array)
• Payment summaries by year
• Filtered payment summaries
• Natures of payment
• Top additional parties

🏥 Hospital View

Ideal for analyzing payments to teaching hospitals. Includes:

• CCN (CMS Certification Number)
• Details URL
• Hospital name and location
• Address lines (as array)
• Alternate names (as array)
• Payment summaries by year
• Current filters applied
• Filtered payment summaries
• Top additional parties

🏢 Company View

Best for tracking payments from pharmaceutical companies and medical device manufacturers. Includes:

• Company ID
• Details URL
• Company name
• Country and state
• Alternate names (as array)
• Payment summaries by year
• Current filters applied
• Filtered payment summaries
• Natures of payment
• Top additional parties

Here's an example of scraped OpenPayments data you'll get:

{
    "entityProfileId": "9869000",
    "entityProfileType": "Physician",
    "entityFirstName": "NGOC-DIEP",
    "entityNpi": 1336122829,
    "entityDetailsUrl": "https://openpaymentsdata.cms.gov/physician/9869000",
    "entityCity": "ATLANTA",
    "entityState": "GA",
    "entityCountry": "UNITED STATES",
    "entitySpecialty": "Allopathic & Osteopathic Physicians|Internal Medicine|Hematology & Oncology",
    "recipientLicenseStateCodes": ["TX", "OK", "GA"],
    "recipientAlternateFirstNames": ["CATARINA", "NGOC-DIEP"],
    "entitySummaryByAvailableYear": [
        {
            "programYear": "2023",
            "generalTransactions": 1,
            "researchTransactions": 0
        }
    ],
    "entityFilteredSummaryByYear": [...],
    "entityTopFilteredAdditionalParties": [...]
}

What You Get:

• Complete Profile Data: Full provider, hospital, or company information with all identifiers
• Payment Summaries: Comprehensive financial summaries organized by program year
• Transaction Details: Detailed payment records with dates, amounts, and types
• Direct Links: URLs to official CMS Open Payments pages for each entity
• Clean Format: All data organized in friendly, readable field names
• Multiple Views: Choose the view that best fits your analysis needs

Download Options: CSV, Excel, or JSON formats for easy analysis in your preferred tools

⚡ Why Choose the OpenPayments Data Scraper?

• Comprehensive Coverage: Access all three search types (Providers, Hospitals, Companies) in one tool
• Time Savings: Automate hours of manual data collection into minutes
• Accurate Data: Direct access to official CMS Open Payments database ensures data accuracy
• Flexible Searching: Use either web URLs or filter fields
• Complete Profiles: Get full entity details including payment summaries, natures of payment, and additional parties
• Easy Access: Direct links to official CMS pages for verification and deeper research
• Multiple Views: Three optimized views help you focus on the data you need
• Export Options: Download results in CSV, Excel, or JSON for analysis

Time Savings: Instead of manually searching and copying data from hundreds of web pages, collect thousands of records automatically in minutes.

Efficiency: Process entire databases of payment records that would take days manually, in just a few hours of automated collection.

🔧 How to Use

1. Sign Up: Create a free account w/ $5 credit (takes 2 minutes)
2. Find the Scraper: Visit the OpenPayments Data Scraper page
3. Set Input: Choose your search approach:
   • Quick Option: Copy a search URL from openpaymentsdata.cms.gov and paste it into Start URL
   • Filter Option: Select search type and fill in filter fields (Country, Name, City, etc.)
4. Set Limit: Enter the maximum number of records you want (required for free users, max 50)
5. Run It: Click "Start" and let it collect your data
6. Choose View: Access your results in the "Dataset" tab and select from Individual Provider, Hospital, or Company views
7. Download Data: Get your results as CSV, Excel, or JSON

Total Time: About 5 minutes to set up and start, then results are ready as they're collected

No Technical Skills Required: Everything is point and click, just like using the Open Payments website

💼 Business Use Cases

👨‍⚕️ Healthcare Researchers:

• Track payment patterns to identify potential conflicts of interest
• Analyze research funding sources and relationships
• Study financial relationships in specific medical specialties
• Monitor payment trends over time

🛡️ Compliance Officers:

• Verify accurate reporting of payments and financial relationships
• Audit compliance with transparency requirements
• Track payments to verify disclosure accuracy
• Generate compliance reports for regulatory review

📰 Medical Journalists:

• Investigate financial relationships in healthcare
• Research potential conflicts of interest in medical research
• Track payments between pharmaceutical companies and providers
• Analyze payment patterns for investigative reporting

📈 Healthcare Policy Analysts:

• Study the impact of financial relationships on healthcare decisions
• Analyze payment distribution across providers and specialties
• Research the scale and scope of industry payments
• Track changes in payment patterns over time

🏢 Pharmaceutical Company Researchers:

• Monitor competitor payment activities
• Analyze market penetration through provider payments
• Track industry-wide payment trends
• Research payment patterns in specific therapeutic areas

📊 Data Analysts:

• Build comprehensive databases of healthcare financial relationships
• Create regular payment transparency reports
• Support business decisions with payment data
• Analyze payment trends and patterns for insights

❓ Frequently Asked Questions

Q: How does it work?
A: OpenPayments Data Scraper is easy to use and requires no technical knowledge. Simply provide a search URL or configure filter fields, set your record limit, and let the tool collect the data automatically from the CMS Open Payments database.

Q: How accurate is the data?
A: The scraper pulls data directly from the official CMS Open Payments API, ensuring 100% accuracy and alignment with what's available on the openpaymentsdata.cms.gov website.

Q: Can I search for multiple providers, hospitals, or companies at once?
A: Yes! You can use broad filters (like Country, City, or Company Name) to collect data for multiple entities in a single run. The scraper will collect all matching records up to your maxItems limit.

Q: What's the difference between using Start URL and filter fields?
A: Start URL is the quickest option - just copy a search URL from the website. Filter fields give you more control and are better for building searches from scratch. Both produce the same results.

Q: Can I schedule regular runs?
A: Yes! With the Apify API, you can schedule regular data collection runs to keep your payment data up to date automatically.

Q: What if a provider or hospital has multiple records?
A: The scraper collects all payment records matching your criteria. Each record represents a payment transaction. The entity details view shows comprehensive summaries across all transactions.

Q: How are the three views (Individual Provider, Hospital, Company) different?
A: Each view is optimized to show the most relevant fields for that entity type. All fields are available in the full dataset, but the views make it easier to focus on what matters for each type of analysis.

Q: What if I need help?
A: Our support team is here to help you get the most out of this tool. Contact us through the Apify platform for assistance.

Q: Is my data secure?
A: Yes, all data collection happens securely through Apify's platform. Your data and searches remain private and are only accessible to you.

🔌 Integrate OpenPayments Data Scraper with any app and automate your workflow

Last but not least, OpenPayments Data Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform.

These includes:

• Make
• Zapier
• Slack
• Airbyte
• GitHub
• Google Drive
• and much more.

Alternatively, you can use webhooks to carry out an action whenever an event occurs, e.g. get a notification whenever OpenPayments Data Scraper successfully finishes a run.

🔗 Recommended Actors

Looking for more data collection tools? Check out these related actors:

Actor	Description	Link
FINRA BrokerCheck Scraper	Collects financial advisor and broker information from FINRA BrokerCheck	https://apify.com/parseforge/finra-brokercheck-scraper
GSA eLibrary Scraper	Extracts government contract and vendor data from GSA eLibrary	https://apify.com/parseforge/gsa-elibrary-scraper
Greatschools Scraper	Collects school ratings and data from GreatSchools	https://apify.com/parseforge/greatschools-scraper
PR Newswire Scraper	Extracts press releases and news data from PR Newswire	https://apify.com/parseforge/pr-newswire-scraper
Hubspot Marketplace Scraper	Collects business app data from HubSpot marketplace	https://apify.com/parseforge/hubspot-marketplace-scraper

Pro Tip: 💡 Browse our complete collection of data collection actors to find the perfect tool for your business needs.

Need Help? Our support team is here to help you get the most out of this tool.

---

⚠️ Disclaimer: This Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by CMS (Centers for Medicare & Medicaid Services), Open Payments, or any of its subsidiaries. All trademarks mentioned are the property of their respective owners.