# Website to Company Profile Scraper (AI Firmographics) (`data-drip/website-company-profile-ai`) Actor

Turn company domains into structured profiles from their own websites: name, description, logo, HQ, social links, pricing/careers pages and tech stack. Optional AI adds industry, products, pricing model and target customers. No personal data.

- **URL**: https://apify.com/data-drip/website-company-profile-ai.md
- **Developed by:** [Ibraheem Ganayim](https://apify.com/data-drip) (community)
- **Categories:** Lead generation, AI, Business
- **Features:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.00 / 1,000 company profiles

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## Website to Company Profile Scraper (AI Firmographics)

**Company Profile Scraper at a glance:** data from the company's own public website (JSON-LD, Open Graph and meta tags) · no login, no browser, no proxies · **$3 per 1,000 company profiles** · optional AI with your own key · JSON, CSV, Excel export, API and MCP ready

### What does the Company Profile Scraper do?

Turn a list of **company domains into structured company profiles** built from each company's **own public website**: company name, legal name, description, logo, language, HQ city and country, official social links, key pages (about, pricing, products, customers, careers) and **tech stack** (Shopify, WordPress, Webflow, HubSpot, Next.js, Stripe...). Turn on the optional **AI firmographics** to add **industry, sub-industry, business model (B2B/B2C), products, pricing model, starting price, target customers and company size**.

A clean, **privacy-first alternative to LinkedIn-based company enrichment**: no people, no emails, no phone numbers, and **robots.txt is always respected**.

### Why this company enrichment scraper?

- **Domain in, profile out**: `stripe.com` → name, description, logo, socials, HQ, tech, key pages
- **Reads structured data** (JSON-LD Organization, Open Graph, meta tags) for high accuracy
- **Visits up to 6 key pages** per site (about, products, pricing, customers, careers)
- **Tech stack detection** from the homepage (CMS, ecommerce, analytics, frameworks, payments)
- **AI firmographics** (optional, your own OpenAI/OpenRouter key)
- **Page text export** for your own LLM / RAG pipeline (contacts stripped)
- **Free for failures**: unreachable or robots-blocked sites are reported but not charged

### Use cases

- **Lead enrichment and CRM hygiene**: fill industry, description and logo for account lists
- **Account-based marketing** segmentation by industry, business model and pricing model
- **Market maps and competitor landscapes**
- **VC and M\&A deal sourcing**: quick profiles for hundreds of startups
- **Sales research**: which prospects have a pricing page, careers page or use Shopify/HubSpot
- **Clean company context for AI agents**

### How to use the Company Profile Scraper

1. Click **Try for free** (or **Start**) on this page and sign in to Apify.
2. Paste company domains or homepage URLs.
3. Choose how many key pages to read per site (about, pricing, careers...).
4. Optionally enable AI firmographics and paste your OpenAI or OpenRouter key.
5. Click **Start**, then download results as JSON, CSV or Excel, or fetch them via the API.

### Input

| Field | Description |
|---|---|
| `domains` | Company domains or URLs, one per line (`stripe.com`, `https://www.notion.so`) |
| `pagesPerSite` | Homepage + key pages to analyse in total (default 3, max 6) |
| `includePageText` | Add cleaned page text (contacts removed) |
| `delayMs` | Delay between requests (default 500 ms) |
| `enableAi`, `llmProvider`, `llmApiKey`, `llmModel` | Optional AI firmographics with your own key |

```json
{ "domains": ["stripe.com", "posthog.com", "notion.so"], "pagesPerSite": 3, "enableAi": true, "llmApiKey": "sk-..." }
```

### Output example

One row per company profile, straight from the company's own public website (JSON-LD, Open Graph and meta tags):

```json
{
  "domain": "posthog.com",
  "inputUrl": "posthog.com",
  "finalUrl": "https://posthog.com/",
  "status": "ok",
  "name": "PostHog",
  "legalName": null,
  "title": "PostHog – Your product's context layer",
  "description": "PostHog automatically diagnoses problems, fixes bugs, and generates pull requests – all without you having to prompt it.",
  "language": "en",
  "logo": "https://posthog.com/brand/posthog-logo-stacked.png",
  "foundingDate": null,
  "hqCity": "San Francisco",
  "hqCountry": "US",
  "socialLinks": { "x": "https://twitter.com/PostHog", "github": "https://github.com/PostHog" },
  "keyPages": {
    "pricing": "https://posthog.com/pricing",
    "about": "https://posthog.com/about",
    "careers": "https://posthog.com/careers",
    "products": "https://posthog.com/products",
    "customers": "https://posthog.com/customers"
  },
  "hasPricingPage": true,
  "hasCareersPage": true,
  "technologies": ["Gatsby"],
  "pagesAnalyzed": ["https://posthog.com/", "https://posthog.com/about", "https://posthog.com/products"],
  "ai": {
    "companyName": "PostHog",
    "oneLiner": "All-in-one product analytics and developer platform.",
    "industry": "Software",
    "subIndustry": "Product analytics",
    "businessModel": "B2B",
    "products": ["Product analytics", "Session replay", "Feature flags", "Experiments", "Error tracking"],
    "pricingModel": "usage-based",
    "startingPrice": "Free tier",
    "targetCustomers": ["Startups", "Product engineers", "SaaS companies"],
    "hqCountry": "United States",
    "companySizeHint": "mid-market",
    "keywords": ["product analytics", "session replay", "feature flags", "open source"]
  },
  "scrapedAt": "2026-10-31T20:05:45.885Z"
}
```

Sites that fail return a row like `{ "domain": "...", "status": "unreachable" }` or `"blocked-by-robots-txt"`, free of charge. The `ai` object only appears when AI is enabled with a key (values shown are illustrative).

### How much does it cost?

This Actor uses **pay per event** pricing: you pay only for results saved to your dataset, with no monthly fee. Apify platform compute is included.

| Event | Price |
|---|---|
| Company profile | **$0.003** per company ($3 per 1,000) |
| AI firmographics | **$0.007** per company (plus your own LLM tokens) |

So a full AI-enriched profile costs **$0.01**, a fraction of typical enrichment APIs.

**Examples**

- 1,000 company profiles: **$3**
- 10,000 company profiles: **$30**
- 1,000 company profiles with AI: **$10** plus your LLM tokens (typically cents with `gpt-4o-mini`)

Apify's Free plan includes $5 of monthly usage, enough for about **1,666 company profiles** without AI. Set **Maximum cost per run** in the run options to cap spend; the Actor stops cleanly at the limit.

### Use it via API, Python, n8n, Make or AI agents

Run the Actor and get results in one call (replace `<APIFY_TOKEN>` with your token):

```bash
curl -X POST "https://api.apify.com/v2/acts/data-drip~website-company-profile-ai/run-sync-get-dataset-items?token=<APIFY_TOKEN>" \
  -H 'Content-Type: application/json' \
  -d '{"domains": ["stripe.com", "posthog.com", "notion.so"], "pagesPerSite": 3}'
```

```python
from apify_client import ApifyClient

client = ApifyClient('<APIFY_TOKEN>')
run = client.actor('data-drip/website-company-profile-ai').call(run_input={"domains": ["stripe.com", "posthog.com", "notion.so"], "pagesPerSite": 3})
for item in client.dataset(run['defaultDatasetId']).iterate_items():
    print(item)
```

- **Schedules**: run it hourly, daily or weekly from Apify Schedules.
- **Integrations**: send results to Google Sheets, Slack, Zapier, Make, n8n or a webhook.
- **AI agents (MCP)**: add `data-drip/website-company-profile-ai` as a tool in the Apify MCP server (`https://mcp.apify.com`) for Claude, Cursor and other MCP clients.

### Limitations

- No people, e-mails or phone numbers by design (not a contact scraper).
- Reads server-rendered HTML; a few fully client-rendered sites return thinner profiles.
- Sites that block crawlers in robots.txt are skipped and not charged.

### FAQ

**Is it allowed?** The Actor reads only a company's own public pages, identifies itself with a clear user agent, checks robots.txt before every page and stays on the company's own domain. It collects business information only.

**Does it return emails, phone numbers or employees?** No. This is deliberate: no personal data is collected, and emails or phone numbers inside page text are masked. Social links are limited to the company's official X, Facebook, Instagram, YouTube, GitHub and TikTok accounts.

**Does it work on JavaScript-heavy sites?** It reads server-rendered HTML, structured data and meta tags, which almost every marketing site provides. Fully client-rendered single-page apps may yield a thinner profile.

**Do I need an AI key?** No. Without a key you still get the structured profile from the site's metadata. To enable AI firmographics, paste your own OpenAI or OpenRouter key into **LLM API key** (stored as an encrypted secret). LLM tokens are billed by your provider, not by us.

**Can I schedule it?** Yes. Use Apify Schedules (for example daily) and connect the dataset to Google Sheets, Slack or a webhook to get only fresh company profiles.

**How do I get help or request a feature?** Open an issue on the Actor's **Issues** tab.

***

**Related searches:** company enrichment, domain to company, firmographics, company data scraper, b2b data enrichment, website scraper, tech stack lookup, lead enrichment, crm enrichment, clearbit alternative.

# Actor input Schema

## `domains` (type: `array`):

One company per line: a bare domain (stripe.com) or a full URL.

## `pagesPerSite` (type: `integer`):

Homepage plus up to this many key pages in total (about, products, pricing, customers, careers).

## `includePageText` (type: `boolean`):

Add the cleaned text of every analysed page (contacts stripped). Useful for your own RAG or LLM pipeline.

## `delayMs` (type: `integer`):

Be polite to the websites.

## `enableAi` (type: `boolean`):

Let an LLM read the pages and add industry, sub-industry, business model, products, pricing model, starting price, target customers, HQ country and size hint. Requires your own OpenAI or OpenRouter key.

## `llmProvider` (type: `string`):

Which API your key belongs to.

## `llmApiKey` (type: `string`):

Your OpenAI or OpenRouter API key. Stored encrypted.

## `llmModel` (type: `string`):

Defaults to gpt-4o-mini (OpenAI) or openai/gpt-4o-mini (OpenRouter).

## Actor input object example

```json
{
  "domains": [
    "stripe.com",
    "notion.so"
  ],
  "pagesPerSite": 3,
  "includePageText": false,
  "delayMs": 500,
  "enableAi": false,
  "llmProvider": "openai"
}
```

# Actor output Schema

## `profiles` (type: `string`):

No description

## `aiFirmographics` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "domains": [
        "stripe.com",
        "notion.so"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("data-drip/website-company-profile-ai").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "domains": [
        "stripe.com",
        "notion.so",
    ] }

# Run the Actor and wait for it to finish
run = client.actor("data-drip/website-company-profile-ai").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "domains": [
    "stripe.com",
    "notion.so"
  ]
}' |
apify call data-drip/website-company-profile-ai --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,data-drip/website-company-profile-ai"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/3h1k2du8OgBtBF34a/builds/MamYfHvocsfH3uDlR/openapi.json
