# Website Metadata & Social Links Scraper (`codescraper/website-metadata-social-scraper`) Actor Extract social media profiles, SEO metadata, JSON-LD, and tech stacks at scale. Use AI to automatically categorize industries and summarize businesses for B2B lead gen. - **URL**: https://apify.com/codescraper/website-metadata-social-scraper.md - **Developed by:** [CodeScraper](https://apify.com/codescraper) (community) - **Categories:** Lead generation, AI, Social media - **Stats:** 2 total users, 2 monthly users, 100.0% runs succeeded, 1 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $3.00 / 1,000 enrichment successes This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. - **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use). - **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`. - **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`. - **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`. - **Any other language** — the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## ⭐ Website Metadata & Social Links Scraper – B2B Enrichment & Domain Intelligence This Apify Actor is a **blazing-fast, all-in-one domain enrichment tool** designed to extract social media profiles, SEO metadata, JSON-LD structured data, and technology stacks from any website. It supports **AI-powered Business Classification** (powered by lightning-fast Groq models), intelligent deep-link filtering, and multi-page routing to find elusive contact pages. Packaged into a clean, structured dataset, it is built specifically for downstream B2B lead generation, CRM enrichment, and market research workflows. > 💲 **Pricing Note:** This Actor operates on a **predictable flat-rate Pay-Per-Event (PPE)** model. > > - **Standard Extraction:** $0.004 per domain processed (regardless of how many social links are found). > - **AI Enrichment Mode:** $0.008 per domain (if the AI successfully classifies the business). > - *Example: Scraping 1,000 company websites will cost exactly $4.00 (or $8.00 with AI enabled).* *** ### 🚀 What It Does For every website URL or domain provided, the actor crawls the homepage and priority subpages (like `/about` and `/contact`) to extract a comprehensive business profile. #### 🏢 Extracted Data The actor can process and retrieve: - **🔗 Social Media Links** (10+ platforms) - **🏷️ Brand Identity** (Logos & Legal Business Names) - **🤖 AI Business Classification** (Industry, B2B/B2C, Summary) - **⚙️ Technology Stack** (CMS, Frameworks, Analytics) - **📄 SEO Metadata** (Titles, Descriptions, JSON-LD) - **🗺️ Site Architecture** (Robots.txt & Sitemap URLs) *** ### 🤖 AI Business Categorization (Built-In) You do **not** need to provide your own API keys to use the AI features! The Actor has Groq's high-speed LLM infrastructure built directly into it. To use it, simply enable the **AI Classification** toggle in the input settings and select your preferred model: - 🥇 **openai/gpt-oss-120b** (Most Capable) - 🥈 **openai/gpt-oss-20b** (Recommended for speed/accuracy) - 🥉 **qwen/qwen3.6-27b** (Best for non-English sites) - 🚀 **groq/compound** (Ultra-fast bursts) *** ### 🏢 Predefined Industries (Standardized B2B List) In the Actor's input, you can optionally provide a list of **Predefined Industries**. - **If you leave it blank:** The AI will evaluate the website and invent an industry category it thinks fits best. - **If you provide a list:** The AI is forced to map the website to one of *your* exact categories. To ensure your CRM data remains clean and matches platforms like LinkedIn, Apollo, or Lead411, you can copy and paste categories from this standardized list of **113 B2B Industries** into the Actor's input: ```text Accounting Aerospace & Defense Airlines/Aviation Architecture & Planning Automotive Banking Biotechnology Broadcast Media Building Materials Business Consulting and Services Chemical Manufacturing Civil Engineering Computer Hardware Computer Networking Construction Consumer Electronics Consumer Goods Cosmetics Defense & Space Design Services E-Learning Education Administration Programs Education Management Electrical/Electronic Manufacturing Energy & Utilities Engineering Services Entertainment Environmental Services Events Services Facilities Services Farming, Ranching & Forestry Financial Services Food & Beverages Food Production Furniture Government Administration Graphic Design Health, Wellness & Fitness Higher Education Hospital & Health Care Hospitality Human Resources Services Import & Export Industrial Automation Information Services Information Technology & Services Insurance Internet Marketplace Platforms Investment Banking Investment Management IT Services and IT Consulting Law Enforcement Law Practice Legal Services Leisure, Travel & Tourism Logistics & Supply Chain Luxury Goods & Jewelry Machinery Management Consulting Manufacturing & Industrial Market Research Marketing & Advertising Mechanical/Industrial Engineering Media Production Medical Device Mental Health Care Military and International Affairs Mining & Metals Non-Profit Organization Management Oil & Energy Online Media Outsourcing/Offshoring Package/Freight Delivery Packaging & Containers Paper & Forest Products Performing Arts Pharmaceuticals Philanthropy Photography Plastics Primary/Secondary Education Printing Professional Training & Coaching Program Development Public Policy Public Relations & Communications Publishing Real Estate Recreational Facilities & Services Religious Institutions Renewables & Environment Research Services Restaurants Retail Security & Investigations Semiconductors Social Networking Platforms Software Development Sporting Goods Sports Staffing & Recruiting Telecommunications Textiles Translation & Localization Transportation/Trucking/Railroad Utilities Venture Capital & Private Equity Veterinary Warehousing Wholesale Wine & Spirits Wireless Writing & Editing ``` *** ### 📦 Processing Modes #### 🔹 Fast Extraction (Default) Provide a list of URLs and the target social platforms. The actor will traverse the domains, parse the HTML, evaluate the DOM context, and extract precise metadata and social profiles purely via code. #### 🔹 AI Enrichment Mode Enable AI Classification in the input. The actor will scrape the visible text across the website and pass it to our integrated LLM. It will return a highly accurate, structured JSON object defining the company's exact industry, a 1-sentence executive summary, and whether they are a B2B or B2C entity. *** ### 🔗 Intelligent Social Link Extraction The actor goes far beyond simple regex matching. It extracts profiles using: #### Supported Platforms Facebook, Twitter (X), LinkedIn, Instagram, YouTube, TikTok, GitHub, Discord, Reddit, and Pinterest. #### Multi-Layered Discovery - **DOM Context Scanning:** Looks for social icons inside `
`, `