DirectIndustry Scraper — Industrial Products & Specs

Disclaimer: Unofficial integration for publicly accessible sources. Trademarks belong to their respective owners. Provided for informational use only; users must comply with applicable platform terms and laws.

Crawloop B2B industrial data — product catalogs (DirectIndustry) plus company directories (Europages / WLW).

DirectIndustry (catalog)	Europages (EU directory)	WLW (DACH directory)
DirectIndustry Scraper ◄── you are here	Europages Scraper	WLW Scraper
Products, tech specs, PDF catalogs, manufacturers	EU companies, VAT, contacts	DE / AT / CH suppliers

DirectIndustry scraper for Apify — a practical DirectIndustry API alternative that turns industrial product listings into structured JSON. Extract product title, model, manufacturer, technical characteristics, numeric specifications, images, linked PDF catalogs, and company websites from keyword listings, category pages, manufacturer stands, or direct product URLs.

Built for OEM competitive intelligence, supplier discovery by specs, BOM / sourcing research, and catalog monitoring. Run from the Console, Python, Node.js, or MCP. Fast HTTP crawl via curl_cffi — parses VirtualExpo product payloads (no headless browser).

Use cases

Use case	What you get
Product shortlists by type	Keyword → industrial-manufacturer listing → product rows
Tech-spec comparison	Characteristics (Technology, Medium, ATEX…) plus min/max specs
Manufacturer catalog pull	All products on a stand URL with optional full PDP enrichment
PDF catalog harvest	Linked datasheet / brochure catalog titles and viewer URLs
Website enrichment	External manufacturer website + off-platform product link
Category deep-dive	/cat/ pages expand into child product-type listings

When to use this Actor

• You need DirectIndustry product data as dataset rows (not just company contacts)
• You have keywords, listing URLs, manufacturer stands, or product PDPs
• You want technical characteristics and PDF catalogs alongside titles
• You prefer a browser-free crawl on Apify

When not to use this Actor

• Guaranteed live prices / stock — most listings are RFQ / price-on-request
• Sending RFQs through the portal contact form — this Actor is read-only extraction
• Company-directory firmographics (VAT, phone) — use Europages or WLW instead
• Authenticated MySpace-only fields — public pages only

Key features

• Keyword search — resolves via DirectIndustry kwref sitemaps to listing URLs
• Listing & category URLs — paginated industrial-manufacturer pages; /cat/ expands to children
• Manufacturer stands — crawl all product cards on a company stand
• Product detail enrichment — fetchDetails parses __preloadData__ for full specs
• VirtualExpo portal switch — portal input prepares MedicalExpo / AeroExpo / … hosts
• Streaming results — dataset rows appear while the run is in progress
• Deduped push — unique by portal + productId within a run
• Pagination controls — maxPages + maxItems for predictable run size
• Lightweight & resilient — Chrome TLS fingerprinting, proxy session rotation on WAF challenges

Input parameters

Parameter	Type	Default	Description
searchKeywords	Array	["float level sensor"]	Keywords → kwref listing URLs.
startUrls	Array	[]	Mixed product / manufacturer / listing / category URLs.
listingUrls	Array	[]	industrial-manufacturer and/or /cat/ URLs.
productUrls	Array	[]	Direct product detail URLs.
manufacturerUrls	Array	[]	Manufacturer stand URLs.
portal	String	"directindustry"	VirtualExpo host (directindustry, medicalexpo, …).
fetchDetails	Boolean	true	Open PDPs for specs, description, images, catalogs.
maxItems	Integer	50	Max dataset rows (0 = unlimited within maxPages).
maxPages	Integer	3	Max listing pages per list URL.
concurrency	Integer	3	Parallel PDP workers (1–15).
proxyConfiguration	Object	residential	Apify Proxy settings (residential recommended).

Example — keyword product crawl

{
  "searchKeywords": ["float level sensor"],
  "fetchDetails": true,
  "maxItems": 50,
  "maxPages": 3,
  "concurrency": 3,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": ["RESIDENTIAL"]
  }
}

Example — manufacturer stand + product URLs

{
  "manufacturerUrls": [
    { "url": "https://www.directindustry.com/prod/flygt-113401.html" }
  ],
  "productUrls": [
    { "url": "https://www.directindustry.com/prod/flygt/product-113401-1101505.html" }
  ],
  "fetchDetails": true,
  "maxItems": 100,
  "concurrency": 3
}

Output

Each dataset item is one industrial product.

Field	Description
title / model	Product label and model designation
companyName / companyId	Manufacturer stand name and id
url / companyUrl	Product PDP and manufacturer stand URLs
companyWebsite	External manufacturer website when published
features	Characteristic rows (Technology, Medium, ATEX, …)
specifications	Numeric / range specs (min / max / raw)
images	Product image URLs
catalogs	Linked PDF catalog title, URL, pages, language
description	Full product description from the detail page
category / breadcrumbs	Listing category and navigation path
enriched	true when fields come from a product detail page

Example (illustrative):

{
  "recordType": "product",
  "portal": "directindustry",
  "productId": "1101505",
  "companyId": "113401",
  "title": "Float level sensor",
  "model": "ENM 10",
  "companyName": "FLYGT",
  "groupCompanyName": "Xylem",
  "url": "https://www.directindustry.com/prod/flygt/product-113401-1101505.html",
  "companyUrl": "https://www.directindustry.com/prod/flygt-113401.html",
  "companyWebsite": "https://www.xylem.com/en-us/brands/flygt",
  "description": "PRODUCT FEATURES …",
  "category": "Float level sensor",
  "features": [
    { "name": "Technology", "value": "float" },
    { "name": "Other characteristics", "value": "ATEX, IECEx" }
  ],
  "specifications": [
    {
      "name": "Process temperature",
      "min": "Min.: 0 °C (32 °F)",
      "max": "Max.: 60 °C (140 °F)"
    }
  ],
  "images": ["https://img.directindustry.com/images_di/photo-g/113401-14661051.jpg"],
  "catalogs": [
    {
      "title": "Flygt C-pumps 3068–3800",
      "url": "https://pdf.directindustry.com/pdf/flygt/flygt-c-pumps-3068-3800/113401-865179.html",
      "pages": 8
    }
  ],
  "enriched": true,
  "scrapedAt": "2026-08-05T12:00:00Z"
}

Integration examples

Node.js

import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('crawloop/directindustry-scraper').call({
  searchKeywords: ['float level sensor'],
  fetchDetails: true,
  maxItems: 50,
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items.slice(0, 5));

Python

from apify_client import ApifyClient

client = ApifyClient(token)
run = client.actor("crawloop/directindustry-scraper").call(
    run_input={
        "searchKeywords": ["float level sensor"],
        "fetchDetails": True,
        "maxItems": 50,
    }
)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item.get("title"), item.get("model"), item.get("companyName"))

cURL

curl "https://api.apify.com/v2/acts/crawloop~directindustry-scraper/runs?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"searchKeywords":["float level sensor"],"fetchDetails":true,"maxItems":50}'

MCP and AI assistants

Use this Actor from AI tools via Apify MCP. Connect your Apify account, then call crawloop/directindustry-scraper.

Example prompts:

• "Run DirectIndustry Scraper for keyword float level sensor, max 30, return title, model, companyName, features"
• "Scrape products from a DirectIndustry manufacturer stand URL and summarize ATEX-related specs"
• "Chain DirectIndustry Scraper then Europages Scraper to map product catalogs to EU company contacts"

Suite next step

For Europe-wide company contacts / VAT / firmographics, run Europages Scraper. For DACH-only suppliers, use WLW Scraper.

Related Actors

Actor	Use for
DirectIndustry Scraper ◄── you are here	Industrial product catalog, specs, PDF catalogs
Europages Scraper	Europe-wide B2B directory, multi-locale, VAT & contacts
WLW Scraper	DACH (DE / AT / CH) B2B suppliers from Wer liefert was

FAQ

Is this a DirectIndustry API?
No official public product API is required. This Actor is a DirectIndustry scraper / API alternative that returns structured dataset rows you can call from Python, Node.js, cURL, or MCP.

Does keyword search need exact listing URLs?
No — keywords are matched against DirectIndustry kwref sitemaps (e.g. pump → pump listing). Prefer exact listing URLs when you already have them.

Can I scrape MedicalExpo with the same Actor?
Set portal to medicalexpo (and sister portals). Page patterns are shared across VirtualExpo; DirectIndustry is the primary tested host.

Why are some rows missing phone/email?
This Actor targets product catalog fields. Public RFQ flows do not expose manufacturer phones on product pages the way Europages company profiles do.