# Siemens SiePortal Scraper — Specs & MPN (`crawloop/siemens-sieportal-scraper`) Actor Scrape Siemens SiePortal (Industry Mall) by part number (MPN): full specs, lifecycle, document links, accessories & successors. Bypasses Akamai WAF. JSON/CSV export for procurement & engineering teams. - **URL**: https://apify.com/crawloop/siemens-sieportal-scraper.md - **Developed by:** [Andrej Kiva](https://apify.com/crawloop) (community) - **Categories:** E-commerce, Automation, Developer tools - **Stats:** 3 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $5.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Siemens SiePortal Scraper — Specs & MPN > **Crawloop Siemens Automation Suite** — Structured data extraction for Siemens SiePortal (Industry Mall), SIOS, and TED product datasheets. Built for procurement teams, system integrators, and BOM engineering workflows. > > Suite hub: [github.com/PLCSPS-DEV/siemens-sieportal-automation](https://github.com/PLCSPS-DEV/siemens-sieportal-automation) | Discovery | Enrichment | SIOS documents | TED datasheets | | :--- | :--- | :--- | :--- | | [Catalog Crawler](https://apify.com/crawloop/siemens-sieportal-product-catalog-crawler?fpr=guboir) | [SiePortal Scraper](https://apify.com/crawloop/siemens-sieportal-scraper?fpr=guboir) | [Document Downloader](https://apify.com/crawloop/siemens-sieportal-document-downloader?fpr=guboir) | [TED Datasheet Downloader](https://apify.com/crawloop/siemens-datasheet-downloader?fpr=guboir) | | [Category Scraper](https://apify.com/crawloop/siemens-category-scraper?fpr=guboir) | [Lifecycle Tracker](https://apify.com/crawloop/siemens-sieportal-product-lifecycle-tracker?fpr=guboir) | [Document PDF Parser](https://apify.com/crawloop/siemens-sieportal-product-document-pdf-crawler?fpr=guboir) | [TED Datasheet Parser](https://apify.com/crawloop/siemens-datasheet-pdf-crawler?fpr=guboir) | > **Disclaimer:** This is an unofficial integration developed independently of Siemens AG. It is not affiliated with, sponsored by, or endorsed by Siemens AG or any of its subsidiaries. > > **Siemens**, **SiePortal**, **SIMATIC**, and related names are trademarks of Siemens AG. Product data is read from publicly accessible Siemens web sources only; no proprietary databases are redistributed. > > This Actor is provided **for informational and research purposes only** (e.g. procurement research, BOM audits, internal engineering workflows). You are solely responsible for ensuring your use complies with applicable laws, Siemens website terms of use, and your organization's policies. > > No warranty is given as to accuracy, completeness, or continued availability of third-party data. Use at your own risk. Extract complete Siemens product data from **SiePortal** (Industry Mall) by part number (MPN): technical specifications, lifecycle status, document links, and related products (accessories, replacements). Designed for procurement databases, ERP enrichment, and engineering review workflows where a single JSON record per MPN is required. SiePortal is protected by Akamai WAF. This Actor uses stealth browser fingerprinting, dynamic page scrolling for lazy-loaded Angular content, and smart MPN normalization (dashes, case, spacing) to deliver reliable results at scale. ### When to use this Actor Use the **SiePortal Scraper** when you already have a list of Siemens part numbers and need the full product detail page (PDP) in structured JSON — specifications, lifecycle, SIOS document links, and related products in one dataset. For bulk lifecycle screening only, use the [Lifecycle Tracker](https://apify.com/crawloop/siemens-sieportal-product-lifecycle-tracker?fpr=guboir) first (faster and lower cost). For PDF downloads, use the [Document Downloader](https://apify.com/crawloop/siemens-sieportal-document-downloader?fpr=guboir). For compact TED catalog datasheets, use the [TED Datasheet Downloader](https://apify.com/crawloop/siemens-datasheet-downloader?fpr=guboir). ### Siemens Automation Pipeline ```` Phase 1 — Discover MPNs Phase 2 — Screen & enrich Phase 3 — Documents & specs ───────────────────────── ───────────────────────── ───────────────────────────── Catalog Crawler ──┐ ├──► MPN list ──► Lifecycle Tracker ──► SiePortal Scraper ◄── you are here Category Scraper ──┘ │ │ ┌────────────────────────────┴────────────────────────────┐ │ │ ▼ ▼ Document Downloader (SIOS) TED Datasheet Downloader certificates, manuals, CAD compact catalog PDFs │ │ ▼ ▼ Document PDF Parser TED Datasheet Parser specs from SIOS PDFs specs from TED PDFs ```` ### Key Features - **Akamai WAF bypass** — Reliable extraction without 403 Access Denied errors on SiePortal PDPs. - **MPN normalization** — Accepts part numbers with or without dashes, mixed case, and extra spaces. - **Complete specifications** — EAN, UPC, commodity codes, packaging dimensions, net weight, country of origin, compliance data. - **Lifecycle data** — PLM status (Active Product, Phase-out, Discontinued) and successor suggestions on the full PDP. - **Document links** — Manuals, certificates, and engineering files linked from Siemens Industry Online Support (SIOS). - **Related products** — Accessories, similar products, and compatible components from the PDP. ### Input Parameters | Parameter | Description | Default | | :--- | :--- | :--- | | `searchTerms` | **Required.** Siemens part numbers (MPNs) to scrape. One per line. | — | | `maxResultsPerSearch` | Max search results per keyword when one MPN matches multiple products. | `1` | | `proxyConfiguration` | Proxy settings. Apify rotating residential proxies are recommended. | — | #### Input Example ```json { "searchTerms": [ "6ES7193-6BP00-0DA0", "6GK7343-1EX30-0XE0" ], "maxResultsPerSearch": 1, "proxyConfiguration": { "useApifyProxy": true } } ```` ### Output Format ```json { "searchTerm": "6ES7193-6BP00-0DA0", "partNumber": "6ES7193-6BP00-0DA0", "title": "BaseUnits", "description": "SIMATIC ET 200SP, BaseUnit BU15-P16+A0+2D, BU type A0, push-in terminals, without aux. terminals, new load group, WxH: 15x 117 mm", "lifecycleStatus": "Active Product", "imageUrl": "https://mall.industry.siemens.com/mall/collaterals/files/201/jpg/04/84/P_ST70_XX_05989t.jpg", "pdpUrl": "https://sieportal.siemens.com/en-nl/products-services/detail/6ES7193-6BP00-0DA0", "specifications": { "Article number": "6ES7193-6BP00-0DA0", "Life cycle status": "Active Product", "Product family": "BaseUnits", "EAN": "4025515080855", "UPC": "040892933574", "Commodity Code": "85366990", "Net weight": "0,048 Kg", "Packaging dimensions (L x W x H)": "12,4 x 4,2 x 2,9 cm", "Country of origin": "Germany" }, "documents": [ { "title": "Equipment Manual BaseUnits (english)", "category": "Manual", "url": "https://support.industry.siemens.com/cs/document/110003392/equipment-manual-baseunits-english?lc=en-NL" } ], "relatedProducts": [ { "part_number": "6ES7193-6CP01-2MA0", "description": "SIMATIC ET 200SP, 5 shield terminals, for BaseUnit", "url": "https://sieportal.siemens.com/en-nl/products-services/detail/6ES7193-6CP01-2MA0" } ] } ``` ### Typical Workflow **1. Screen your BOM for obsolete parts** Run the [Lifecycle Tracker](https://apify.com/crawloop/siemens-sieportal-product-lifecycle-tracker?fpr=guboir) on your full MPN list. Filter results where `isDiscontinued: true` or `hasSuccessor: true`. **2. Pull full details only where it matters** Feed selected MPNs — especially `successors[].partNumber` values — into this Actor for full specifications. For PDF downloads, use the [Document Downloader](https://apify.com/crawloop/siemens-sieportal-document-downloader?fpr=guboir). **3. Build your migration or procurement dataset** Combine lifecycle results with full PDP output: original MPN lifecycle status, successor MPN, full specs, and documentation URLs — ready for ERP import or engineering review. ``` BOM (800 MPNs) │ ▼ Lifecycle Tracker → 52 discontinued, 18 with successors │ ▼ SiePortal Scraper (18 successor MPNs) → specs, EAN, manuals, accessories ``` ### Actor Comparison | Task | SiePortal Scraper | Lifecycle Tracker | Document Downloader | | :--- | :---: | :---: | :---: | | Full specs, EAN, accessories | Yes | No | No | | Bulk lifecycle screening | No | Yes | No | | Official successor MPN | Partial | Yes | No | | Download PDF files | No | No | Yes | | 1,000+ MPN obsolescence audit | No | Yes | No | ### Pricing Pay-per-event billing. You are charged only for successfully delivered dataset items; `NOT_FOUND` and `FAILED` rows are not billed. | Event | Price | | :--- | :--- | | Actor start | $0.05 per run | | Scraped product | $5.00 / 1,000 results ($0.005 per product) | # Actor input Schema ## `searchTerms` (type: `array`): List of Siemens part numbers to search for. You can write them in any format (with or without dashes, uppercase or lowercase, with spaces). One per line. ## `maxResultsPerSearch` (type: `integer`): The maximum number of matching products to extract for each search term. Default is 1 (exact match). ## `proxyConfiguration` (type: `object`): Specifies proxy servers to bypass Akamai blocks. Using Apify rotating proxies is recommended. ## Actor input object example ```json { "searchTerms": [ "6ES7193-6BP00-0DA0", "6ES7214-1AG40-0XB0" ], "maxResultsPerSearch": 1, "proxyConfiguration": { "useApifyProxy": true } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchTerms": [ "6ES7193-6BP00-0DA0", "6ES7214-1AG40-0XB0" ], "proxyConfiguration": { "useApifyProxy": true } }; // Run the Actor and wait for it to finish const run = await client.actor("crawloop/siemens-sieportal-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchTerms": [ "6ES7193-6BP00-0DA0", "6ES7214-1AG40-0XB0", ], "proxyConfiguration": { "useApifyProxy": True }, } # Run the Actor and wait for it to finish run = client.actor("crawloop/siemens-sieportal-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchTerms": [ "6ES7193-6BP00-0DA0", "6ES7214-1AG40-0XB0" ], "proxyConfiguration": { "useApifyProxy": true } }' | apify call crawloop/siemens-sieportal-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawloop/siemens-sieportal-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Siemens SiePortal Scraper — Specs & MPN", "description": "Scrape Siemens SiePortal (Industry Mall) by part number (MPN): full specs, lifecycle, document links, accessories & successors. Bypasses Akamai WAF. JSON/CSV export for procurement & engineering teams.", "version": "0.1", "x-build-id": "S8G53VF5wPuN3EbeB" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawloop~siemens-sieportal-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawloop-siemens-sieportal-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawloop~siemens-sieportal-scraper/runs": { "post": { "operationId": "runs-sync-crawloop-siemens-sieportal-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawloop~siemens-sieportal-scraper/run-sync": { "post": { "operationId": "run-sync-crawloop-siemens-sieportal-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "searchTerms" ], "properties": { "searchTerms": { "title": "Search Terms (Part Numbers)", "type": "array", "description": "List of Siemens part numbers to search for. You can write them in any format (with or without dashes, uppercase or lowercase, with spaces). One per line.", "items": { "type": "string" } }, "maxResultsPerSearch": { "title": "Max Results Per Search", "minimum": 1, "maximum": 5, "type": "integer", "description": "The maximum number of matching products to extract for each search term. Default is 1 (exact match).", "default": 1 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Specifies proxy servers to bypass Akamai blocks. Using Apify rotating proxies is recommended." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```