# Rockwell Product Scraper — Specs & Catalog Numbers (`crawloop/rockwell-product-scraper`) Actor
Enrich Allen-Bradley catalog numbers with full Rockwell product data: specifications, lifecycle status, dimensions, literature links, and optional accessories. HTTP API with JSON/CSV export for engineering and procurement teams.
- **URL**: https://apify.com/crawloop/rockwell-product-scraper.md
- **Developed by:** [Andrej Kiva](https://apify.com/crawloop) (community)
- **Categories:** Developer tools, Automation, Integrations
- **Stats:** 2 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet
## Pricing
from $0.05 / 1,000 product scrapeds
This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event
## What's an Apify Actor?
Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.
In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):
```bash
npm install apify-client
```
In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):
```bash
pip install apify-client
```
In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):
````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash
In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).
If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).
For usage examples, see the [API](#api) section below.
For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).
# README
## Rockwell Product Scraper — Specs & Catalog Numbers
> **Crawloop Rockwell Automation Suite** — Structured data extraction for Rockwell Automation and Allen-Bradley hardware catalog. Built for procurement teams, system integrators, and BOM engineering workflows.
>
> Suite hub: [github.com/PLCSPS-DEV/rockwell-automation](https://github.com/PLCSPS-DEV/rockwell-automation)
>
> Product site: [crawloop.com/rockwell-automation](https://crawloop.com/rockwell-automation.html)
| Discovery | Enrichment | Documents | PDF parsing |
| :--- | :--- | :--- | :--- |
| [Full Catalog Crawler](https://apify.com/crawloop/rockwell-full-catalog-crawler?fpr=guboir) | [Product Scraper](https://apify.com/crawloop/rockwell-product-scraper?fpr=guboir) | [Document Downloader](https://apify.com/crawloop/rockwell-document-downloader?fpr=guboir) | [Datasheet Parser](https://apify.com/crawloop/rockwell-datasheet-parser?fpr=guboir) |
| | [Lifecycle Tracker](https://apify.com/crawloop/rockwell-lifecycle-tracker?fpr=guboir) | | |
> **Disclaimer:** This is an unofficial integration developed independently of Rockwell Automation Inc. It is not affiliated with, sponsored by, or endorsed by Rockwell Automation Inc. or any of its subsidiaries.
>
> **Rockwell Automation**, **Allen-Bradley**, and related names are trademarks of Rockwell Automation Inc. Product data is read from publicly accessible Rockwell web sources only; no proprietary databases are redistributed.
>
> This Actor is provided **for informational and research purposes only** (e.g. procurement research, BOM audits, internal engineering workflows). You are solely responsible for ensuring your use complies with applicable laws, Rockwell website terms of use, and your organization's policies.
>
> No warranty is given as to accuracy, completeness, or continued availability of third-party data. Use at your own risk.
Extract complete Allen-Bradley product data from the Rockwell **product-details** API by catalog number: technical specifications, lifecycle status, document links, dimensions, and related products (accessories, replacements). Designed for procurement databases, ERP enrichment, and engineering review workflows where a single JSON record per catalog number is required.
This Actor uses direct HTTP calls to the Elasticsearch-backed product servlet — no browser required. Session warmup on a family page avoids 403 errors; explicit field lists keep responses fast and reliable.
### When to use this Actor
Use the **Product Scraper** when you already have a list of Allen-Bradley catalog numbers and need the full product detail page (PDP) in structured JSON — specifications, lifecycle, literature links, and related products in one dataset.
For bulk lifecycle screening only, use the [Lifecycle Tracker](https://apify.com/crawloop/rockwell-lifecycle-tracker?fpr=guboir) first (faster and lower cost). For PDF downloads, use the [Document Downloader](https://apify.com/crawloop/rockwell-document-downloader?fpr=guboir). Chain after the [Full Catalog Crawler](https://apify.com/crawloop/rockwell-full-catalog-crawler?fpr=guboir) to enrich discovered SKUs.
### Rockwell Automation Pipeline
````
Phase 1 — Discover SKUs Phase 2 — Screen & enrich Phase 3 — Documents & specs
───────────────────────── ───────────────────────── ─────────────────────────────
Full Catalog Crawler ──┐
├──► catalogNumber list ──► Lifecycle Tracker ──► Product Scraper ◄── you are here
│
┌──────┴──────────────────────────────────────────────────────────────────┐
│ │
▼ ▼
Document Downloader Datasheet Parser
PDFs to Key-Value Store specs from TD PDFs
````
### Key Features
- **HTTP-only** — Direct API calls; no browser or proxy required.
- **Full specs** — `classificationFeaturesArray` normalized to name/value pairs.
- **Lifecycle data** — Status, replacement URL, and successor catalog number on the full PDP.
- **Document links** — Technical data, manuals, and drawings from `literature.rockwellautomation.com`.
- **Accessories** — Optional related products via API.
- **Bulk-friendly** — Parallel requests with configurable delay and concurrency.
### Input Parameters
| Parameter | Description | Default |
| :--- | :--- | :--- |
| `catalogNumbers` | **Required.** Allen-Bradley catalog numbers to scrape. | — |
| `includeAccessories` | Fetch accessories list. | `true` |
| `includeKnowledgeBase` | Fetch technote links. | `false` |
| `concurrencyLimit` | Parallel SKU workers. | `5` |
| `countryCode` | API country code. | `us` |
#### Input Example
```json
{
"catalogNumbers": ["1756-L81E", "25B-E027N104"],
"includeAccessories": true,
"concurrencyLimit": 5
}
````
### Output Format
```json
{
"inputCatalogNumber": "1756-L81E",
"catalogNumber": "1756-L81E",
"title": "ControlLogix 5580 Controller",
"description": "...",
"lifecycle": "ACTIVE",
"brand": "Allen-Bradley",
"series": "ControlLogix",
"pdpUrl": "https://www.rockwellautomation.com/en-us/products/details.1756-L81E.html",
"replacementUrl": null,
"dimensions": { "height": 14.5, "width": 8.9, "length": 13.3, "unit": "CM" },
"documents": [
{
"documentType": "TECHNICAL_DATA",
"title": "1756-L81E Technical Data",
"url": "https://literature.rockwellautomation.com/..."
}
],
"specifications": [
{ "name": "Communication ports", "value": "1 x USB; 1 x SD; Dual Ethernet" }
],
"accessories": [],
"status": "SCRAPED"
}
```
#### Status values
| `status` | Meaning |
| :--- | :--- |
| `SCRAPED` | Full product record retrieved |
| `NOT_FOUND` | Catalog number not found on Rockwell |
| `FAILED` | Processing error |
### Typical Workflow
**1. Screen your BOM for obsolete parts**
Run the [Lifecycle Tracker](https://apify.com/crawloop/rockwell-lifecycle-tracker?fpr=guboir) on your full catalog number list. Filter results where `isDiscontinued: true` or `hasReplacement: true`.
**2. Pull full details only where it matters**
Feed selected catalog numbers — especially `replacementCatalogNumber` values — into this Actor for full specifications. For PDF downloads, use the [Document Downloader](https://apify.com/crawloop/rockwell-document-downloader?fpr=guboir).
**3. Build your migration or procurement dataset**
Combine lifecycle results with full PDP output: original SKU lifecycle status, replacement catalog number, full specs, and documentation URLs — ready for ERP import or engineering review.
```
BOM (800 catalog numbers)
│
▼
Lifecycle Tracker → 52 discontinued, 18 with replacements
│
▼
Product Scraper (18 replacement SKUs) → specs, documents, accessories
```
### Actor Comparison
| Task | Product Scraper | Lifecycle Tracker | Document Downloader |
| :--- | :---: | :---: | :---: |
| Full specs, dimensions, accessories | Yes | No | No |
| Bulk lifecycle screening | No | Yes | No |
| Replacement catalog number | Partial | Yes | No |
| Download PDF files | No | No | Yes |
| 1,000+ SKU obsolescence audit | No | Yes | No |
### Pricing
Pay-per-event billing. You are charged only for successfully scraped products (`status: SCRAPED`); `NOT_FOUND` and `FAILED` rows are not billed.
**Current Store setup (until pricing unlock — 18 July 2026):**
| Event | Price |
| :--- | :--- |
| Actor start | $0.05 per run |
| Scraped product (`scraped-product`) | $0.05 per product |
**Target setup (after 18 July 2026 — configure in Publication tab):**
| Event | Price |
| :--- | :--- |
| Actor start | $0.05 per run |
| Scraped product (`scraped-product`) | $5.00 / 1,000 ($0.005 per product) |
See [Rockwell PPE migration checklist](../../docs/rockwell_ppe_july2026.md) for the exact Store update steps.
***
**Learn more:** [Product page](https://crawloop.com/products/rockwell-product-scraper.html) · [Suite hub](https://crawloop.com/rockwell-automation.html) · [GitHub docs](https://plcsps-dev.github.io/rockwell-automation/)
**Also from Crawloop Industrial:** [Siemens SiePortal Suite](https://crawloop.com/siemens-automation.html) · [GitHub docs](https://plcsps-dev.github.io/siemens-sieportal-automation/)
# Actor input Schema
## `catalogNumbers` (type: `array`):
Allen-Bradley catalog numbers to scrape. One per line.
Example: 1756-L81E, 25B-E027N104
## `locale` (type: `string`):
Rockwell locale path segment (e.g. en-us).
## `countryCode` (type: `string`):
Country code for product-details API (e.g. us).
## `includeAccessories` (type: `boolean`):
Fetch related accessories for each catalog number.
## `includeKnowledgeBase` (type: `boolean`):
Fetch technote / knowledge-base article links.
## `concurrencyLimit` (type: `integer`):
How many catalog numbers to scrape in parallel.
## `requestDelaySecs` (type: `number`):
Pause between API calls per worker to reduce rate limiting.
## `proxyConfiguration` (type: `object`):
Optional Apify proxy.
## Actor input object example
```json
{
"catalogNumbers": [
"1756-L81E",
"25B-E027N104",
"140G-G3C3-C90"
],
"locale": "en-us",
"countryCode": "us",
"includeAccessories": true,
"includeKnowledgeBase": false,
"concurrencyLimit": 5,
"requestDelaySecs": 0.5,
"proxyConfiguration": {
"useApifyProxy": false
}
}
```
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"catalogNumbers": [
"1756-L81E",
"25B-E027N104",
"140G-G3C3-C90"
],
"locale": "en-us",
"countryCode": "us",
"includeAccessories": true,
"includeKnowledgeBase": false,
"concurrencyLimit": 5,
"requestDelaySecs": 0.5,
"proxyConfiguration": {
"useApifyProxy": false
}
};
// Run the Actor and wait for it to finish
const run = await client.actor("crawloop/rockwell-product-scraper").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = {
"catalogNumbers": [
"1756-L81E",
"25B-E027N104",
"140G-G3C3-C90",
],
"locale": "en-us",
"countryCode": "us",
"includeAccessories": True,
"includeKnowledgeBase": False,
"concurrencyLimit": 5,
"requestDelaySecs": 0.5,
"proxyConfiguration": { "useApifyProxy": False },
}
# Run the Actor and wait for it to finish
run = client.actor("crawloop/rockwell-product-scraper").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"catalogNumbers": [
"1756-L81E",
"25B-E027N104",
"140G-G3C3-C90"
],
"locale": "en-us",
"countryCode": "us",
"includeAccessories": true,
"includeKnowledgeBase": false,
"concurrencyLimit": 5,
"requestDelaySecs": 0.5,
"proxyConfiguration": {
"useApifyProxy": false
}
}' |
apify call crawloop/rockwell-product-scraper --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com/?tools=crawloop/rockwell-product-scraper",
"--header",
"Authorization: Bearer "
]
}
}
}
```
## OpenAPI specification
```json
{
"openapi": "3.0.1",
"info": {
"title": "Rockwell Product Scraper — Specs & Catalog Numbers",
"description": "Enrich Allen-Bradley catalog numbers with full Rockwell product data: specifications, lifecycle status, dimensions, literature links, and optional accessories. HTTP API with JSON/CSV export for engineering and procurement teams.",
"version": "0.2",
"x-build-id": "Hzi276oqBJ5BhSdBg"
},
"servers": [
{
"url": "https://api.apify.com/v2"
}
],
"paths": {
"/acts/crawloop~rockwell-product-scraper/run-sync-get-dataset-items": {
"post": {
"operationId": "run-sync-get-dataset-items-crawloop-rockwell-product-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
},
"/acts/crawloop~rockwell-product-scraper/runs": {
"post": {
"operationId": "runs-sync-crawloop-rockwell-product-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor and returns information about the initiated run in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK",
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/runsResponseSchema"
}
}
}
}
}
}
},
"/acts/crawloop~rockwell-product-scraper/run-sync": {
"post": {
"operationId": "run-sync-crawloop-rockwell-product-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
}
},
"components": {
"schemas": {
"inputSchema": {
"type": "object",
"required": [
"catalogNumbers"
],
"properties": {
"catalogNumbers": {
"title": "Catalog numbers",
"type": "array",
"description": "Allen-Bradley catalog numbers to scrape. One per line.
Example: 1756-L81E, 25B-E027N104",
"items": {
"type": "string"
}
},
"locale": {
"title": "Locale",
"type": "string",
"description": "Rockwell locale path segment (e.g. en-us).",
"default": "en-us"
},
"countryCode": {
"title": "Country code",
"type": "string",
"description": "Country code for product-details API (e.g. us).",
"default": "us"
},
"includeAccessories": {
"title": "Include accessories",
"type": "boolean",
"description": "Fetch related accessories for each catalog number.",
"default": true
},
"includeKnowledgeBase": {
"title": "Include knowledge-base articles",
"type": "boolean",
"description": "Fetch technote / knowledge-base article links.",
"default": false
},
"concurrencyLimit": {
"title": "Parallel requests",
"minimum": 1,
"maximum": 20,
"type": "integer",
"description": "How many catalog numbers to scrape in parallel.",
"default": 5
},
"requestDelaySecs": {
"title": "Delay between requests (seconds)",
"minimum": 0,
"type": "number",
"description": "Pause between API calls per worker to reduce rate limiting.",
"default": 0.5
},
"proxyConfiguration": {
"title": "Proxy",
"type": "object",
"description": "Optional Apify proxy.",
"default": {
"useApifyProxy": false
}
}
}
},
"runsResponseSchema": {
"type": "object",
"properties": {
"data": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"actId": {
"type": "string"
},
"userId": {
"type": "string"
},
"startedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"finishedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"status": {
"type": "string",
"example": "READY"
},
"meta": {
"type": "object",
"properties": {
"origin": {
"type": "string",
"example": "API"
},
"userAgent": {
"type": "string"
}
}
},
"stats": {
"type": "object",
"properties": {
"inputBodyLen": {
"type": "integer",
"example": 2000
},
"rebootCount": {
"type": "integer",
"example": 0
},
"restartCount": {
"type": "integer",
"example": 0
},
"resurrectCount": {
"type": "integer",
"example": 0
},
"computeUnits": {
"type": "integer",
"example": 0
}
}
},
"options": {
"type": "object",
"properties": {
"build": {
"type": "string",
"example": "latest"
},
"timeoutSecs": {
"type": "integer",
"example": 300
},
"memoryMbytes": {
"type": "integer",
"example": 1024
},
"diskMbytes": {
"type": "integer",
"example": 2048
}
}
},
"buildId": {
"type": "string"
},
"defaultKeyValueStoreId": {
"type": "string"
},
"defaultDatasetId": {
"type": "string"
},
"defaultRequestQueueId": {
"type": "string"
},
"buildNumber": {
"type": "string",
"example": "1.0.0"
},
"containerUrl": {
"type": "string"
},
"usage": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "integer",
"example": 1
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
},
"usageTotalUsd": {
"type": "number",
"example": 0.00005
},
"usageUsd": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "number",
"example": 0.00005
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
}
}
}
}
}
}
}
}
```