# Rockwell Full Catalog Crawler — Allen-Bradley SKUs (`crawloop/rockwell-full-catalog-crawler`) Actor

Discover Allen-Bradley catalog numbers from Rockwell family pages and the product-details API. Export deduplicated SKUs with breadcrumbs, lifecycle hints, and document counts. HTTP-only discovery for procurement and BOM workflows.

- **URL**: https://apify.com/crawloop/rockwell-full-catalog-crawler.md
- **Developed by:** [Andrej Kiva](https://apify.com/crawloop) (community)
- **Categories:** Developer tools, Automation, Integrations
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.00 / 1,000 discovered skus

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## Rockwell Full Catalog Crawler — Allen-Bradley SKUs

> **Crawloop Rockwell Automation Suite** — Structured data extraction for Rockwell Automation and Allen-Bradley hardware catalog. Built for procurement teams, system integrators, and BOM engineering workflows.

| Discovery | Enrichment | Documents | PDF parsing |
| :--- | :--- | :--- | :--- |
| **Full Catalog Crawler** ◄── you are here | [Product Scraper](https://apify.com/crawloop/rockwell-product-scraper) | [Document Downloader](https://apify.com/crawloop/rockwell-document-downloader) | [Datasheet Parser](https://apify.com/crawloop/rockwell-datasheet-parser) |
| | [Lifecycle Tracker](https://apify.com/crawloop/rockwell-lifecycle-tracker) | | |

> **Disclaimer:** This is an unofficial integration developed independently of Rockwell Automation Inc. It is not affiliated with, sponsored by, or endorsed by Rockwell Automation Inc. or any of its subsidiaries.
>
> **Rockwell Automation**, **Allen-Bradley**, and related names are trademarks of Rockwell Automation Inc. Product data is read from publicly accessible Rockwell web sources only; no proprietary databases are redistributed.
>
> This Actor is provided **for informational and research purposes only** (e.g. procurement research, BOM audits, internal engineering workflows). You are solely responsible for ensuring your use complies with applicable laws, Rockwell website terms of use, and your organization's policies.
>
> No warranty is given as to accuracy, completeness, or continued availability of third-party data. Use at your own risk.

**Rockwell catalog crawler** — discover Allen-Bradley hardware catalog numbers by walking family pages and paginating the product-details API. Build SKU inventories for procurement databases, then enrich with Lifecycle Tracker / Product Scraper. HTTP-only; use from Python, Node.js, or MCP.

### When to use this Actor

Use the **Rockwell Full Catalog Crawler** when you need to discover Allen-Bradley catalog numbers across family / PIM categories (large unique SKU sets after deduplication).

For full PDP specifications on a known list, use [Rockwell Product Scraper](https://apify.com/crawloop/rockwell-product-scraper). For bulk lifecycle screening only, use [Rockwell Lifecycle Tracker](https://apify.com/crawloop/rockwell-lifecycle-tracker).

### Key Features

- **Family / PIM discovery** — Enumerate categories and paginate product lists
- **Live API rows** — Catalog numbers fetched from product-details servlet
- **Deduped output** — Optional deduplication of discovered SKUs
- **Lifecycle hints** — Brand, series, document counts when present
- **HTTP-only** — No browser required

### Input Parameters

| Parameter | Description | Default |
| :--- | :--- | :--- |
| `discoveryMode` | Discovery strategy (e.g. `full_sitemap`, `pim_ids`). | `full_sitemap` |
| `pimCategoryIds` | Optional PIM category IDs for targeted discovery. | — |
| `maxFamilyPages` | Max family pages (`0` = until exhausted in some modes). | `3` |
| `deduplicateOutput` | Deduplicate catalog numbers in output. | `true` |

#### Input Example

```json
{
  "discoveryMode": "pim_ids",
  "pimCategoryIds": ["PIM_vfd/25b-powerflex-525,PIM_PF525"],
  "maxFamilyPages": 0,
  "deduplicateOutput": true
}
```

### Output Format

```json
{
  "catalogNumber": "25B-E027N104",
  "title": "PowerFlex 525 AC Drive",
  "lifecycle": "ACTIVE",
  "brand": "Allen-Bradley",
  "series": "PowerFlex 525",
  "documentCount": 12,
  "categoryPath": "Drives / PowerFlex 525",
  "source": "pim",
  "pdpUrl": "https://www.rockwellautomation.com/en-us/products/details.25B-E027N104.html"
}
```

### Use cases

| Use case | What you get |
| :--- | :--- |
| **Catalog inventory** | Deduped Allen-Bradley SKU lists |
| **Family harvest** | Targeted PIM / family discovery |
| **Downstream enrichment** | Input list for Lifecycle / Product scrapers |
| **AI / MCP workflows** | Run via Apify API, clients, or MCP |

### Integration examples

#### Node.js

```javascript
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('crawloop/rockwell-full-catalog-crawler').call({{ discoveryMode: 'pim_ids', pimCategoryIds: ['PIM_vfd/25b-powerflex-525,PIM_PF525'], maxFamilyPages: 0, deduplicateOutput: true }});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items.slice(0, 5));
```

#### Python

```python
from apify_client import ApifyClient

client = ApifyClient(token)
run = client.actor("crawloop/rockwell-full-catalog-crawler").call(
    run_input={{"discoveryMode": "pim_ids", "pimCategoryIds": ["PIM_vfd/25b-powerflex-525,PIM_PF525"], "maxFamilyPages": 0, "deduplicateOutput": True}}
)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item.get("catalogNumber"), item.get("title"), item.get("lifecycle"))
```

#### cURL

```bash
curl "https://api.apify.com/v2/acts/crawloop~rockwell-full-catalog-crawler/runs?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"discoveryMode":"pim_ids","pimCategoryIds":["PIM_vfd/25b-powerflex-525,PIM_PF525"],"maxFamilyPages":0,"deduplicateOutput":true}'
```

### MCP and AI assistants

Use this Actor from AI tools via [Apify MCP](https://docs.apify.com/platform/integrations/mcp). Connect your Apify account, then call `crawloop/rockwell-full-catalog-crawler`.

Example prompts:

- "Run Rockwell Full Catalog Crawler for PowerFlex 525 PIM ids and return catalogNumber, title, lifecycle"
- "Discover Allen-Bradley SKUs for a product family and summarize counts by lifecycle"
- "Chain Full Catalog Crawler then Rockwell Lifecycle Tracker for obsolescence screening"

### Suite next step

Screen discovered SKUs with [Rockwell Lifecycle Tracker](https://apify.com/crawloop/rockwell-lifecycle-tracker), then enrich with [Rockwell Product Scraper](https://apify.com/crawloop/rockwell-product-scraper).

### Related Actors — Rockwell Automation

| Focus | Actor |
| :--- | :--- |
| **Discover Allen-Bradley SKUs** | **Rockwell Full Catalog Crawler** ◄── you are here |
| Bulk lifecycle / successors | [Rockwell Lifecycle Tracker](https://apify.com/crawloop/rockwell-lifecycle-tracker) |
| Full PDP specs & docs links | [Rockwell Product Scraper](https://apify.com/crawloop/rockwell-product-scraper) |
| Download literature PDFs | [Rockwell Document Downloader](https://apify.com/crawloop/rockwell-document-downloader) |
| Parse TD PDFs to JSON | [Rockwell Datasheet Parser](https://apify.com/crawloop/rockwell-datasheet-parser) |

# Actor input Schema

## `discoveryMode` (type: `string`):

<b>Full sitemap</b> — crawl all hardware family pages from sitemap (recommended).<br><b>Family URLs</b> — crawl only provided family/category page URLs.<br><b>PIM IDs</b> — query a specific comma-separated PIM category list directly.

## `startUrls` (type: `array`):

Used when discovery mode is <b>Family page URLs</b>. Full URLs or paths under /products/hardware/.

## `pimCategoryIds` (type: `array`):

Used when discovery mode is <b>Direct PIM category IDs</b>. Example: <code>PIM\_vfd/25b-powerflex-525,PIM\_PF525</code>

## `locale` (type: `string`):

Rockwell locale path segment.

## `countryCode` (type: `string`):

Country code for product-details API (e.g. <code>us</code>).

## `hardwareOnly` (type: `boolean`):

When using sitemap mode, include only /products/hardware/ URLs.

## `maxFamilyPages` (type: `integer`):

For quick tests use <code>3</code>. For full run use <code>0</code> (no limit).

## `numResultsPerPage` (type: `integer`):

Number of products per API request (max 100).

## `concurrencyLimit` (type: `integer`):

How many PIM category queries run in parallel.

## `deduplicateOutput` (type: `boolean`):

Each catalog number appears only once in results.

## `resumeFromCheckpoint` (type: `boolean`):

Skip PIM queries already finished in a previous run.

## `proxyConfiguration` (type: `object`):

Optional Apify proxy. Usually not required for Rockwell catalog API.

## Actor input object example

```json
{
  "discoveryMode": "full_sitemap",
  "startUrls": [
    "https://www.rockwellautomation.com/en-us/products/hardware/vfds-variable-frequency-drives/powerflex-525.html"
  ],
  "pimCategoryIds": [
    "PIM_vfd/25b-powerflex-525,PIM_PF525"
  ],
  "locale": "en-us",
  "countryCode": "us",
  "hardwareOnly": true,
  "maxFamilyPages": 3,
  "numResultsPerPage": 24,
  "concurrencyLimit": 3,
  "deduplicateOutput": true,
  "resumeFromCheckpoint": false,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# Actor output Schema

## `results` (type: `string`):

Default dataset items.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "discoveryMode": "full_sitemap",
    "startUrls": [
        "https://www.rockwellautomation.com/en-us/products/hardware/vfds-variable-frequency-drives/powerflex-525.html"
    ],
    "pimCategoryIds": [
        "PIM_vfd/25b-powerflex-525,PIM_PF525"
    ],
    "locale": "en-us",
    "countryCode": "us",
    "hardwareOnly": true,
    "maxFamilyPages": 3,
    "numResultsPerPage": 24,
    "concurrencyLimit": 3,
    "deduplicateOutput": true,
    "resumeFromCheckpoint": false,
    "proxyConfiguration": {
        "useApifyProxy": false
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("crawloop/rockwell-full-catalog-crawler").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "discoveryMode": "full_sitemap",
    "startUrls": ["https://www.rockwellautomation.com/en-us/products/hardware/vfds-variable-frequency-drives/powerflex-525.html"],
    "pimCategoryIds": ["PIM_vfd/25b-powerflex-525,PIM_PF525"],
    "locale": "en-us",
    "countryCode": "us",
    "hardwareOnly": True,
    "maxFamilyPages": 3,
    "numResultsPerPage": 24,
    "concurrencyLimit": 3,
    "deduplicateOutput": True,
    "resumeFromCheckpoint": False,
    "proxyConfiguration": { "useApifyProxy": False },
}

# Run the Actor and wait for it to finish
run = client.actor("crawloop/rockwell-full-catalog-crawler").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "discoveryMode": "full_sitemap",
  "startUrls": [
    "https://www.rockwellautomation.com/en-us/products/hardware/vfds-variable-frequency-drives/powerflex-525.html"
  ],
  "pimCategoryIds": [
    "PIM_vfd/25b-powerflex-525,PIM_PF525"
  ],
  "locale": "en-us",
  "countryCode": "us",
  "hardwareOnly": true,
  "maxFamilyPages": 3,
  "numResultsPerPage": 24,
  "concurrencyLimit": 3,
  "deduplicateOutput": true,
  "resumeFromCheckpoint": false,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}' |
apify call crawloop/rockwell-full-catalog-crawler --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=crawloop/rockwell-full-catalog-crawler",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/TevJZ1ZD1jLyghjkK/builds/JM79ubdcDERUVJsCu/openapi.json