# Walmart Data Extractor (`thenetaji/walmart-data-extractor`) Actor

Walmart Scraper extracts detailed product information and search results from Walmart's website automatically. Use it to save time on market research, price monitoring, and competitive analysis without manual data collection.

- **URL**: https://apify.com/thenetaji/walmart-data-extractor.md
- **Developed by:** [The Netaji](https://apify.com/thenetaji) (community)
- **Categories:** Automation, E-commerce, Developer tools
- **Stats:** 35 total users, 1 monthly users, 62.1% runs succeeded, 1 bookmarks
- **User rating**: 5.00 out of 5 stars

## Pricing

from $1.15 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Walmart Scraper

Extract product details and search results from Walmart.com. Supports direct product URLs, search queries, and paginated search results — with automatic anti-bot bypass via stealth HTTP and browser fallback.

### Features

- Scrape **product pages** — full details, pricing, images, availability, and reviews
- Scrape **search results** — all items across paginated results up to 25 pages (1,000 items)
- Accepts product URLs, search URLs, or plain search queries
- Stealth fetching with residential US proxy — bypasses Walmart's bot detection
- Automatic fallback to headless browser if initial request is blocked

### Input

| Field | Type | Required | Description |
|---|---|---|---|
| `searchTerms` | `string[]` | ✅ | Product URLs (`/ip/...`), search URLs (`search?q=...`), or plain queries |
| `maxItems` | `integer` | ❌ | Max search results to collect (default: `100`, min: `40`) |
| `includeReviews` | `boolean` | ❌ | Include review data for product pages (default: `false`) |

#### Input Example

```json
{
  "searchTerms": [
    "laptop",
    "https://www.walmart.com/search?q=gaming+chair",
    "https://www.walmart.com/ip/Sony-PlayStation-5/4S6KN6TWU0A0"
  ],
  "maxItems": 100,
  "includeReviews": true
}
````

### Output

Every dataset row has a `_type` field indicating which shape the record is:

| `_type` | When | Fields present |
|---|---|---|
| `"product"` | Product URL scraped | `product`, `reviews` |
| `"search"` | Search query/URL scraped | `query`, `item` |

#### Product Output (`_type: "product"`)

```json
{
  "_type": "product",
  "product": {
    "availabilityStatus": "IN_STOCK",
    "averageRating": 4.8,
    "brand": "PlayStation",
    "id": "4S6KN6TWU0A0",
    "name": "Sony PlayStation 5 Video Game Console",
    "shortDescription": "Sony offers the PlayStation 5...",
    "type": "Video Game Consoles",
    "manufacturerName": null,
    "orderLimit": 5,
    "orderMinLimit": 1,
    "priceInfo": {
      "currentPrice": {
        "price": 649.95,
        "priceString": "$649.95",
        "currencyUnit": "USD"
      },
      "isPriceReduced": false
    },
    "imageInfo": {
      "thumbnailUrl": "https://i5.walmartimages.com/seo/...",
      "allImages": [
        { "id": "028D1C...", "url": "https://i5.walmartimages.com/...", "zoomable": true }
      ]
    }
  },
  "reviews": {
    "averageOverallRating": 4.8,
    "totalReviewCount": 4507,
    "reviewSummary": {
      "summary": "Customers praise the console's stunning appearance...",
      "summaryTitle": "Console offers impressive gaming experience"
    },
    "customerReviews": [
      {
        "reviewId": "396282776",
        "rating": 5,
        "reviewSubmissionTime": "8/24/2025",
        "reviewText": "cam in a timely manner my son love it...",
        "userNickname": "Teresa",
        "badges": [{ "id": "VerifiedPurchaser", "glassBadge": { "text": "Verified Purchase" } }]
      }
    ],
    "ratingValueFiveCount": 4096,
    "ratingValueOneCount": 204,
    "percentageFiveCount": 91
  }
}
```

#### Search Output (`_type: "search"`)

```json
{
  "_type": "search",
  "query": "laptop",
  "item": {
    "id": "4SAK0JUE6DVK",
    "name": "HP 15.6 inch HD Windows Laptop AI Intel Core Ultra 5 225U 8GB 512GB SSD Natural Silver",
    "brand": null,
    "catalogProductType": "Laptop Computers",
    "averageRating": 3.8,
    "numberOfReviews": 18,
    "isOutOfStock": false,
    "canonicalUrl": "/ip/HP-15-U5-8-512-Touch/19436203209",
    "image": "https://i5.walmartimages.com/seo/HP-15-U5-8-512-Touch_...",
    "priceInfo": {
      "itemPrice": "$599.00",
      "linePrice": "$429.00",
      "linePriceDisplay": "Now $429.00",
      "savings": "SAVE $170.00"
    },
    "availabilityStatusV2": {
      "display": "In stock",
      "value": "IN_STOCK"
    },
    "sellerName": "Walmart.com",
    "departmentName": "Electronics"
  }
}
```

### Use Cases

- **Price monitoring** — track price changes across products or categories
- **Market research** — collect product data at scale for competitive analysis
- **Inventory tracking** — monitor availability status across SKUs
- **Review analysis** — aggregate customer sentiment from review data
- **Product database** — build structured catalogs from Walmart listings

### Notes

- Walmart limits search results to 25 pages (~1,000 items per query)
- Reviews are only returned for product page scrapes, not search results
- The scraper uses Apify residential US proxies to avoid blocks

### Contact

Questions, issues, or custom scraping needs: **thenetaji@proton.me**

***

### More Actors

| Actor | Description |
|---|---|
| [TikTok Profile Scraper](https://apify.com/thenetaji/tiktok-profile-scraper?utm_source=actor-docs\&utm_medium=readme\&utm_campaign=thenetaji) | Extract TikTok user profiles and engagement metrics |
| [TikTok Video Downloader](https://apify.com/thenetaji/tiktok-video-downloader?utm_source=actor-docs\&utm_medium=readme\&utm_campaign=thenetaji) | Download TikTok videos without watermarks |
| [YouTube Scraper](https://apify.com/thenetaji/youtube-scraper?utm_source=actor-docs\&utm_medium=readme\&utm_campaign=thenetaji) | Channel and video analytics extraction |
| [Website Media Link Scraper](https://apify.com/thenetaji/website-media-link-scraper?utm_source=actor-docs\&utm_medium=readme\&utm_campaign=thenetaji) | Extract media assets from any website |

# Actor input Schema

## `searchTerms` (type: `array`):

List of URLs of products, categories or url to start crawling

## `maxItems` (type: `integer`):

Maximum items to scrape, works only for search URL(s) and query. Walmart only sends 25 pages.

## `includeReviews` (type: `boolean`):

Include product reviews, works only for direct product URL(s)

## Actor input object example

```json
{
  "searchTerms": [
    "laptop",
    "https://www.walmart.com/search?q=laptop&sort=price_low&page=1&affinityOverride=default",
    "https://www.walmart.com/ip/1736740710"
  ],
  "maxItems": 100,
  "includeReviews": false
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchTerms": [
        "laptop",
        "https://www.walmart.com/search?q=laptop&sort=price_low&page=1&affinityOverride=default",
        "https://www.walmart.com/ip/1736740710"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("thenetaji/walmart-data-extractor").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "searchTerms": [
        "laptop",
        "https://www.walmart.com/search?q=laptop&sort=price_low&page=1&affinityOverride=default",
        "https://www.walmart.com/ip/1736740710",
    ] }

# Run the Actor and wait for it to finish
run = client.actor("thenetaji/walmart-data-extractor").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchTerms": [
    "laptop",
    "https://www.walmart.com/search?q=laptop&sort=price_low&page=1&affinityOverride=default",
    "https://www.walmart.com/ip/1736740710"
  ]
}' |
apify call thenetaji/walmart-data-extractor --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=thenetaji/walmart-data-extractor",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Walmart Data Extractor",
        "description": "Walmart Scraper extracts detailed product information and search results from Walmart's website automatically. Use it to save time on market research, price monitoring, and competitive analysis without manual data collection.",
        "version": "3.0",
        "x-build-id": "E5C1iq6NNGm9u3Oqe"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/thenetaji~walmart-data-extractor/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-thenetaji-walmart-data-extractor",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/thenetaji~walmart-data-extractor/runs": {
            "post": {
                "operationId": "runs-sync-thenetaji-walmart-data-extractor",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/thenetaji~walmart-data-extractor/run-sync": {
            "post": {
                "operationId": "run-sync-thenetaji-walmart-data-extractor",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "required": [
                    "searchTerms"
                ],
                "properties": {
                    "searchTerms": {
                        "title": "Input URL(s) or query",
                        "type": "array",
                        "description": "List of URLs of products, categories or url to start crawling",
                        "default": [
                            "laptop",
                            "https://www.walmart.com/search?q=laptop&sort=price_low&page=1&affinityOverride=default",
                            "https://www.walmart.com/ip/1736740710"
                        ],
                        "items": {
                            "type": "string"
                        }
                    },
                    "maxItems": {
                        "title": "Maximum items to scrape",
                        "minimum": 40,
                        "type": "integer",
                        "description": "Maximum items to scrape, works only for search URL(s) and query. Walmart only sends 25 pages.",
                        "default": 100
                    },
                    "includeReviews": {
                        "title": "Also scrape products reviews",
                        "type": "boolean",
                        "description": "Include product reviews, works only for direct product URL(s)",
                        "default": false
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```