# Amazon Product Scraper (`datapilot/amazon-product-scraper`) Actor Amazon Scraper Actor uses to collect product data via search terms, URLs, or ASINs. Extracts title, price, rating, reviews, images, features, and sellers. Supports proxies, async scraping, and optional full details. Outputs clean structured JSON. - **URL**: https://apify.com/datapilot/amazon-product-scraper.md - **Developed by:** [Data Pilot](https://apify.com/datapilot) (community) - **Categories:** E-commerce, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing $10.00/month + usage To use this Actor, you pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period.You also pay for the Apify platform usage, which gets cheaper the higher Apify subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#rental-actors ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Amazon Product Scraper πŸš€ **Amazon Product Scraper** is a powerful Apify Actor designed to extract detailed **Amazon Product data** from Amazon search results and individual product pages. This tool provides comprehensive **Amazon Product information**, including titles, prices, ratings, reviews, images, and seller details for any Amazon Product query. Whether you're conducting **Amazon Product research**, price monitoring, or market analysis, the Amazon Product Scraper delivers accurate **Amazon Product data** efficiently. With browser automation using Playwright, the Amazon Product Scraper ensures reliable extraction of dynamic **Amazon Product content** that may not be available through simple API calls. It focuses on key **Amazon Product metrics** like pricing, availability, and seller information, making it an essential tool for **Amazon Product analysis** and e-commerce research. ### πŸ”₯ Features - **Comprehensive Amazon Product Extraction** – Scrapes detailed **Amazon Product data**, including ASINs, titles, prices, ratings, and reviews for any search query or product URL. - **Search & Product Page Support** – Handles both **Amazon Product search results** and direct **Amazon Product page URLs** for flexible **Amazon Product data collection**. - **Seller Information** – Extracts **Amazon Product seller details**, including merchant names, prices, and shipping options. - **Batch Processing** – Processes multiple **Amazon Product search terms** in a single run for efficient **Amazon Product data collection**. - **Full Detail Enrichment** – Optionally retrieves full **Amazon Product details** (features, images, availability) for top search results. - **Residential Proxy Support** – Utilizes Apify's residential proxies to bypass restrictions and ensure high success rates for **Amazon Product scraping**. - **Error Handling** – Robust logging and fallback mechanisms for failed **Amazon Product scrapes**. - **Dataset Integration** – Automatically uploads **Amazon Product data** to your Apify dataset for easy export and analysis. --- ### βš™οΈ How It Works The Amazon Product Scraper takes search terms or product URLs as input and uses Playwright to launch a headless browser, navigate to Amazon, and extract **Amazon Product data**. It parses HTML elements for **Amazon Product details** like price, rating, and images. The scraper returns structured **Amazon Product data** on success or error details on failure, providing a reliable way to gather **Amazon Product information** for research and analysis. **Key Processing Steps:** 1. **Input Validation** – Parse search terms or ASINs 2. **Browser Launch** – Initialize Playwright headless browser 3. **Amazon Navigation** – Visit Amazon search or product pages 4. **HTML Parsing** – Extract product data from page elements 5. **Seller Extraction** – Parse seller information and prices 6. **Image Collection** – Gather product images and details 7. **Data Compilation** – Aggregate all product data 8. **Export** – Push results to dataset in JSON format **Key benefits for Amazon Product analysis:** - Track **Amazon Product prices** and availability in real-time. - Analyze **Amazon Product reviews** and ratings for market insights. - Build **Amazon Product databases** for e-commerce research. - Monitor competitor products and pricing strategies. - Research market trends through product availability. --- ### πŸ“₯ Input The scraper accepts the following input parameters: | Field | Type | Default | Description | |--------------------|---------|-------------------|-------------| | `searchTerms` | string | required | List of search terms or ASINs to scrape Amazon Product data from, comma-separated (e.g., `"laptop, B08N5KWB9H"`). | | `maxResults` | integer | `10` | Maximum number of Amazon Product results per search (1-50). | | `getFullDetails` | boolean | `true` | Retrieve full Amazon Product details (features, images) for top results. | | `useApifyProxy` | boolean | `true` | Enable residential proxies for Amazon Product scraping. | | `apifyProxyGroups` | array | `["RESIDENTIAL"]` | Proxy groups to use (e.g., `["RESIDENTIAL"]`). | **Example input JSON:** ```json { "searchTerms": "wireless headphones, B08N5KWB9H", "maxResults": 15, "getFullDetails": true, "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } ```` *** ### πŸ“€ Output The scraper outputs detailed **Amazon Product data** in JSON format for each result. Each record includes: | Field | Type | Description | |------------|--------|-------------| | `product` | object | Amazon Product details object. | | `sellers` | array | Array of seller objects for the product. | **Product Object Fields:** | Field | Type | Description | |---------------|---------|-------------| | `asin` | string | Amazon Standard Identification Number. | | `title` | string | Title of the Amazon Product. | | `brand` | string | Brand of the Amazon Product. | | `price` | string | Current price of the Amazon Product. | | `rating` | string | Average rating of the Amazon Product. | | `reviewCount` | string | Number of reviews for the Amazon Product. | | `availability`| string | Availability status of the Amazon Product. | | `prime` | boolean | Prime eligible status. | | `features` | array | List of product features. | | `images` | array | List of image URLs. | | `url` | string | URL to the Amazon Product page. | **Sellers Array Fields:** | Field | Type | Description | |---------------|---------|-------------| | `merchantName`| string | Name of the seller. | | `price` | string | Seller's price for the product. | | `shipping` | string | Shipping information. | | `prime` | boolean | Prime shipping status. | **Example output for Amazon Product data:** ```json { "product": { "asin": "B08N5KWB9H", "title": "Example Amazon Product", "brand": "Example Brand", "price": "$29.99", "rating": "4.5 out of 5 stars", "reviewCount": "1,234", "availability": "In Stock", "prime": true, "features": ["Feature 1", "Feature 2", "Feature 3"], "images": ["https://example.com/image1.jpg", "https://example.com/image2.jpg"], "url": "https://www.amazon.com/dp/B08N5KWB9H" }, "sellers": [ { "merchantName": "Amazon", "price": "$29.99", "shipping": "Free Prime shipping", "prime": true }, { "merchantName": "Third Party Seller", "price": "$27.99", "shipping": "Free shipping on orders over $25", "prime": false } ] } ``` *** ### 🧰 Technical Stack - **HTML Parsing:** BeautifulSoup – HTML element extraction - **Data Processing:** JSON formatting, price parsing - **Proxy Support:** Apify Proxy with RESIDENTIAL support - **Platform:** Apify Actor – serverless, scalable, integrated with Dataset - **Deployment:** One‑click run on Apify Console or via REST API *** ### 🎯 Use Cases - **Price Monitoring** – Track Amazon product prices over time for monitoring and alerts. - **Competitor Analysis** – Analyze competitor products and pricing strategies. - **Market Research** – Research product availability and market trends. - **Product Database Building** – Build comprehensive product databases for e-commerce analysis. - **Review Analysis** – Analyze product reviews and ratings for insights. - **Seller Research** – Research seller information and pricing across products. - **Inventory Tracking** – Monitor product availability across multiple sellers. - **Brand Monitoring** – Monitor brand products and performance metrics. - **Price Comparison** – Compare prices across different sellers for the same product. - **Product Trend Analysis** – Identify trending products and categories. - **Lead Generation** – Find product opportunities in specific niches. - **Quality Analysis** – Analyze product ratings for quality assessment. - **Marketing Research** – Research successful product listings and descriptions. - **Dropshipping Research** – Research dropshipping opportunities on Amazon. *** ### πŸš€ Quick Start 1. **Open in Apify Console** – visit the Actor page and click Try for free. 2. **Enter search terms** – provide product names or ASINs (e.g., "laptop, B08N5KWB9H"). 3. **Set result limits** – choose between 1-50 results per search. 4. **Enable full details** – toggle to get features and images for top results. 5. **Click Start** – the Actor will scrape Amazon Product data using browser automation. 6. **View Results** – check the dataset for extracted product information. 7. **Analyze Data** – examine prices, ratings, seller information. 8. **Export** – download the results as JSON, CSV, or Excel. You can also call this Actor programmatically via Apify SDK or REST API – ideal for automated price monitoring and market research. *** ### πŸ’Ž Why This Scraper? | Feature | Benefit | |---------|---------| | βœ… Complete data | Get prices, ratings, reviews, sellers. | | βœ… Browser automation | Handle dynamic Amazon content. | | βœ… Seller information | Get multiple seller prices and shipping. | | βœ… Batch processing | Process multiple searches efficiently. | | βœ… Full details option | Get features and images for analysis. | | βœ… Residential proxies | Bypass restrictions – reliable access. | | βœ… Error handling | Robust fallback mechanisms. | | βœ… Apify ecosystem | Seamless integration with other Actors, triggers, and webhooks. | ### πŸ“¦ Changelog - Initial release of Amazon Product Scraper - Amazon search results scraping - Direct product page URL support - ASIN-based product lookup - Comprehensive product data extraction - Seller information and pricing - Product images extraction - Product features and specifications - Ratings and review counts - Availability status tracking - Prime eligibility detection - Batch search term processing - Full detail enrichment option - Residential proxy support - Error handling with fallback mechanisms - Automatic dataset integration - Full Apify Actor integration *** ### πŸ§‘β€πŸ’» Support & Feedback - **Issues & Ideas:** Open a ticket on the Apify Actor issue tracker - **Documentation:** Visit Apify Docs for comprehensive platform guides - **Community:** Join the Apify community forum for discussions and support - **Bug Reports:** Submit detailed bug reports through the issue tracker - **Feature Requests:** Suggest new features to improve the scraper *** ### πŸ’° Pricing - **Free** for basic usage on Apify platform - **Paid plans** available for higher limits and priority support - **Proxy credits** consumed based on residential proxy usage *** **Disclaimer:** Amazon Product Scraper is provided as-is for research and analysis purposes. Users are responsible for ensuring their usage complies with Amazon's policies and applicable laws. *** ### πŸŽ‰ Get Started Today **Begin scraping Amazon Product data now!** Use Amazon Product Scraper for: - πŸ’° Price Monitoring - πŸ” Competitor Research - πŸ“Š Market Analysis - πŸ’‘ Product Research - πŸ“ˆ Trend Analysis **Perfect for:** - E-commerce Professionals - Researchers - Market Analysts - Business Strategists - Price Trackers *** **Last Updated:** February 2025\ **Version:** 1.0.0\ **Status:** Active Development\ **Support:** 24/7 Customer Support Available\ **Platform:** Apify *** ### πŸ“š Related Tools For comprehensive e-commerce and market research, explore our full suite of tools: - Google Search Results Scraper - Ranked Keywords Scraper with SEO Metrics - Keyword Traffic & CPC Analyzer - All-in-One Media Downloader - Ultimate Video Info Fetcher # Actor input Schema ## `searchTerms` (type: `string`): Enter search terms, Amazon URLs, or ASINs (comma-separated). ## `maxResults` (type: `integer`): Maximum number of products per search query (default: 10). ## `getFullDetails` (type: `boolean`): Enrich search results with full product page details (slower but more data). ## `useApifyProxy` (type: `boolean`): Recommended to avoid blocks. ## `apifyProxyGroups` (type: `array`): Select proxy type. ## Actor input object example ```json { "searchTerms": "sony headphones,https://www.amazon.com/dp/B09XS7JWHH,B09XS7JWHH", "maxResults": 10, "getFullDetails": true, "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchTerms": "sony headphones,https://www.amazon.com/dp/B09XS7JWHH,B09XS7JWHH" }; // Run the Actor and wait for it to finish const run = await client.actor("datapilot/amazon-product-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchTerms": "sony headphones,https://www.amazon.com/dp/B09XS7JWHH,B09XS7JWHH" } # Run the Actor and wait for it to finish run = client.actor("datapilot/amazon-product-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchTerms": "sony headphones,https://www.amazon.com/dp/B09XS7JWHH,B09XS7JWHH" }' | apify call datapilot/amazon-product-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=datapilot/amazon-product-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Amazon Product Scraper", "description": "Amazon Scraper Actor uses to collect product data via search terms, URLs, or ASINs. Extracts title, price, rating, reviews, images, features, and sellers. Supports proxies, async scraping, and optional full details. Outputs clean structured JSON.", "version": "0.0", "x-build-id": "hgr3BbJZgZShmyuou" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/datapilot~amazon-product-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-datapilot-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/datapilot~amazon-product-scraper/runs": { "post": { "operationId": "runs-sync-datapilot-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/datapilot~amazon-product-scraper/run-sync": { "post": { "operationId": "run-sync-datapilot-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "searchTerms" ], "properties": { "searchTerms": { "title": "Search Terms / URLs / ASINs", "type": "string", "description": "Enter search terms, Amazon URLs, or ASINs (comma-separated)." }, "maxResults": { "title": "Max Results per Search", "minimum": 1, "maximum": 50, "type": "integer", "description": "Maximum number of products per search query (default: 10).", "default": 10 }, "getFullDetails": { "title": "Get Full Product Details", "type": "boolean", "description": "Enrich search results with full product page details (slower but more data).", "default": true }, "useApifyProxy": { "title": "Use Apify Proxy", "type": "boolean", "description": "Recommended to avoid blocks.", "default": true }, "apifyProxyGroups": { "title": "Proxy Groups", "uniqueItems": true, "type": "array", "description": "Select proxy type.", "items": { "type": "string", "enum": [ "RESIDENTIAL", "DATACENTER" ] }, "default": [ "RESIDENTIAL" ] } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```