# EBay Scraper Ultimate (`nikhuge/ebay-scraper-ultimate`) Actor

This Apify Actor allows you to scrape detailed product data from eBay listings quickly and reliably. It is ideal for e-commerce research, price monitoring, competitor analysis, dropshipping, and market intelligence.

- **URL**: https://apify.com/nikhuge/ebay-scraper-ultimate.md
- **Developed by:** [charith wijesundara](https://apify.com/nikhuge) (community)
- **Categories:** E-commerce, Automation, Lead generation
- **Stats:** 6 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: 5.00 out of 5 stars

## Pricing

$1.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## eBay Scraper Ultimate

eBay Scraper Ultimate is a sophisticated and robust Apify Actor designed to extract comprehensive product data from eBay. It goes beyond simple title and price extraction, providing deep insights into product variants, ratings, and customer feedback.

### Features

- **Anti-Bot Measures**: Implements randomized delays (2-5 seconds), human-like behavior (random mouse movements, slow incremental scrolling), and optimized concurrency to bypass eBay's sophisticated detection.
- **Robust Title & Data Extraction**: Uses multiple fallback selectors, increased timeouts, and `page.evaluate` for reliable data capture across various eBay page layouts, including the new **"evo" layout**.
- **Bot Detection Handling**: Automatically detects and handles eBay's "Pardon Our Interruption" screens, logging warnings and skipping blocked pages to ensure crawl continuity.
- **Enhanced Image Gallery**: Extracts all available product images, including high-resolution versions (up to 1600px) from the gallery, with automatic image cleaning.
- **Deep Item Specifications**: Captures comprehensive technical details and item specifics using advanced table-parsing logic and text-based search fallbacks.
- **Seller Insights**: Extracts seller names and feedback ratings to help identify reputable sources.
- **Reliable Ratings & Reviews**:
    - **Average Rating**: Extracts the average star rating using reliable LD+JSON structured data.
    - **Rating Count**: Captures the total number of ratings for the product.
- **Customer Feedback**: Scrapes the top 10 most relevant customer comments/reviews for each product.
- **Residential Proxy Support**: Defaults to Apify Residential Proxies for maximum reliability and anti-bot protection on the Apify platform. Gracefully falls back to no proxy for local development.
- **Optimized for Performance**: Combines Playwright for dynamic content and BeautifulSoup for fast, resilient data extraction.

### How to Use

#### Input Parameters

The Actor accepts the following input parameters:

| Field | Type | Description | Default |
|-------|------|-------------|---------|
| `searchQuery` | String | **Required**. The product name or keywords to search for on eBay. | `iPhone 15` |
| `maxProducts` | Integer | Maximum number of products to scrape. | `20` |
| `proxyConfiguration` | Object | Apify Proxy or external proxy configuration for rotating IP addresses. | `{ "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] }` |

#### Proxy Configuration

The Actor **defaults to Apify Residential Proxies** for best results and anti-bot protection.

##### On Apify Platform
When running on the Apify platform with an account that has proxy access enabled:
- **Residential Proxies** (Default): Automatically enabled for maximum reliability and bot detection avoidance
- **Datacenter Proxies**: Can be configured by changing `apifyProxyGroups` to `["DATACENTER"]`
- **External Proxies**: Select "Custom proxies" and provide your own proxy URLs (e.g., `http://username:password@proxy.example.com:8080`)

##### Local Development
When running locally with `apify run`:
- The Actor will display a warning and run **without proxies**
- This is normal behavior - residential proxies only work on the Apify platform
- The scraper will still function but may be more prone to blocks for large-scale scraping

> [!IMPORTANT]
> **Residential proxies are highly recommended** for production scraping to prevent bot detection and ensure high reliability. They are automatically enabled when running on the Apify platform.

#### Output Data

The results are stored in the default dataset. Each item in the dataset represents a product and contains the following fields:

- `url`: The direct link to the eBay product page.
- `title`: The full title of the product.
- `price`: The current listed price.
- `condition`: The condition of the item (e.g., "New", "Very Good - Refurbished").
- `variants`: An object containing available options (e.g., `{"Color": ["Black", "Blue"], "Storage": ["128GB", "256GB"]}`).
- `averageRating`: The average star rating of the product.
- `ratingCount`: The total number of ratings received.
- `sellerName`: The name of the seller.
- `sellerRating`: The feedback rating of the seller.
- `itemDetails`: An object containing detailed specifications of the item.
- `images`: An array of product image URLs.
- `comments`: An array of the top 10 customer comments.

### Local Development

If you want to run this Actor locally, ensure you have the [Apify CLI](https://docs.apify.com/cli) installed.

1. **Install dependencies**:
   ```bash
   pip install -r requirements.txt
````

2. **Install Playwright browsers**:
   ```bash
   playwright install chromium
   ```

3. **Run the Actor**:
   ```bash
   apify run
   ```

> \[!NOTE]
> When running locally, you'll see a warning about proxy access. This is expected - the Actor will continue without proxies. For production use with proxies, deploy to the Apify platform.

### Deployment to Apify

To deploy this Actor to the Apify platform:

1. **Log in to Apify**:
   ```bash
   apify login
   ```

2. **Push the project**:
   ```bash
   apify push
   ```

### Resources

- [Apify SDK for Python](https://docs.apify.com/sdk/python/)
- [Crawlee for Python](https://crawlee.dev/python/)
- [Beautiful Soup Documentation](https://www.crummy.com/software/BeautifulSoup/bs4/doc/)
- [Apify Proxy Documentation](https://docs.apify.com/platform/proxy)

# Actor input Schema

## `searchQuery` (type: `string`):

The product name or keywords to search for on eBay.

## `maxProducts` (type: `integer`):

Maximum number of products to scrape.

## `proxyConfiguration` (type: `object`):

Proxy settings for anti-bot protection. Supports Apify Proxy and external/custom proxies.

## Actor input object example

```json
{
  "searchQuery": "iPhone 15",
  "maxProducts": 20,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}
```

# Actor output Schema

## `dataset` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchQuery": "iPhone 15"
};

// Run the Actor and wait for it to finish
const run = await client.actor("nikhuge/ebay-scraper-ultimate").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "searchQuery": "iPhone 15" }

# Run the Actor and wait for it to finish
run = client.actor("nikhuge/ebay-scraper-ultimate").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchQuery": "iPhone 15"
}' |
apify call nikhuge/ebay-scraper-ultimate --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=nikhuge/ebay-scraper-ultimate",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "EBay Scraper Ultimate",
        "description": "This Apify Actor allows you to scrape detailed product data from eBay listings quickly and reliably. It is ideal for e-commerce research, price monitoring, competitor analysis, dropshipping, and market intelligence.",
        "version": "0.15",
        "x-build-id": "Arcup5Y6Nj6nGT2sd"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/nikhuge~ebay-scraper-ultimate/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-nikhuge-ebay-scraper-ultimate",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/nikhuge~ebay-scraper-ultimate/runs": {
            "post": {
                "operationId": "runs-sync-nikhuge-ebay-scraper-ultimate",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/nikhuge~ebay-scraper-ultimate/run-sync": {
            "post": {
                "operationId": "run-sync-nikhuge-ebay-scraper-ultimate",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "required": [
                    "searchQuery"
                ],
                "properties": {
                    "searchQuery": {
                        "title": "Search Query",
                        "type": "string",
                        "description": "The product name or keywords to search for on eBay."
                    },
                    "maxProducts": {
                        "title": "Max Products",
                        "minimum": 1,
                        "type": "integer",
                        "description": "Maximum number of products to scrape.",
                        "default": 20
                    },
                    "proxyConfiguration": {
                        "title": "Proxy Configuration",
                        "type": "object",
                        "description": "Proxy settings for anti-bot protection. Supports Apify Proxy and external/custom proxies.",
                        "default": {
                            "useApifyProxy": true,
                            "apifyProxyGroups": [
                                "RESIDENTIAL"
                            ]
                        }
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```