# Etsy Shop Scraper (`mighty_monk/etsy-shop-scraper`) Actor

Scrape Etsy shop information and product listings: shop name, sales count, location, rating, product titles, prices, URLs, images, favorites.

- **URL**: https://apify.com/mighty\_monk/etsy-shop-scraper.md
- **Developed by:** [Harsh](https://apify.com/mighty_monk) (community)
- **Categories:** E-commerce, Developer tools
- **Stats:** 3 total users, 3 monthly users, 93.1% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.00 / 1,000 shop or product results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## Etsy Shop Scraper

**Scrape Etsy shop profiles and product listings** in one run: shop name, sales, location, rating, product titles, prices, URLs, images, and favorites. Built with **TypeScript**, **Crawlee CheerioCrawler**, and multi-strategy extraction (JSON-LD, embedded scripts, DOM).

Run it on the [Apify platform](https://apify.com) for scheduling, API access, proxy rotation, monitoring, and dataset exports (JSON, CSV, Excel).

### What does Etsy Shop Scraper do?

Given one or more [Etsy](https://www.etsy.com) shop URLs, this Actor:

1. Loads each shop page (with optional pagination)
2. Extracts **shop summary** fields (name, location, sales, admirers, rating, reviews, description)
3. Extracts **product listings** (title, price, currency, URL, image, listing ID, sold-out flag, favorites)
4. Deduplicates products by `listingId`
5. Pushes dataset items (`type: "shop"` and `type: "product"`)
6. Exports **PRODUCTS.csv** and **SHOP\_SUMMARY.md** to the key-value store

### Why use Etsy Shop Scraper?

- **Competitor research** — track product catalogs, pricing, and ratings across shops
- **Market analysis** — sample niches by scraping multiple shop URLs
- **Inventory monitoring** — spot sold-out listings and favorites velocity
- **Lead generation** — collect public shop metadata for outreach (respect Etsy ToS)

### How to scrape Etsy shops

1. Open the Actor in [Apify Console](https://console.apify.com)
2. Paste one or more shop URLs (e.g. `https://www.etsy.com/shop/ShopName`)
3. Set **Max products per shop** and optional proxy settings
4. Click **Start**
5. Download results from the **Dataset** tab or key-value store exports

### Input

| Field                | Type     | Default        | Description                  |
| -------------------- | -------- | -------------- | ---------------------------- |
| `shopUrls`           | string\[] | sample shop    | Etsy shop page URLs          |
| `maxProducts`        | integer  | `50`           | Max listings per shop        |
| `maxConcurrency`     | integer  | `2`            | Concurrent HTTP requests     |
| `maxRequestRetries`  | integer  | `3`            | HTTP retry count             |
| `requestDelayMs`     | integer  | `800`          | Delay used for rate limiting |
| `proxyConfiguration` | object   | Apify Proxy on | Proxy settings               |
| `includeShopInfo`    | boolean  | `true`         | Push `type=shop` summary     |
| `includeProducts`    | boolean  | `true`         | Push `type=product` items    |

Example:

```json
{
    "shopUrls": ["https://www.etsy.com/shop/VintageVibes"],
    "maxProducts": 50,
    "maxConcurrency": 2,
    "maxRequestRetries": 3,
    "requestDelayMs": 800,
    "proxyConfiguration": { "useApifyProxy": true },
    "includeShopInfo": true,
    "includeProducts": true
}
```

See [`examples/input.json`](examples/input.json).

### Output

Dataset items are either **shop** or **product** records:

```json
{
    "type": "product",
    "shopName": "VintageVibes",
    "shopUrl": "https://www.etsy.com/shop/VintageVibes",
    "title": "Vintage Brass Candle Holder",
    "price": 28,
    "currency": "USD",
    "url": "https://www.etsy.com/listing/1000000001/vintage-brass-candle-holder",
    "image": "https://i.etsystatic.com/example/il_570xN.1001.jpg",
    "listingId": "1000000001",
    "isSoldOut": false,
    "favorites": 312,
    "scrapedAt": "2026-07-13T12:00:00.000Z",
    "error": null
}
```

```json
{
    "type": "shop",
    "shopName": "VintageVibes",
    "shopUrl": "https://www.etsy.com/shop/VintageVibes",
    "location": "Portland, OR, US",
    "sales": 12345,
    "admirers": 2100,
    "rating": 4.9,
    "reviewCount": 1284,
    "description": "Curated vintage home decor and gifts.",
    "productCount": 4,
    "scrapedAt": "2026-07-13T12:00:00.000Z",
    "error": null
}
```

You can download the dataset as **JSON, HTML, CSV, or Excel**. The Actor also writes:

| Key-value record  | Description                               |
| ----------------- | ----------------------------------------- |
| `PRODUCTS.csv`    | All product rows as CSV                   |
| `SHOP_SUMMARY.md` | Markdown summary of shops + product table |

### Data fields

| Field          | Shop | Product |
| -------------- | :--: | :-----: |
| `type`         |  ✅  |   ✅    |
| `shopName`     |  ✅  |   ✅    |
| `shopUrl`      |  ✅  |   ✅    |
| `location`     |  ✅  |         |
| `sales`        |  ✅  |         |
| `admirers`     |  ✅  |         |
| `rating`       |  ✅  |         |
| `reviewCount`  |  ✅  |         |
| `description`  |  ✅  |         |
| `productCount` |  ✅  |         |
| `title`        |      |   ✅    |
| `price`        |      |   ✅    |
| `currency`     |      |   ✅    |
| `url`          |      |   ✅    |
| `image`        |      |   ✅    |
| `listingId`    |      |   ✅    |
| `isSoldOut`    |      |   ✅    |
| `favorites`    |      |   ✅    |
| `scrapedAt`    |  ✅  |   ✅    |
| `error`        |  ✅  |   ✅    |

### Pricing

**Pay-per-event (PPE):** **$0.003 per dataset result** (shop summary or product row), plus a small Actor-start fee.

Estimate: scraping 1 shop + 50 products ≈ 51 results ≈ **$0.15**.

### Tips

- Use **Apify Proxy** (residential recommended) if Etsy returns captchas or 403s
- Keep `maxConcurrency` low (1–3) and `requestDelayMs` around 800–1500 ms
- Increase `maxProducts` only as needed — larger catalogs cost more and take longer
- Prefer stable public shop URLs: `https://www.etsy.com/shop/ShopName`
- Unit tests use HTML fixtures so CI does not depend on live Etsy access

### Limitations

- Cheerio parses **static HTML**. Heavy client-only rendering may yield fewer listings.
- Etsy may **block** or rate-limit automated traffic; graceful error records are pushed when detected.
- Layout and embedded JSON formats change over time; multi-strategy extraction mitigates but cannot guarantee 100% coverage.
- Always respect [Etsy Terms of Use](https://www.etsy.com/legal/terms-of-use) and applicable laws. Scrape only public data you are allowed to collect.

### Local development

```bash
cd factory/etsy-shop-scraper
npm install
npm run lint
npm run format
npm run build
npm test
apify run --purge
```

Copy `examples/input.json` to `storage/key_value_stores/default/INPUT.json` for local runs.

### Deploy

```bash
apify login
apify push
```

### Project structure

```text
.actor/           Actor metadata, input/output/dataset schemas
examples/         Sample input/output JSON
src/
  main.ts         Crawler setup, exports, rate limits
  routes.ts       Shop page handlers, pagination, finalize
  extractors.ts   JSON-LD / embedded JSON / DOM extractors
  csv.ts          PRODUCTS.csv + SHOP_SUMMARY.md builders
  utils.ts        Parsing helpers
  types.ts        TypeScript interfaces
test/
  fixtures/       Offline Etsy shop HTML
```

### Support

Report issues on the Actor’s **Issues** tab in Apify Console. For custom scrapers or enterprise pipelines, contact the developer via Apify.

### License

Apache-2.0

# Actor input Schema

## `shopUrls` (type: `array`):

One or more Etsy shop page URLs to scrape (e.g. https://www.etsy.com/shop/ShopName).

## `maxProducts` (type: `integer`):

Maximum number of product listings to extract per shop. Pagination stops once this limit is reached.

## `maxConcurrency` (type: `integer`):

Maximum number of concurrent HTTP requests. Keep low to reduce the chance of rate limiting.

## `maxRequestRetries` (type: `integer`):

How many times to retry a failed HTTP request before giving up.

## `requestDelayMs` (type: `integer`):

Approximate delay between requests used to compute rate limiting (max requests per minute).

## `proxyConfiguration` (type: `object`):

Apify Proxy settings. Residential proxies are strongly recommended — Etsy blocks most datacenter IPs.

## `includeShopInfo` (type: `boolean`):

Push a type=shop dataset item with shop name, sales, location, rating, and description.

## `includeProducts` (type: `boolean`):

Push one type=product dataset item per listing (title, price, URL, image, favorites).

## Actor input object example

```json
{
  "shopUrls": [
    "https://www.etsy.com/shop/VintageVibes"
  ],
  "maxProducts": 50,
  "maxConcurrency": 2,
  "maxRequestRetries": 3,
  "requestDelayMs": 800,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  },
  "includeShopInfo": true,
  "includeProducts": true
}
```

# Actor output Schema

## `dataset` (type: `string`):

No description

## `productsCsv` (type: `string`):

No description

## `shopSummary` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "shopUrls": [
        "https://www.etsy.com/shop/VintageVibes"
    ]
};

// Run the Actor and wait for it to finish
const run = await client.actor("mighty_monk/etsy-shop-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "shopUrls": ["https://www.etsy.com/shop/VintageVibes"] }

# Run the Actor and wait for it to finish
run = client.actor("mighty_monk/etsy-shop-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "shopUrls": [
    "https://www.etsy.com/shop/VintageVibes"
  ]
}' |
apify call mighty_monk/etsy-shop-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=mighty_monk/etsy-shop-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/acts/xyfTgHi461MgehuMC/builds/6P9MwbusLi6WVEn4z/openapi.json