# Product Hunt Daily Products Scraper (`wsgcjj/product-hunt-scraper`) Actor

Scrape Product Hunt for daily/top products with votes, reviews, descriptions, and maker information. Perfect for competitive analysis, market research, and founder intelligence.

- **URL**: https://apify.com/wsgcjj/product-hunt-scraper.md
- **Developed by:** [陈俊杰](https://apify.com/wsgcjj) (community)
- **Categories:** Developer tools, AI
- **Stats:** 2 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

$1.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## Product Hunt Scraper — Apify Actor

[![Apify Actor](https://img.shields.io/badge/Apify-Actor-blue)](https://apify.com/)
[![Python](https://img.shields.io/badge/Python-3.14+-brightgreen)](https://python.org)

Scrape [Product Hunt](https://www.producthunt.com) for daily and top products, including upvotes, comment counts, descriptions, maker information, tags, and more. This actor is perfect for:

- **Competitive analysis** — track new product launches in your niche.
- **Market research** — discover trending products and categories.
- **Founder intelligence** — build lead lists of makers and their projects.
- **Content curation** — aggregate Product Hunt data for newsletters or dashboards.

---

### How it works

1. The actor sends a standard HTTP GET request to the Product Hunt collection page of your choice (e.g. `https://www.producthunt.com/tech`).
2. Product Hunt is built with **Next.js**, so the initial page state is serialised into a `<script id="__NEXT_DATA__">` tag.
3. The actor parses this JSON payload to extract products **without** needing a headless browser — making it fast and resource-efficient.
4. Each product is normalised, filtered (by minimum upvotes), limited, and pushed to the Apify dataset.

---

### Input parameters

| Field          | Type   | Default       | Description                                                              |
|----------------|--------|---------------|--------------------------------------------------------------------------|
| `date`         | string | today         | The date to scrape (YYYY-MM-DD). Used for reference; Product Hunt often returns currently featured products. |
| `collection`   | enum   | `tech`        | Which Product Hunt collection to scrape.                                 |
| `min_votes`    | int    | 0             | Minimum number of upvotes — products below this threshold are dropped.   |
| `limit`        | int    | 25            | Maximum number of products to return (capped at 100).                    |

#### Available collections

- `tech`
- `games`
- `podcasts`
- `books`
- `developer-tools`
- `artificial-intelligence`
- `all` (home page / trending)

---

### Example output

Each item in the dataset is a JSON object like this:

```json
{
  "name": "Not Diamond",
  "tagline": "The AI model router that improves every LLM output",
  "description": "Not Diamond automatically routes each query to the best LLM, saving costs and improving quality.",
  "url": "https://www.producthunt.com/posts/not-diamond",
  "slug": "not-diamond",
  "upvotes": 987,
  "comments_count": 42,
  "maker_name": "Tommy Sun",
  "thumbnail_url": "https://ph-files.imgix.net/...",
  "website_url": "https://notdiamond.ai",
  "tags": ["artificial-intelligence", "developer-tools", "open-source"],
  "featured_at": "2025-05-26T07:01:00Z",
  "id": "123456"
}
````

#### Field descriptions

| Field              | Type     | Description                                        |
|--------------------|----------|----------------------------------------------------|
| `name`             | string   | Product name                                       |
| `tagline`          | string   | Short one-line description                         |
| `description`      | string   | Full description (often same as tagline)           |
| `url`              | string   | Product Hunt post URL                              |
| `slug`             | string   | URL slug                                           |
| `upvotes`          | integer  | Number of upvotes ▲                                |
| `comments_count`   | integer  | Number of comments                                 |
| `maker_name`       | string   | Name of the first listed maker                     |
| `thumbnail_url`    | string   | Thumbnail image URL                                |
| `website_url`      | string   | Product's external website                         |
| `tags`             | array    | List of topic/category tags                        |
| `featured_at`      | string   | ISO 8601 timestamp when featured                   |
| `id`               | string   | Unique Product Hunt ID                             |

***

### Example usage (Apify client)

#### Python

```python
from apify_client import ApifyClient

client = ApifyClient("YOUR_API_TOKEN")

run_input = {
    "collection": "tech",
    "min_votes": 50,
    "limit": 10,
    "date": "2025-05-26",
}

run = client.actor("your-actor-id").call(run_input=run_input)
dataset_items = client.dataset(run["defaultDatasetId"]).list_items().items

for item in dataset_items:
    print(f"{item['name']} — ▲ {item['upvotes']} by {item['maker_name']}")
```

#### JavaScript / TypeScript

```javascript
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: 'YOUR_API_TOKEN' });

const input = {
  collection: 'developer-tools',
  min_votes: 100,
  limit: 5,
};

const run = await client.actor('your-actor-id').call(input);
const { items } = await client.dataset(run.defaultDatasetId).listItems();

items.forEach(item => {
  console.log(`${item.name} — ▲ ${item.upvotes}`);
});
```

***

### Local development

```bash
## 1. Clone the repository
git clone <repo-url> product-hunt-scraper
cd product-hunt-scraper

## 2. Create a virtual environment
python -m venv venv
source venv/bin/activate  # or venv\Scripts\activate on Windows

## 3. Install dependencies
pip install -r requirements.txt

## 4. Run the actor locally
python -m src
```

> **Note:** When running locally without the Apify platform, `Actor.push_data()` and `Actor.get_input()` require either the Apify CLI (`apify run`) or environment variables. For quick tests, you can set `APIFY_LOCAL_EMULATION=true` or use the Apify CLI.

***

### Technical details

- **Language:** Python 3.14
- **HTTP client:** `httpx` (async)
- **HTML parsing:** `BeautifulSoup` is declared as a dependency, but the primary extraction path uses the `__NEXT_DATA__` JSON payload — no full DOM parsing needed.
- **Scraping approach:** Static HTTP request with a real browser User-Agent. No headless browser (Puppeteer/Playwright) required.
- **Dataset:** Each product is pushed individually via `Actor.push_data()`.

***

### Limitations

- Product Hunt **rate-limits** aggressive requests. Adding randomised delays between multiple runs is recommended.
- The `__NEXT_DATA__` JSON structure may change when Product Hunt updates their frontend. The actor includes fallback logic to find product data by key name, but occasional breakage is possible.
- Only **publicly visible** data on collection pages is extracted. Authentication-gated data (e.g. private follow feeds) is not supported.

***

### License

MIT

# Actor input Schema

## `date` (type: `string`):

The date to scrape products for (format: YYYY-MM-DD). Defaults to today.

## `collection` (type: `string`):

Product Hunt collection to scrape.

## `min_votes` (type: `integer`):

Minimum upvotes filter — only products with at least this many upvotes will be included.

## `limit` (type: `integer`):

Maximum number of products to return.

## Actor input object example

```json
{
  "date": "2026-05-26",
  "collection": "tech",
  "min_votes": 0,
  "limit": 25
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("wsgcjj/product-hunt-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("wsgcjj/product-hunt-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call wsgcjj/product-hunt-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=wsgcjj/product-hunt-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Product Hunt Daily Products Scraper",
        "description": "Scrape Product Hunt for daily/top products with votes, reviews, descriptions, and maker information. Perfect for competitive analysis, market research, and founder intelligence.",
        "version": "0.0",
        "x-build-id": "WKSZMggaF3s8V7eTi"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/wsgcjj~product-hunt-scraper/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-wsgcjj-product-hunt-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/wsgcjj~product-hunt-scraper/runs": {
            "post": {
                "operationId": "runs-sync-wsgcjj-product-hunt-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/wsgcjj~product-hunt-scraper/run-sync": {
            "post": {
                "operationId": "run-sync-wsgcjj-product-hunt-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "properties": {
                    "date": {
                        "title": "Date",
                        "type": "string",
                        "description": "The date to scrape products for (format: YYYY-MM-DD). Defaults to today.",
                        "default": "2026-05-26"
                    },
                    "collection": {
                        "title": "Collection",
                        "enum": [
                            "tech",
                            "games",
                            "podcasts",
                            "books",
                            "developer-tools",
                            "artificial-intelligence",
                            "all"
                        ],
                        "type": "string",
                        "description": "Product Hunt collection to scrape.",
                        "default": "tech"
                    },
                    "min_votes": {
                        "title": "Minimum Upvotes",
                        "type": "integer",
                        "description": "Minimum upvotes filter — only products with at least this many upvotes will be included.",
                        "default": 0
                    },
                    "limit": {
                        "title": "Limit",
                        "maximum": 100,
                        "type": "integer",
                        "description": "Maximum number of products to return.",
                        "default": 25
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```