# Hacker News Search Scraper (Algolia API) (`chrisp1211/hackernews-scraper-max`) Actor

Hacker News Search Scraper (Algolia API). No API key required. Pay only per result; empty or failed runs cost nothing.

- **URL**: https://apify.com/chrisp1211/hackernews-scraper-max.md
- **Developed by:** [Christian Pichichero](https://apify.com/chrisp1211) (community)
- **Categories:** News
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

$0.50 / 1,000 records

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

## Hacker News Search Scraper (Algolia API)

**Hacker News Search Scraper (Algolia API)** — a fast, reliable hackernews scraper that needs **no API key**. You pay only for the results you get: failed or empty runs are always free.

This hackernews scraper runs on the [Apify platform](https://apify.com), so you can call it from the API, run it on a schedule, or export results to JSON, CSV, Excel, or Google Sheets.

### What this scraper does

- Extracts structured **hackernews** data with no browser or API key required
- Returns clean JSON, one record per result — ready for sheets, databases, or apps
- Pay-per-result pricing: you are never charged for a run that returns nothing
- Runs on demand or on a schedule, and integrates with 5,000+ apps via the Apify API and webhooks

### What data you get

Each result record includes fields such as:

- **Object Id** (`objectId`) — e.g. `"45751400"`
- **Title** (`title`) — e.g. `"Uv is the best thing to happen to the Python ecosystem i...`
- **Url** (`url`) — e.g. `"https://emily.space/posts/251023-uv"`
- **Author** (`author`) — e.g. `"todsacerdoti"`
- **Points** (`points`) — e.g. `2214`
- **Num Comments** (`numComments`) — e.g. `1324`
- **Created At** (`createdAt`) — e.g. `"2025-10-29T18:57:29Z"`
- **Story Text** (`storyText`) — e.g. `null`
- **Hn Url** (`hnUrl`) — e.g. `"https://news.ycombinator.com/item?id=45751400"`

### Input

| Field | Type | Description |
|---|---|---|
| `searchQueries` | array | Keywords to search Hacker News for (e.g. "rust", "openai"). Each query runs as its own search. Leave empty ... |
| `tags` | string | Which HN item type to fetch: story, comment, poll, show\_hn, ask\_hn, or front\_page. |
| `sortByDate` | boolean | If true, uses the search\_by\_date endpoint (newest first). If false, results are sorted by relevance/popular... |
| `maxResults` | integer | Maximum number of records to return per search query (1-5000). The API is paginated at 100 hits per page. |
| `minPoints` | integer | Only return stories/polls with at least this many points (applied server-side via numericFilters and re-che... |

### Example output

```json
{
  "type": "story",
  "objectId": "45751400",
  "title": "Uv is the best thing to happen to the Python ecosystem in a decade",
  "url": "https://emily.space/posts/251023-uv",
  "author": "todsacerdoti",
  "points": 2214,
  "numComments": 1324,
  "createdAt": "2025-10-29T18:57:29Z",
  "storyText": null,
  "hnUrl": "https://news.ycombinator.com/item?id=45751400",
  "scrapedAt": "2026-07-10T00:00:00Z"
}
```

### Use cases

- Monitor news and media coverage
- Track brands, topics, and competitors
- Feed research and trend-analysis pipelines
- Build alerting on breaking events

### Run it as a monitor (alerts on new hackernews)

Schedule this hackernews scraper to run automatically — hourly, daily, or on any cron schedule — with the built-in [Apify Scheduler](https://docs.apify.com/platform/schedules), and have results pushed to you by **webhook, email, Slack, or your own app** the moment they're ready. It's the easiest way to **monitor hackernews for changes over time** and get alerted the instant something new appears — no manual runs. Because pricing is per result, a scheduled monitor only ever charges you for the data each run actually returns.

### Pricing

This actor uses **pay-per-result** pricing at **$0.0005 per record**. There is no monthly fee and no start fee — and **empty or failed runs cost $0**, so you only ever pay for data you actually receive.

### Frequently asked questions

**Do I need an API key or account for the source?** No. This hackernews scraper works out of the box with no API key required.

**What happens if a run returns no results?** You are not charged. Billing is per result, so empty or failed runs are free.

**Can I run the hackernews scraper on a schedule?** Yes. Use the Apify Scheduler to run it hourly, daily, or on any cron schedule, and get results by webhook or API.

**What export formats are supported?** Results can be exported as JSON, CSV, Excel, HTML, or pushed to Google Sheets, a database, or your own app via the Apify API.

**Is the data structured?** Yes. Every hackernews result is a clean, flat JSON record you can use immediately.

# Actor input Schema

## `searchQueries` (type: `array`):

Keywords to search Hacker News for (e.g. "rust", "openai"). Each query runs as its own search. Leave empty to browse the selected tag without a keyword (top stories, or newest with Sort by date).

## `tags` (type: `string`):

Which HN item type to fetch: story, comment, poll, show\_hn, ask\_hn, or front\_page.

## `sortByDate` (type: `boolean`):

If true, uses the search\_by\_date endpoint (newest first). If false, results are sorted by relevance/popularity.

## `maxResults` (type: `integer`):

Maximum number of records to return per search query (1-5000). The API is paginated at 100 hits per page.

## `minPoints` (type: `integer`):

Only return stories/polls with at least this many points (applied server-side via numericFilters and re-checked client-side). Ignored for comments. 0 = no filter.

## `maxCostUsd` (type: `integer`):

HARD budget cap. The run stops cleanly before exceeding this.

## `proxyConfiguration` (type: `object`):

This is an open API; no proxy needed. Default is fine.

## Actor input object example

```json
{
  "searchQueries": [
    "python"
  ],
  "tags": "story",
  "sortByDate": false,
  "maxResults": 100,
  "minPoints": 0,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchQueries": [
        "python"
    ],
    "proxyConfiguration": {
        "useApifyProxy": false
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("chrisp1211/hackernews-scraper-max").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "searchQueries": ["python"],
    "proxyConfiguration": { "useApifyProxy": False },
}

# Run the Actor and wait for it to finish
run = client.actor("chrisp1211/hackernews-scraper-max").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchQueries": [
    "python"
  ],
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}' |
apify call chrisp1211/hackernews-scraper-max --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=chrisp1211/hackernews-scraper-max",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/JuG5UWrelYbllH6GY/builds/UJaC0OVTZ3wP7iEIP/openapi.json