# Hyper Reader (`ai_solutionist/hyper-reader`) Actor
High-fidelity web extraction for AI agents. Clean Markdown optimized for Claude, GPT-4 & Gemini. 3-level stealth, Vision screenshots, Deep Read link following. Standby Mode for 1-second responses.
- **URL**: https://apify.com/ai\_solutionist/hyper-reader.md
- **Developed by:** [Jason Pellerin](https://apify.com/ai_solutionist) (community)
- **Categories:** AI, Agents, Developer tools
- **Stats:** 12 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet
## Pricing
from $0.01 / actor start
This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage.
Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event
## What's an Apify Actor?
Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.
In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):
```bash
npm install apify-client
```
In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):
```bash
pip install apify-client
```
In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):
````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash
In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).
If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).
For usage examples, see the [API](#api) section below.
For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).
# README
## 🚀 Hyper-Reader: The Agentic Web Bridge
**Stop feeding your LLM messy HTML.** Hyper-Reader delivers high-fidelity, ad-free content optimized for Claude, GPT-4, and Gemini with sub-second response times.
Built by [Jason Pellerin AI Solutionist](https://jasonpellerin.com) — the same engineering behind enterprise AI voice agents and automation systems.
---
### Why Hyper-Reader?
| Problem | Hyper-Reader Solution |
|---------|----------------------|
| Raw HTML is noisy and token-expensive | Clean Markdown with smart content extraction |
| Anti-bot systems block your scrapers | 3-level stealth with fingerprint randomization |
| Different LLMs need different formats | Agent-optimized presets (Claude, GPT, Gemini) |
| Cold starts kill your agent's speed | Standby Mode for 1-second responses |
| Single pages lack context | Deep Read follows links for comprehensive data |
---
### 🎯 Agent Presets
Choose your target LLM for optimized output:
#### Claude (Default)
```xml
Article Title
John Doe
2024-01-15
https://example.com/article
# Main Heading
Clean, structured Markdown content...
````
#### GPT-4
```markdown
## Article Title
> Source: https://example.com/article
> Author: John Doe | Published: 2024-01-15
Content with inline citations [1] and reference links...
---
### References
[1]: https://example.com/article "Original Source"
```
#### Gemini
Compact Markdown optimized for Gemini's context window with aggressive token optimization.
#### SearchGPT
Web-search optimized format with prominent source attribution and fact-checkable structure.
***
### ⚡ Standby Mode
Enable **Standby Mode** for instant API responses. Your Actor stays warm and ready:
```bash
## Response time: ~1 second vs 30+ seconds cold start
curl -X POST "https://YOUR_ACTOR_STANDBY_URL/extract" \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com", "agentPreset": "Claude"}'
```
Perfect for:
- Real-time AI assistants
- MCP tool integrations
- Cursor/Claude Desktop extensions
- n8n and automation workflows
***
### 🛡️ Stealth Levels
#### Level 1: Basic
- Standard datacenter proxies
- Basic header rotation
- **Best for:** Blogs, news sites, documentation
#### Level 2: Standard (Default)
- Residential proxy rotation
- Browser fingerprint randomization
- WebGL/Canvas spoofing
- **Best for:** E-commerce, social media, most protected sites
#### Level 3: Elite
- Premium residential proxies
- Human-like mouse movements
- Session persistence
- Full anti-fingerprinting
- **Best for:** LinkedIn, Amazon, heavily protected sites
***
### 🔍 Deep Read
Gather comprehensive context by following internal links:
```json
{
"url": "https://example.com/product",
"deepReadDepth": 2,
"deepReadMaxPages": 10
}
```
Returns aggregated content from the main page plus related pages (About, FAQ, Reviews, etc.) in a single, structured document.
***
### 📸 Vision Screenshots
Capture page screenshots for Vision model analysis:
```json
{
"url": "https://example.com",
"useVision": true
}
```
Returns a 1280x720 optimized PNG stored in Apify's Key-Value Store, perfect for GPT-4V, Claude Vision, or Gemini Pro Vision.
***
### Input Schema
| Field | Type | Default | Description |
|-------|------|---------|-------------|
| `url` | string | - | Target URL to extract |
| `urls` | array | - | Multiple URLs (batch mode) |
| `agentPreset` | enum | `Claude` | Output optimization target |
| `outputFormat` | enum | `markdown` | `markdown`, `json`, or `html_cleaned` |
| `stealthLevel` | integer | `2` | 1-3 (Basic to Elite) |
| `useVision` | boolean | `false` | Capture screenshot |
| `deepReadDepth` | integer | `0` | Link following depth (0-3) |
| `waitForSelector` | string | - | CSS selector to wait for |
| `excludeSelectors` | string | - | Elements to remove (comma-separated) |
| `maxContentLength` | integer | `0` | Truncate output (0 = unlimited) |
***
### Output Structure
```json
{
"url": "https://example.com/article",
"finalUrl": "https://example.com/article/",
"format": "markdown",
"agentPreset": "Claude",
"content": "# Article Title\n\nClean markdown content...",
"metadata": {
"title": "Article Title",
"author": "John Doe",
"publishDate": "2024-01-15",
"description": "Article description...",
"wordCount": 1500,
"readingTimeMinutes": 7
},
"screenshotUrl": "https://api.apify.com/v2/key-value-stores/.../screenshot.png",
"processingTimeMs": 2340,
"charCount": 8500,
"extractedAt": "2024-01-15T10:30:00.000Z"
}
```
***
### Use Cases
#### 🤖 AI Agent Research
```javascript
// Feed clean web data to your AI agent
const result = await client.call('ai_solutionist/hyper-reader', {
url: 'https://docs.example.com/api',
agentPreset: 'Claude'
});
// result.content is ready for your LLM context
```
#### 📊 Competitive Intelligence
```javascript
// Extract competitor pages with deep context
const result = await client.call('ai_solutionist/hyper-reader', {
url: 'https://competitor.com/pricing',
deepReadDepth: 2,
agentPreset: 'GPT-4'
});
```
#### 🔗 MCP Tool Integration
```json
{
"mcpServers": {
"hyper-reader": {
"command": "npx",
"args": ["-y", "@anthropic-ai/mcp-apify"],
"env": {
"APIFY_TOKEN": "your_token",
"ACTOR_ID": "ai_solutionist/hyper-reader"
}
}
}
}
```
#### 📰 News Aggregation
```javascript
// Batch extract multiple articles
const result = await client.call('ai_solutionist/hyper-reader', {
urls: [
'https://news.site/article1',
'https://news.site/article2',
'https://news.site/article3'
],
agentPreset: 'Gemini',
outputFormat: 'json'
});
```
***
### Pricing
| Tier | Price | Features |
|------|-------|----------|
| **Standard** | $1 / 1,000 pages | Full extraction, all presets, Stealth 1-2 |
| **Elite** | $5 / 1,000 pages | Stealth Level 3, residential proxies |
| **Pro Monthly** | $49 / month | Standby Mode, unlimited standard proxy |
***
### Support
- **Documentation:** [jasonpellerin.com/hyper-reader](https://jasonpellerin.com/hyper-reader)
- **Issues:** Open an issue on GitHub
- **Enterprise:** [Contact Jason Pellerin](https://jasonpellerin.com/contact)
***
**Built with 🔥 by Jason Pellerin AI Solutionist**
*Transforming web chaos into agent-ready intelligence.*
## Build timestamp: Sun Jan 18 16:29:53 MST 2026
# Actor input Schema
## `url` (type: `string`):
The web page URL to extract content from.
## `urls` (type: `array`):
Extract from multiple URLs at once (one per line). Takes precedence over single URL.
## `agentPreset` (type: `string`):
Optimize output format for your target AI agent.
## `outputFormat` (type: `string`):
The format of the extracted content.
## `stealthLevel` (type: `integer`):
Anti-bot protection level. 1=Basic, 2=Standard, 3=Elite (heavy protection).
## `useVision` (type: `boolean`):
Capture a 1280x720 screenshot for Vision model analysis.
## `deepReadDepth` (type: `integer`):
Follow internal links to gather more context. 0 = single page only.
## `deepReadMaxPages` (type: `integer`):
Maximum number of pages to extract when using Deep Read.
## `waitForSelector` (type: `string`):
CSS selector to wait for before extracting (for JS-heavy pages).
## `waitForTimeout` (type: `integer`):
Maximum time to wait for page load.
## `excludeSelectors` (type: `string`):
CSS selectors to remove before extraction (comma-separated).
## `includeMetadata` (type: `boolean`):
Include title, author, date, and other metadata in output.
## `includeLinks` (type: `boolean`):
Keep hyperlinks in Markdown output.
## `includeImages` (type: `boolean`):
Include image URLs in Markdown output.
## `maxContentLength` (type: `integer`):
Truncate content if it exceeds this character count. 0 = no limit.
## `proxyConfiguration` (type: `object`):
Configure proxy for requests. Leave empty to use Apify's automatic proxy.
## Actor input object example
```json
{
"url": "https://example.com",
"agentPreset": "Claude",
"outputFormat": "markdown",
"stealthLevel": 2,
"useVision": false,
"deepReadDepth": 0,
"deepReadMaxPages": 10,
"waitForTimeout": 30000,
"excludeSelectors": "nav, footer, .ads, .sidebar, #cookie-banner",
"includeMetadata": true,
"includeLinks": true,
"includeImages": false,
"maxContentLength": 0,
"proxyConfiguration": {
"useApifyProxy": true,
"apifyProxyGroups": [
"RESIDENTIAL"
]
}
}
```
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"url": "https://example.com",
"excludeSelectors": "nav, footer, .ads, .sidebar, #cookie-banner"
};
// Run the Actor and wait for it to finish
const run = await client.actor("ai_solutionist/hyper-reader").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = {
"url": "https://example.com",
"excludeSelectors": "nav, footer, .ads, .sidebar, #cookie-banner",
}
# Run the Actor and wait for it to finish
run = client.actor("ai_solutionist/hyper-reader").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"url": "https://example.com",
"excludeSelectors": "nav, footer, .ads, .sidebar, #cookie-banner"
}' |
apify call ai_solutionist/hyper-reader --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com/?tools=ai_solutionist/hyper-reader",
"--header",
"Authorization: Bearer "
]
}
}
}
```
## OpenAPI specification
```json
{
"openapi": "3.0.1",
"info": {
"title": "Hyper Reader",
"description": "High-fidelity web extraction for AI agents. Clean Markdown optimized for Claude, GPT-4 & Gemini. 3-level stealth, Vision screenshots, Deep Read link following. Standby Mode for 1-second responses.",
"version": "1.5",
"x-build-id": "fxtTemTleTFNqB2Si"
},
"servers": [
{
"url": "https://api.apify.com/v2"
}
],
"paths": {
"/acts/ai_solutionist~hyper-reader/run-sync-get-dataset-items": {
"post": {
"operationId": "run-sync-get-dataset-items-ai_solutionist-hyper-reader",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
},
"/acts/ai_solutionist~hyper-reader/runs": {
"post": {
"operationId": "runs-sync-ai_solutionist-hyper-reader",
"x-openai-isConsequential": false,
"summary": "Executes an Actor and returns information about the initiated run in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK",
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/runsResponseSchema"
}
}
}
}
}
}
},
"/acts/ai_solutionist~hyper-reader/run-sync": {
"post": {
"operationId": "run-sync-ai_solutionist-hyper-reader",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
}
},
"components": {
"schemas": {
"inputSchema": {
"type": "object",
"properties": {
"url": {
"title": "Target URL",
"type": "string",
"description": "The web page URL to extract content from."
},
"urls": {
"title": "Multiple URLs",
"type": "array",
"description": "Extract from multiple URLs at once (one per line). Takes precedence over single URL.",
"items": {
"type": "string"
}
},
"agentPreset": {
"title": "Agent Optimization",
"enum": [
"Claude",
"GPT-4",
"Gemini",
"SearchGPT",
"Raw"
],
"type": "string",
"description": "Optimize output format for your target AI agent.",
"default": "Claude"
},
"outputFormat": {
"title": "Output Format",
"enum": [
"markdown",
"json",
"html_cleaned"
],
"type": "string",
"description": "The format of the extracted content.",
"default": "markdown"
},
"stealthLevel": {
"title": "Stealth Level",
"minimum": 1,
"maximum": 3,
"type": "integer",
"description": "Anti-bot protection level. 1=Basic, 2=Standard, 3=Elite (heavy protection).",
"default": 2
},
"useVision": {
"title": "Capture Screenshot for Vision",
"type": "boolean",
"description": "Capture a 1280x720 screenshot for Vision model analysis.",
"default": false
},
"deepReadDepth": {
"title": "Deep Read Depth",
"minimum": 0,
"maximum": 3,
"type": "integer",
"description": "Follow internal links to gather more context. 0 = single page only.",
"default": 0
},
"deepReadMaxPages": {
"title": "Deep Read Max Pages",
"minimum": 1,
"maximum": 50,
"type": "integer",
"description": "Maximum number of pages to extract when using Deep Read.",
"default": 10
},
"waitForSelector": {
"title": "Wait for Selector",
"type": "string",
"description": "CSS selector to wait for before extracting (for JS-heavy pages)."
},
"waitForTimeout": {
"title": "Wait Timeout (ms)",
"minimum": 1000,
"maximum": 60000,
"type": "integer",
"description": "Maximum time to wait for page load.",
"default": 30000
},
"excludeSelectors": {
"title": "Exclude Selectors",
"type": "string",
"description": "CSS selectors to remove before extraction (comma-separated)."
},
"includeMetadata": {
"title": "Include Metadata",
"type": "boolean",
"description": "Include title, author, date, and other metadata in output.",
"default": true
},
"includeLinks": {
"title": "Preserve Links",
"type": "boolean",
"description": "Keep hyperlinks in Markdown output.",
"default": true
},
"includeImages": {
"title": "Include Image URLs",
"type": "boolean",
"description": "Include image URLs in Markdown output.",
"default": false
},
"maxContentLength": {
"title": "Max Content Length",
"minimum": 0,
"type": "integer",
"description": "Truncate content if it exceeds this character count. 0 = no limit.",
"default": 0
},
"proxyConfiguration": {
"title": "Proxy Configuration",
"type": "object",
"description": "Configure proxy for requests. Leave empty to use Apify's automatic proxy.",
"default": {
"useApifyProxy": true,
"apifyProxyGroups": [
"RESIDENTIAL"
]
}
}
}
},
"runsResponseSchema": {
"type": "object",
"properties": {
"data": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"actId": {
"type": "string"
},
"userId": {
"type": "string"
},
"startedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"finishedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"status": {
"type": "string",
"example": "READY"
},
"meta": {
"type": "object",
"properties": {
"origin": {
"type": "string",
"example": "API"
},
"userAgent": {
"type": "string"
}
}
},
"stats": {
"type": "object",
"properties": {
"inputBodyLen": {
"type": "integer",
"example": 2000
},
"rebootCount": {
"type": "integer",
"example": 0
},
"restartCount": {
"type": "integer",
"example": 0
},
"resurrectCount": {
"type": "integer",
"example": 0
},
"computeUnits": {
"type": "integer",
"example": 0
}
}
},
"options": {
"type": "object",
"properties": {
"build": {
"type": "string",
"example": "latest"
},
"timeoutSecs": {
"type": "integer",
"example": 300
},
"memoryMbytes": {
"type": "integer",
"example": 1024
},
"diskMbytes": {
"type": "integer",
"example": 2048
}
}
},
"buildId": {
"type": "string"
},
"defaultKeyValueStoreId": {
"type": "string"
},
"defaultDatasetId": {
"type": "string"
},
"defaultRequestQueueId": {
"type": "string"
},
"buildNumber": {
"type": "string",
"example": "1.0.0"
},
"containerUrl": {
"type": "string"
},
"usage": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "integer",
"example": 1
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
},
"usageTotalUsd": {
"type": "number",
"example": 0.00005
},
"usageUsd": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "number",
"example": 0.00005
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
}
}
}
}
}
}
}
}
```