# 🛡️⚡ Cloudflare Scraper - Bypass All Captchas (`neatrat/cloudflare-scraper`) Actor

Updated June 2025, No proxies needed! A powerful web scraper that bypasses Cloudflare protection.

- **URL**: https://apify.com/neatrat/cloudflare-scraper.md
- **Developed by:** [Neatrat](https://apify.com/neatrat) (community)
- **Categories:** Automation, Developer tools
- **Stats:** 131 total users, 5 monthly users, 100.0% runs succeeded, 4 bookmarks
- **User rating**: 3.32 out of 5 stars

## Pricing

$39.00/month + usage

To use this Actor, you pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period.You also pay for the Apify platform usage, which gets cheaper the higher Apify subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#rental-actors

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

## 🛡️⚡ Cloudflare Scraper - Bypass Any Protection

### 🌟 Overview

Welcome to the **most powerful Cloudflare scraper** on Apify! This cutting-edge tool effortlessly bypasses Cloudflare protection, bot detection, and anti-scraping measures using advanced browser automation technology. **Scrape any website protected by Cloudflare with 99%+ success rate** - from simple sites to the most heavily protected enterprise applications.

### 🚀 Key Features

- **🛡️ Cloudflare Bypass**: Seamlessly bypass Cloudflare protection, DDoS Guard, and other anti-bot systems
- **🔄 Smart Failover**: Multiple solver instances with automatic failover for maximum reliability
- **🌐 Proxies Included**: Premium proxies built-in - no additional proxy costs or setup required!
- **🍪 Advanced Cookie Handling**: Full cookie support with automatic domain/path configuration
- **⚡ Lightning Fast**: Optimized for speed with intelligent retry mechanisms
- **🔧 Highly Configurable**: Support for custom proxies and cookies
- **📊 Detailed Analytics**: Comprehensive response data including cookies, user agents, and status codes

---

### 🎯 Perfect For

- **🛒 E-commerce Scraping**: Extract product data from protected online stores
- **📰 News & Media**: Scrape articles from news sites with Cloudflare protection
- **💼 Business Intelligence**: Gather competitive data from protected business sites
- **🏢 Enterprise Data**: Access corporate websites and applications
- **🔍 SEO Research**: Analyze protected competitor websites
- **📈 Market Research**: Collect data from protected market research platforms

---

### 🧩 Input Configuration

#### Required Fields
- **🌐 url** (required): Target URL to scrape (must include http:// or https://)

#### Optional Fields
- **🌐 proxy**: Custom proxy configuration (optional - premium proxies included by default!)
  ```json
  {
    "url": "http://proxy.example.com:8080",
    "username": "your_username",
    "password": "your_password"
  }
````

- **🍪 cookies**: Array of cookies to include in the request
  ```json
  [
    {
      "name": "session_id",
      "value": "abc123",
      "domain": "example.com",
      "path": "/",
      "secure": true
    }
  ]
  ```

***

### 📦 Output Format

#### Successful Scrape

```json
{
  "url": "https://example.com",
  "content": "<html>...</html>",
  "cookies": [
    {
      "name": "cf_clearance",
      "value": "xyz789...",
      "domain": ".example.com"
    }
  ],
  "userAgent": "Mozilla/5.0...",
  "status": "200",
  "success": true,
  "timestamp": "2024-01-15T10:30:00.000Z"
}
```

#### Failed Scrape

```json
{
  "url": "https://example.com",
  "error": "All solver URLs failed: Cloudflare challenge failed",
  "success": false,
  "timestamp": "2024-01-15T10:30:00.000Z"
}
```

***

### 🔥 Advanced Features

#### 🌐 Premium Proxies Included

- High-quality residential and datacenter proxies
- **No additional proxy costs** - included in scraper pricing!
- Automatic IP rotation
- Support for custom proxy configurations if needed

#### 🍪 Intelligent Cookie Management

- Automatic cookie processing and validation
- Domain and path auto-configuration
- Secure flag handling based on protocol

#### 🔄 Robust Error Handling

- Exponential backoff retry mechanism
- Detailed error reporting
- Comprehensive logging for debugging

***

### 💻 Usage Examples

#### Basic Scraping

```json
{
  "url": "https://example.com"
}
```

#### Advanced Configuration with Cookies

```json
{
  "url": "https://example.com",
  "cookies": [
    {
      "name": "session",
      "value": "abc123"
    }
  ]
}
```

#### Custom Proxy (Optional)

```json
{
  "url": "https://example.com",
  "proxy": {
    "url": "http://your-proxy.com:8080",
    "username": "user",
    "password": "pass"
  }
}
```

***

### 🚀 Quick Start Guide

1. **👤 Create Apify Account**: [Sign up here](https://apify.com/sign-up) if you haven't already
2. **🔧 Configure Input**: Set your target URL and optional parameters
3. **▶️ Run the Scraper**: Click run and watch the magic happen
4. **📊 View Results**: Access your data in multiple convenient formats
5. **📥 Export Data**: Download as JSON, CSV, or integrate via API

***

### 🎯 Success Tips

- **🕐 Timing**: Add delays between requests for better success rates
- **🔄 Retry Logic**: Use the built-in retry mechanism for reliability
- **🍪 Cookies**: Leverage cookies for session-based scraping
- **📱 User Agents**: Our solvers automatically handle user agent rotation
- **🌐 No Proxy Setup**: Premium proxies are included - just run and scrape!

***

### 📊 Performance Metrics

- **✅ Success Rate**: 99%+ for most Cloudflare-protected sites
- **⚡ Average Response Time**: 15-30 seconds per request
- **🔄 Uptime**: 99.9% service availability
- **🛡️ Bypass Rate**: Successfully bypasses Cloudflare, DDoS Guard, and similar protections

***

### 🛠️ Technical Specifications

- **🏗️ Built on**: Apify Platform with TypeScript
- **🤖 Solver Technology**: Advanced browser automation
- **🌐 Proxy Support**: Premium proxies included + custom proxy support
- **📦 Output Formats**: JSON, CSV, Excel
- **🔄 Concurrency**: Optimized for parallel processing
- **💾 Memory**: 256MB - 512MB allocation for optimal performance

***

### ❓ FAQ

**🤔 What sites can this scrape?**
Any website protected by Cloudflare, DDoS Guard, or similar anti-bot systems. Success rate is 99%+ for most sites.

**🕐 How long does each request take?**
Typically 15-30 seconds per request, depending on the complexity of the protection.

**🌐 Do I need to buy proxies?**
No! Premium proxies are included in the scraper cost. No additional proxy expenses or setup required.

**🍪 Can I use cookies from previous sessions?**
Yes! Our advanced cookie handling makes it easy to maintain sessions across requests.

**🔄 What if a request fails?**
Built-in retry logic with smart failover across multiple solver instances ensures maximum reliability.

***

### 🤝 Support & Feedback

Need help or have suggestions?

- 💬 **Support/Bug Reports**: Reach out via Apify issues
- 💡 **Feature Requests**: We're always improving based on user feedback

***

### 🏆 Why Choose Our Cloudflare Scraper?

✅ **Proven Technology**: Battle-tested across thousands of protected sites\
✅ **Maximum Reliability**: Smart failover and retry mechanisms\
✅ **All-Inclusive Pricing**: Premium proxies included - no hidden costs\
✅ **Zero Setup**: No proxy configuration needed - just run and scrape\
✅ **Easy Integration**: Simple API with comprehensive documentation\
✅ **Continuous Updates**: Regular improvements and new features

# Actor input Schema

## `url` (type: `string`):

The URL to scrape. Must include protocol (http:// or https://)

## `proxy` (type: `object`):

Optional custom proxy configuration. If not provided, we use our own proxies. Format: {"url": "http://proxy.com:8080", "username": "user", "password": "pass"}

## `cookies` (type: `array`):

Optional cookies to include in the request. Format: \[{"name": "cookieName", "value": "cookieValue", "domain": "example.com"}]

## Actor input object example

```json
{
  "url": "https://de.indeed.com/jobs?q=Assistenzarzt+Chirurgie&filter=0"
}
```

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "url": "https://de.indeed.com/jobs?q=Assistenzarzt+Chirurgie&filter=0"
};

// Run the Actor and wait for it to finish
const run = await client.actor("neatrat/cloudflare-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "url": "https://de.indeed.com/jobs?q=Assistenzarzt+Chirurgie&filter=0" }

# Run the Actor and wait for it to finish
run = client.actor("neatrat/cloudflare-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "url": "https://de.indeed.com/jobs?q=Assistenzarzt+Chirurgie&filter=0"
}' |
apify call neatrat/cloudflare-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=neatrat/cloudflare-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "🛡️⚡ Cloudflare Scraper - Bypass All Captchas",
        "description": "Updated June 2025, No proxies needed! A powerful web scraper that bypasses Cloudflare protection.",
        "version": "1.0",
        "x-build-id": "74RTT1GiW1djgnqGo"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/neatrat~cloudflare-scraper/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-neatrat-cloudflare-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/neatrat~cloudflare-scraper/runs": {
            "post": {
                "operationId": "runs-sync-neatrat-cloudflare-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/neatrat~cloudflare-scraper/run-sync": {
            "post": {
                "operationId": "run-sync-neatrat-cloudflare-scraper",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "required": [
                    "url"
                ],
                "properties": {
                    "url": {
                        "title": "Target URL",
                        "pattern": "^https?://.*",
                        "type": "string",
                        "description": "The URL to scrape. Must include protocol (http:// or https://)"
                    },
                    "proxy": {
                        "title": "Custom Proxy (Optional, proxies are included by default)",
                        "type": "object",
                        "description": "Optional custom proxy configuration. If not provided, we use our own proxies. Format: {\"url\": \"http://proxy.com:8080\", \"username\": \"user\", \"password\": \"pass\"}"
                    },
                    "cookies": {
                        "title": "Cookies",
                        "type": "array",
                        "description": "Optional cookies to include in the request. Format: [{\"name\": \"cookieName\", \"value\": \"cookieValue\", \"domain\": \"example.com\"}]"
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```