# Reliefweb Discovery Spider (`getdataforme/reliefweb-discovery-spider`) Actor

The Reliefweb Discovery Spider efficiently extracts and aggregates data from Reliefweb, providing insights on global crises and humanitarian efforts....

- **URL**: https://apify.com/getdataforme/reliefweb-discovery-spider.md
- **Developed by:** [GetDataForMe](https://apify.com/getdataforme) (community)
- **Categories:** AI, Automation, E-commerce
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $9.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):

```bash
npm install apify-client
```

In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):

```bash
pip install apify-client
```

In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):

````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash

In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).

If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).


# README

---

## Reliefweb Discovery Spider

The Reliefweb Discovery Spider is a powerful Apify Actor designed to scrape and extract disaster-related reports, news, and updates from ReliefWeb, the leading humanitarian information service. By inputting specific queries, it efficiently gathers timely and relevant data on global crises, enabling users to stay informed on humanitarian efforts, natural disasters, and emergency responses. This tool is invaluable for organizations, researchers, and analysts needing structured, up-to-date information from a trusted source.

### Features

- **Comprehensive Data Extraction**: Scrapes detailed reports including titles, summaries, sources, dates, and URLs from ReliefWeb's extensive database.
- **Query-Based Filtering**: Supports multiple search queries to target specific regions, disasters, or topics for precise results.
- **High Reliability**: Leverages ReliefWeb's official API and scraping techniques to ensure accurate, real-time data without duplicates.
- **Scalable Performance**: Handles large query sets efficiently, with built-in pagination for extensive searches.
- **Structured Output**: Delivers clean JSON data with metadata like posting dates and formats for easy integration.
- **Error-Resilient**: Includes retry mechanisms for network issues, ensuring robust operation.
- **No API Key Required**: Runs directly on Apify's platform, simplifying setup for users.

### Input Parameters

| Parameter | Type | Required | Description | Example |
|-----------|------|----------|-------------|---------|
| Queries | array | No | An array of search queries to filter ReliefWeb content. Each query targets specific keywords like countries or disaster types. | ["nepal", "earthquake"] |

### Example Usage

To run the actor, provide input in JSON format:

```json
{
  "Queries": ["nepal", "flood"]
}
````

Example output:

```json
[
  {
    "title": "Children and families at risk after 6.4-magnitude earthquake hits western Nepal",
    "url": "https://reliefweb.int/report/nepal/children-and-families-risk-after-64-magnitude-earthquake-hits-western-nepal",
    "country": "",
    "date_posted": "4 Nov 2023",
    "date_posted_datetime": "2023-11-04T16:20:06+00:00",
    "source": "UNICEF",
    "format": "News and Press Release",
    "summary": "UNICEF teams are on the ground providing urgent assistance to families in need and have already dispatched emergency supplies to the most affected areas in Jajarkot and Rukum West districts.",
    "query": "nepal",
    "actor_id": "Czjnfr8dEctUv4RuA",
    "run_id": "AScrEokG2IgOUJeoc"
  },
  {
    "title": "Continuous earthquake aftershocks displace thousands in Nepal, IFRC warns",
    "url": "https://reliefweb.int/report/nepal/nepal-earthquake-2023-dref-operation-mdrnp015",
    "country": "",
    "date_posted": "13 Oct 2023",
    "date_posted_datetime": "2023-10-13T15:10:02+00:00",
    "source": "IFRC",
    "format": "Situation Report",
    "summary": "Following a magnitude 5.3 earthquake earlier this month, an aftershock of equal strength has affected 36,250 people, and either fully or partially destroyed more than 7,000 houses.",
    "query": "nepal",
    "actor_id": "Czjnfr8dEctUv4RuA",
    "run_id": "AScrEokG2IgOUJeoc"
  },
  {
    "title": "Climate situation wreaks havoc in Asia Pacific, causing relentless floods, diseases and life-threatening heat",
    "url": "https://reliefweb.int/report/bangladesh/climate-situation-wreaks-havoc-asia-pacific-causing-relentless-floods-diseases-and-life-threatening-heat",
    "country": "",
    "date_posted": "10 Aug 2023",
    "date_posted_datetime": "2023-08-10T04:54:40+00:00",
    "source": "IFRC",
    "format": "News and Press Release",
    "summary": "As the full impact of El Niño is expected in the coming months, IFRC urges authorities and humanitarian organisations to brace for multiple disasters hitting simultaneously, with more intensity.",
    "query": "nepal",
    "actor_id": "Czjnfr8dEctUv4RuA",
    "run_id": "AScrEokG2IgOUJeoc"
  }
]
```

### Use Cases

- **Humanitarian Monitoring**: Track real-time updates on disasters for NGOs and aid organizations to coordinate responses.
- **Academic Research**: Gather historical and current data on global crises for studies in environmental science or sociology.
- **Media and Journalism**: Aggregate news and reports for in-depth coverage of international emergencies.
- **Government Intelligence**: Monitor regional threats and humanitarian needs for policy planning.
- **Risk Assessment**: Analyze patterns in disaster reports for insurance or urban planning purposes.
- **Content Aggregation**: Build databases of humanitarian information for websites or apps.

### Installation and Usage

1. Search for "Reliefweb Discovery Spider" in the Apify Store
2. Click "Try for free" or "Run"
3. Configure input parameters
4. Click "Start" to begin extraction
5. Monitor progress in the log
6. Export results in your preferred format (JSON, CSV, Excel)

### Output Format

The actor outputs an array of JSON objects, each representing a scraped report. Key fields include:

- `title`: The report's headline.
- `url`: Direct link to the full report on ReliefWeb.
- `country`: Associated country (may be empty).
- `date_posted`: Human-readable posting date.
- `date_posted_datetime`: ISO 8601 formatted datetime.
- `source`: Organization or entity publishing the report (e.g., UNICEF, IFRC).
- `format`: Type of document (e.g., News and Press Release, Situation Report).
- `summary`: Brief excerpt of the report's content.
- `query`: The original search query that matched the report.
- `actor_id` and `run_id`: Metadata for tracking the Apify run.

This structured format ensures easy parsing and integration into databases or analysis tools.

### Support

For custom/simplified outputs or bug reports, please contact:

- Email: support@getdataforme.com
- Subject line: "custom support"
- Contact form: https://getdataforme.com/contact/

We're here to help you get the most out of this Actor!

# Actor input Schema

## `Queries` (type: `array`):

The queries for the spider.

## Actor input object example

```json
{
  "Queries": [
    "nepal"
  ]
}
```

# Actor output Schema

## `results` (type: `string`):

Scraped data items from dataset

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("getdataforme/reliefweb-discovery-spider").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("getdataforme/reliefweb-discovery-spider").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call getdataforme/reliefweb-discovery-spider --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=getdataforme/reliefweb-discovery-spider",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

```json
{
    "openapi": "3.0.1",
    "info": {
        "title": "Reliefweb Discovery Spider",
        "description": "The Reliefweb Discovery Spider efficiently extracts and aggregates data from Reliefweb, providing insights on global crises and humanitarian efforts....",
        "version": "0.0",
        "x-build-id": "3Aj0DhnloHaHj1ptT"
    },
    "servers": [
        {
            "url": "https://api.apify.com/v2"
        }
    ],
    "paths": {
        "/acts/getdataforme~reliefweb-discovery-spider/run-sync-get-dataset-items": {
            "post": {
                "operationId": "run-sync-get-dataset-items-getdataforme-reliefweb-discovery-spider",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        },
        "/acts/getdataforme~reliefweb-discovery-spider/runs": {
            "post": {
                "operationId": "runs-sync-getdataforme-reliefweb-discovery-spider",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor and returns information about the initiated run in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK",
                        "content": {
                            "application/json": {
                                "schema": {
                                    "$ref": "#/components/schemas/runsResponseSchema"
                                }
                            }
                        }
                    }
                }
            }
        },
        "/acts/getdataforme~reliefweb-discovery-spider/run-sync": {
            "post": {
                "operationId": "run-sync-getdataforme-reliefweb-discovery-spider",
                "x-openai-isConsequential": false,
                "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
                "tags": [
                    "Run Actor"
                ],
                "requestBody": {
                    "required": true,
                    "content": {
                        "application/json": {
                            "schema": {
                                "$ref": "#/components/schemas/inputSchema"
                            }
                        }
                    }
                },
                "parameters": [
                    {
                        "name": "token",
                        "in": "query",
                        "required": true,
                        "schema": {
                            "type": "string"
                        },
                        "description": "Enter your Apify token here"
                    }
                ],
                "responses": {
                    "200": {
                        "description": "OK"
                    }
                }
            }
        }
    },
    "components": {
        "schemas": {
            "inputSchema": {
                "type": "object",
                "properties": {
                    "Queries": {
                        "title": "Queries",
                        "type": "array",
                        "description": "The queries for the spider.",
                        "default": [
                            "nepal"
                        ],
                        "items": {
                            "type": "string"
                        }
                    }
                }
            },
            "runsResponseSchema": {
                "type": "object",
                "properties": {
                    "data": {
                        "type": "object",
                        "properties": {
                            "id": {
                                "type": "string"
                            },
                            "actId": {
                                "type": "string"
                            },
                            "userId": {
                                "type": "string"
                            },
                            "startedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "finishedAt": {
                                "type": "string",
                                "format": "date-time",
                                "example": "2025-01-08T00:00:00.000Z"
                            },
                            "status": {
                                "type": "string",
                                "example": "READY"
                            },
                            "meta": {
                                "type": "object",
                                "properties": {
                                    "origin": {
                                        "type": "string",
                                        "example": "API"
                                    },
                                    "userAgent": {
                                        "type": "string"
                                    }
                                }
                            },
                            "stats": {
                                "type": "object",
                                "properties": {
                                    "inputBodyLen": {
                                        "type": "integer",
                                        "example": 2000
                                    },
                                    "rebootCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "restartCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "resurrectCount": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "computeUnits": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "options": {
                                "type": "object",
                                "properties": {
                                    "build": {
                                        "type": "string",
                                        "example": "latest"
                                    },
                                    "timeoutSecs": {
                                        "type": "integer",
                                        "example": 300
                                    },
                                    "memoryMbytes": {
                                        "type": "integer",
                                        "example": 1024
                                    },
                                    "diskMbytes": {
                                        "type": "integer",
                                        "example": 2048
                                    }
                                }
                            },
                            "buildId": {
                                "type": "string"
                            },
                            "defaultKeyValueStoreId": {
                                "type": "string"
                            },
                            "defaultDatasetId": {
                                "type": "string"
                            },
                            "defaultRequestQueueId": {
                                "type": "string"
                            },
                            "buildNumber": {
                                "type": "string",
                                "example": "1.0.0"
                            },
                            "containerUrl": {
                                "type": "string"
                            },
                            "usage": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "integer",
                                        "example": 1
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            },
                            "usageTotalUsd": {
                                "type": "number",
                                "example": 0.00005
                            },
                            "usageUsd": {
                                "type": "object",
                                "properties": {
                                    "ACTOR_COMPUTE_UNITS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATASET_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "KEY_VALUE_STORE_WRITES": {
                                        "type": "number",
                                        "example": 0.00005
                                    },
                                    "KEY_VALUE_STORE_LISTS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_READS": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "REQUEST_QUEUE_WRITES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_INTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "DATA_TRANSFER_EXTERNAL_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                                        "type": "integer",
                                        "example": 0
                                    },
                                    "PROXY_SERPS": {
                                        "type": "integer",
                                        "example": 0
                                    }
                                }
                            }
                        }
                    }
                }
            }
        }
    }
}
```