# Omni Jobs Board Scraper ~$2 per 500 results (`doggo/uk-jobs-board-scraper`) Actor international Jobs Board Scraper Search 14+ job boards across UK, US, EU & remote in one run Reed, Totaljobs, CV-Library, CWJobs, Indeed (6 countries), USAJobs, RemoteOK, Arbeitnow & Adzuna. Deduplicated results with parsed salaries and optional salary benchmarks. - **URL**: https://apify.com/doggo/uk-jobs-board-scraper.md - **Developed by:** [Doggo](https://apify.com/doggo) (community) - **Categories:** Jobs, Automation, Open source - **Stats:** 240 total users, 37 monthly users, 100.0% runs succeeded, 5 bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $4.00 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## International Jobs Board Scraper Search **14+ job boards** across the UK, US, EU and remote markets in a single run. Get one clean, deduplicated dataset with parsed salaries and optional salary benchmarks. ### Job Boards Covered #### UK Boards | Board | What It Covers | |-------|---------------| | **Reed.co.uk** | UK's #1 job site — huge range of industries | | **Totaljobs.com** | 280,000+ live jobs across all sectors | | **CV-Library.co.uk** | 120,000+ jobs, strong outside London | | **CWJobs.co.uk** | IT & Tech specialist roles | | **Indeed UK** | Global aggregator with massive UK reach | | **GOV.UK Find a Job** | Public sector & government roles | #### US Boards | Board | What It Covers | |-------|---------------| | **USAJobs.gov** | US federal government jobs (free API, no key needed) | | **Indeed US** | Largest US job aggregator | #### EU Boards | Board | What It Covers | |-------|---------------| | **Indeed DE** | Indeed Germany | | **Indeed FR** | Indeed France | | **Indeed NL** | Indeed Netherlands | | **Arbeitnow** | EU & remote tech jobs (free API) | #### Global / Remote | Board | What It Covers | |-------|---------------| | **Adzuna** | Multi-country API — UK, US, DE, FR, NL, AU (free API key) | | **RemoteOK** | Remote-first jobs worldwide (free API) | | **Indeed AU** | Indeed Australia | ### What You Get Every result includes structured, ready-to-use data: ```json { "title": "Junior Software Engineer", "company": "TechCorp Ltd", "location": "London", "salary_raw": "£30,000 - £40,000 per annum", "salary_min": 30000, "salary_max": 40000, "salary_period": "annum", "snippet": "We are looking for a passionate junior developer...", "employment_type": "Permanent", "date_posted": "2026-03-05", "url": "https://www.reed.co.uk/jobs/junior-software-engineer/12345", "job_id": "12345", "source": "reed.co.uk" } ```` Salaries are automatically parsed into min/max numbers with currency detection (GBP, USD, EUR). Duplicates posted across multiple boards are removed automatically. #### Salary Benchmarks (Optional) Enable the **Include Salary Benchmarks** toggle to get aggregated salary stats alongside your job listings: ```json { "_type": "salary_benchmark", "benchmark_title": "software engineer", "benchmark_location": "london", "count": 42, "salary_mean": 55000, "salary_median": 52000, "salary_p25": 42000, "salary_p75": 65000, "salary_min": 30000, "salary_max": 95000 } ``` All salaries are annualised (daily/hourly rates converted) for fair comparison. ### How to Use 1. Click **Start** on the actor page 2. Pick a **country** (UK, US, Germany, France, Netherlands, Australia, or Remote) 3. Select a **job role** from the dropdown, or type a custom keyword 4. Pick a **location** from the dropdown, or type a custom city/town 5. Set how many results you want (default: 50, or 0 for unlimited) 6. Hit **Run** — results are ready in a few minutes Export your results as **JSON, CSV, or Excel** directly from the Apify dashboard. ### Input Options | Setting | Default | What It Does | |---------|---------|-------------| | **Job Role Preset** | Software Engineer | Pick from 25 popular roles or choose "Custom" | | **Custom Keyword** | — | Type your own search keyword (overrides preset) | | **Location Preset** | London | Pick from 27 cities across UK/US/EU/AU or "Remote" | | **Custom Location** | — | Type your own location (overrides preset) | | **Country** | UK | Determines which boards are auto-selected | | **Max Results** | 50 | Total jobs to return. Set 0 for unlimited | | **Minimum Salary** | — | Pick a preset threshold or type a custom number | | **Job Type** | All | Filter by Permanent, Temporary, Contract, or Part-time | | **Job Boards** | Auto | Leave empty to auto-select based on country, or pick specific boards | | **Fetch Full Descriptions** | Off | Fetches each job's detail page. More data but costs more | | **Remove Duplicates** | On | Removes the same job appearing on multiple boards | | **Salary Benchmarks** | Off | Output salary summary statistics per role/location | ### Country Defaults When you leave the boards selection empty, boards are auto-picked based on country: | Country | Boards | |---------|--------| | UK | Reed, Totaljobs, CV-Library, CWJobs, Indeed UK, GOV.UK, Adzuna | | US | USAJobs, Indeed US, Adzuna, RemoteOK | | Germany | Indeed DE, Adzuna, Arbeitnow | | France | Indeed FR, Adzuna | | Netherlands | Indeed NL, Adzuna | | Australia | Indeed AU, Adzuna | | Remote | RemoteOK, Arbeitnow, Adzuna | ### Enabling Adzuna (Optional) Adzuna uses a free API instead of scraping — it's the cheapest source to run. To include it: 1. Sign up at [developer.adzuna.com](https://developer.adzuna.com) (free) 2. Create an app to get your **App ID** and **App Key** 3. Paste them into the input fields Without these keys, Adzuna is simply skipped — everything else works fine. Adzuna supports multiple countries and automatically switches based on your country selection. ### Saving Money The biggest cost driver is **detail page fetching** — Reed and GOV.UK Find a Job used to fetch each job's individual page for full descriptions. This is now **off by default**. Tips to reduce costs: - Leave **Fetch Full Descriptions** off (saves ~50% on Reed and FindAJob) - Use **API-based boards** where possible (Adzuna, USAJobs, RemoteOK, Arbeitnow) — they're much cheaper than HTML scrapers - Remove boards you don't need - Set a reasonable **Max Results** limit ### Use Cases - **Job seekers** — Search once, see results from everywhere - **Recruiters** — Monitor the market for specific roles and locations - **Salary benchmarking** — Compare pay by role and location with structured stats - **Market analysis** — Track hiring trends across countries - **Lead generation** — Find companies that are actively hiring - **Remote job hunting** — Search RemoteOK + Arbeitnow + Adzuna in one go ### Tips - Use the **country selector** to auto-pick the right boards — no need to configure boards manually - The **salary filter** works best on boards that show salary upfront (Reed, CV-Library, Adzuna, USAJobs) - **GOV.UK Find a Job** is great for public sector and NHS roles - **USAJobs** is great for US federal government positions — no API key needed - Results are sorted by date — newest listings first - Enable **salary benchmarks** when doing market research to get median/mean/percentile stats # Actor input Schema ## `keyword` (type: `string`): Pick a common role or choose 'Custom' and type your own below ## `custom_keyword` (type: `string`): Type your own search keyword here. Overrides the preset above when filled in. ## `location` (type: `string`): Pick a common location or choose 'Custom' and type your own below ## `custom_location` (type: `string`): Type your own location here. Overrides the preset above when filled in. ## `country` (type: `string`): Target country for job search. Determines which boards are auto-selected and which proxy region to use. ## `max_results` (type: `integer`): Maximum total job listings to return (spread across all boards). Minimum 100. ## `unlimited` (type: `boolean`): Scrape without a results cap. Results are saved as they come in, so you keep everything even if you stop the run early. Overrides Max Results. ## `salary_min` (type: `integer`): Minimum annual salary filter (e.g. 30000, 50000, 75000). Leave empty for no filter. ## `job_type` (type: `string`): Filter by employment type ## `boards` (type: `array`): Pick specific boards or leave empty to auto-select based on your chosen country. ## `deduplicate` (type: `boolean`): Remove duplicate jobs that appear on multiple boards ## `salary_benchmark` (type: `boolean`): Output salary summary statistics (median, mean, p25, p75) alongside job listings ## `adzuna_app_id` (type: `string`): Optional: Adzuna API App ID (free at https://developer.adzuna.com) ## `adzuna_app_key` (type: `string`): Optional: Adzuna API App Key ## Actor input object example ```json { "keyword": "software engineer", "location": "London", "country": "uk", "max_results": 100, "unlimited": false, "job_type": "all", "boards": [], "deduplicate": true, "salary_benchmark": false } ``` # Actor output Schema ## `jobListings` (type: `string`): Structured job data from all selected boards # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("doggo/uk-jobs-board-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("doggo/uk-jobs-board-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call doggo/uk-jobs-board-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=doggo/uk-jobs-board-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Omni Jobs Board Scraper ~$2 per 500 results", "description": "international Jobs Board Scraper\nSearch 14+ job boards across UK, US, EU & remote in one run\nReed, Totaljobs, CV-Library, CWJobs, Indeed (6 countries), USAJobs, RemoteOK, Arbeitnow & Adzuna. Deduplicated results with parsed salaries and optional salary benchmarks.", "version": "0.3", "x-build-id": "XPKfZqbsuKO80XVbd" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/doggo~uk-jobs-board-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-doggo-uk-jobs-board-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/doggo~uk-jobs-board-scraper/runs": { "post": { "operationId": "runs-sync-doggo-uk-jobs-board-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/doggo~uk-jobs-board-scraper/run-sync": { "post": { "operationId": "run-sync-doggo-uk-jobs-board-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "keyword", "location" ], "properties": { "keyword": { "title": "Job Role Preset", "enum": [ "software engineer", "data analyst", "data scientist", "web developer", "frontend developer", "backend developer", "fullstack developer", "devops engineer", "cloud engineer", "cybersecurity analyst", "product manager", "project manager", "UX designer", "business analyst", "marketing manager", "accountant", "nurse", "teacher", "sales executive", "customer service", "warehouse operative", "mechanical engineer", "electrical engineer", "civil engineer", "HR manager", "__custom__" ], "type": "string", "description": "Pick a common role or choose 'Custom' and type your own below", "default": "software engineer" }, "custom_keyword": { "title": "Custom Keyword", "type": "string", "description": "Type your own search keyword here. Overrides the preset above when filled in." }, "location": { "title": "Location Preset", "enum": [ "London", "Manchester", "Birmingham", "Leeds", "Edinburgh", "Glasgow", "Bristol", "Liverpool", "Cardiff", "Belfast", "Cambridge", "Oxford", "Remote", "New York", "San Francisco", "Los Angeles", "Chicago", "Austin", "Seattle", "Washington DC", "Berlin", "Munich", "Paris", "Amsterdam", "Sydney", "Melbourne", "__custom__" ], "type": "string", "description": "Pick a common location or choose 'Custom' and type your own below", "default": "London" }, "custom_location": { "title": "Custom Location", "type": "string", "description": "Type your own location here. Overrides the preset above when filled in." }, "country": { "title": "Country / Region", "enum": [ "uk", "us", "de", "fr", "nl", "au", "remote" ], "type": "string", "description": "Target country for job search. Determines which boards are auto-selected and which proxy region to use.", "default": "uk" }, "max_results": { "title": "Max Results", "minimum": 100, "type": "integer", "description": "Maximum total job listings to return (spread across all boards). Minimum 100.", "default": 100 }, "unlimited": { "title": "Unlimited Mode", "type": "boolean", "description": "Scrape without a results cap. Results are saved as they come in, so you keep everything even if you stop the run early. Overrides Max Results.", "default": false }, "salary_min": { "title": "Minimum Salary", "type": "integer", "description": "Minimum annual salary filter (e.g. 30000, 50000, 75000). Leave empty for no filter." }, "job_type": { "title": "Job Type", "enum": [ "all", "permanent", "temporary", "contract", "part-time" ], "type": "string", "description": "Filter by employment type", "default": "all" }, "boards": { "title": "Job Boards to Scrape", "type": "array", "description": "Pick specific boards or leave empty to auto-select based on your chosen country.", "items": { "type": "string", "enum": [ "reed", "totaljobs", "cvlibrary", "cwjobs", "indeed", "findajob", "adzuna", "usajobs", "indeed_us", "indeed_de", "indeed_fr", "indeed_nl", "indeed_au", "remoteok", "arbeitnow" ], "enumTitles": [ "Reed (UK)", "Totaljobs (UK)", "CV-Library (UK)", "CWJobs (UK)", "Indeed UK", "GOV.UK Find a Job", "Adzuna (Multi-Country)", "USAJobs (US Gov)", "Indeed US", "Indeed Germany", "Indeed France", "Indeed Netherlands", "Indeed Australia", "RemoteOK (Global Remote)", "Arbeitnow (EU & Remote)" ] }, "default": [] }, "deduplicate": { "title": "Remove Duplicates", "type": "boolean", "description": "Remove duplicate jobs that appear on multiple boards", "default": true }, "salary_benchmark": { "title": "Include Salary Benchmarks", "type": "boolean", "description": "Output salary summary statistics (median, mean, p25, p75) alongside job listings", "default": false }, "adzuna_app_id": { "title": "Adzuna App ID", "type": "string", "description": "Optional: Adzuna API App ID (free at https://developer.adzuna.com)" }, "adzuna_app_key": { "title": "Adzuna App Key", "type": "string", "description": "Optional: Adzuna API App Key" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```