# Omni Remote Jobs Scraper (`automation-lab/omni-remote-jobs-scraper`) Actor Scrape normalized remote job listings from public job boards with deduplication, filters, clean fields, and required source attribution. - **URL**: https://apify.com/automation-lab/omni-remote-jobs-scraper.md - **Developed by:** [Stas Persiianenko](https://apify.com/automation-lab) (community) - **Categories:** Jobs - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.21 / 1,000 result extracteds This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Omni Remote Jobs Scraper Collect normalized remote job listings from public job-board APIs in one Apify Actor run. ### What does Omni Remote Jobs Scraper do? Omni Remote Jobs Scraper extracts job listings from public remote and EU job sources, normalizes the fields, removes duplicates, and saves clean rows to an Apify dataset. It is built for workflows where you need a repeatable job feed instead of manually opening several job boards and merging CSV files. ### Who is it for? #### Recruiting and sourcing teams - Monitor fresh remote roles by keyword, region, and source in one repeatable run. - Build shortlists of companies currently hiring for specific skills. - Export normalized jobs to spreadsheets, CRMs, or recruiting dashboards. #### Job-board and community operators - Seed public job boards with attributed listings from remote-friendly sources. - Track competing boards without manually reconciling duplicate postings. - Keep ingestion pipelines simple with one consistent dataset shape. #### Market intelligence and HR analytics teams - Compare remote hiring patterns across role categories, locations, and employers. - Feed labor-market dashboards with clean title, company, salary, tag, and date fields. - Run scheduled snapshots for trend analysis or alerts. ### Why use this actor? Running several single-source scrapers creates duplicated rows, inconsistent field names, and missing source attribution. This actor gives you one normalized dataset with source, title, company, location, job type, salary, tags, post date, job URL, and attribution. ### Public sources included The first version uses public HTTP JSON APIs only. - Arbeitnow public job board API. - Remotive public remote jobs API. Remotive results include attribution text and the original Remotive URL so you can preserve the link-back when reusing listings. ### Data fields | Field | Description | | --- | --- | | `source` | Source API name. | | `sourceJobId` | Source-specific listing ID. | | `url` | Original job listing URL. | | `title` | Job title. | | `companyName` | Hiring company. | | `location` | Listing location. | | `isRemote` | Whether the listing is remote. | | `candidateRequiredLocation` | Candidate location requirement when available. | | `jobType` | Employment type. | | `category` | Job category. | | `tags` | Skills, departments, or source tags. | | `salary` | Salary text when published. | | `descriptionText` | Clean text description. | | `descriptionHtml` | Optional original HTML description. | | `postedAt` | ISO posting date when available. | | `postedTimestamp` | Unix posting timestamp when available. | | `scrapedAt` | Actor scrape timestamp. | | `attribution` | Source attribution/link-back note. | | `dedupeKey` | Cross-source dedupe key. | ### How much does it cost to scrape remote jobs? The actor uses pay-per-event pricing. You pay a small run-start fee of $0.005 and then a tiered per-result fee for each normalized job saved. The BRONZE per-result price is about $0.000357 per job, with lower rates on higher Apify subscription tiers. A small test with 20 jobs is designed to stay inexpensive. ### How to run it 1. Open the actor on Apify. 2. Choose sources: Arbeitnow, Remotive, or both. 3. Set a maximum number of jobs. 4. Add a keyword such as `frontend`, `python`, `data analyst`, or leave it empty. 5. Optionally add location keywords such as `Worldwide`, `Europe`, or `Germany`. 6. Run the actor. 7. Export the dataset as JSON, CSV, Excel, XML, or via API. ### Input options #### Sources Select one or both public job sources. #### Maximum jobs Controls how many deduplicated jobs are saved after filtering. #### Keyword filter Searches title, company, location, category, tags, salary, and description text. #### Location keywords Use this when you only need jobs for a specific region. #### Remote jobs only When enabled, non-remote Arbeitnow listings are skipped. #### Include description HTML Enable this when your downstream system needs rich text. Disable it for smaller exports. ### Example input ```json { "sources": ["arbeitnow", "remotive"], "maxItems": 25, "query": "frontend", "locations": ["Worldwide"], "remoteOnly": true, "includeDescriptionHtml": false } ```` ### Example output ```json { "source": "remotive", "sourceJobId": "2090991", "url": "https://remotive.com/remote-jobs/software-development/frontend-developer-2090991", "title": "Frontend Developer", "companyName": "Example Company", "location": "Worldwide", "isRemote": true, "candidateRequiredLocation": "Worldwide", "jobType": "full_time", "category": "Software Development", "tags": ["javascript", "react"], "salary": "$20k - $35k", "descriptionText": "This posting is for a Frontend Developer...", "postedAt": "2026-06-16T06:59:30.000Z", "postedTimestamp": 1781593170, "scrapedAt": "2026-06-18T00:00:00.000Z", "attribution": "Source: Remotive public API...", "dedupeKey": "frontend-developer-example-company-worldwide" } ``` ### Tips for best results - Start with 25 jobs to validate your filters. - Use broad keywords first, then narrow down. - Leave locations empty if you want all countries. - Keep `descriptionHtml` disabled unless you need formatting. - Preserve the `url` and `attribution` fields when republishing listings. ### Integrations Use the dataset in: - Recruiting dashboards. - Airtable or Google Sheets automations. - CRM enrichment workflows. - Labor-market monitoring reports. - Job-board ingestion pipelines. - Slack alerts for new roles. ### API usage with Node.js ```js import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: process.env.APIFY_TOKEN }); const run = await client.actor('automation-lab/omni-remote-jobs-scraper').call({ sources: ['arbeitnow', 'remotive'], maxItems: 25, query: 'frontend', locations: ['Worldwide'], remoteOnly: true }); const { items } = await client.dataset(run.defaultDatasetId).listItems(); console.log(items); ``` ### API usage with Python ```python from apify_client import ApifyClient import os client = ApifyClient(os.environ['APIFY_TOKEN']) run = client.actor('automation-lab/omni-remote-jobs-scraper').call(run_input={ 'sources': ['arbeitnow', 'remotive'], 'maxItems': 25, 'query': 'frontend', 'locations': ['Worldwide'], 'remoteOnly': True, }) items = client.dataset(run['defaultDatasetId']).list_items().items print(items) ``` ### API usage with cURL ```bash curl -X POST "https://api.apify.com/v2/acts/automation-lab~omni-remote-jobs-scraper/runs?token=$APIFY_TOKEN" \ -H 'Content-Type: application/json' \ -d '{"sources":["arbeitnow","remotive"],"maxItems":25,"query":"frontend","locations":["Worldwide"],"remoteOnly":true}' ``` ### MCP integration Use this actor through Apify MCP from Claude Code, Claude Desktop, Cursor, or any MCP-compatible client. MCP server URL: ```text https://mcp.apify.com/?tools=automation-lab/omni-remote-jobs-scraper ``` Claude Code setup: ```bash claude mcp add apify-omni-remote-jobs --transport http "https://mcp.apify.com/?tools=automation-lab/omni-remote-jobs-scraper" ``` Claude Desktop or JSON-based MCP client setup: ```json { "mcpServers": { "apify-omni-remote-jobs": { "url": "https://mcp.apify.com/?tools=automation-lab/omni-remote-jobs-scraper" } } } ``` Example prompts: - "Find 50 remote frontend jobs worldwide and summarize the top hiring companies." - "Scrape remote data analyst roles in Europe and export them as CSV." - "Run the Omni Remote Jobs Scraper for Python jobs and compare categories." ### Deduplication The actor creates a normalized dedupe key from title, company, and location. If two sources contain the same role with matching normalized values, only the first saved row is kept. ### Source attribution Every row includes an attribution field. For Remotive, keep the original job URL and attribution text when redistributing or displaying the listing. ### Limitations The actor only extracts public data available from the source APIs. It does not apply to jobs, log in to job boards, bypass paywalls, or scrape private candidate data. Some sources may publish delayed, incomplete, or removed listings. ### Legality This actor collects publicly available job listing data. You are responsible for using the output in compliance with source terms, privacy rules, copyright rules, and applicable laws. Do not use the data for spam, credential harvesting, or discriminatory hiring workflows. ### FAQ #### Does this scrape private candidate or applicant data? No. It only reads public job listing APIs and returns listing-level data such as title, company, location, tags, salary text, URL, and source attribution. #### Can I republish Remotive jobs? Keep the original job URL and attribution field in your downstream workflow. Remotive asks API users to preserve attribution/link-back, so every Remotive row includes this context. ### Troubleshooting #### Why did I get fewer jobs than `maxItems`? Filters are applied after fetching and deduplication. Try a broader keyword or remove location filters. #### Why is salary empty? Many job boards do not publish salary information for every role. #### Why are some descriptions plain text? The default output strips HTML to keep datasets compact. Enable `includeDescriptionHtml` for raw HTML. ### Related scrapers - https://apify.com/automation-lab/himalayas-remote-jobs-scraper - https://apify.com/automation-lab/remoteok-jobs-scraper - https://apify.com/automation-lab/jobicy-jobs-scraper - https://apify.com/automation-lab/multi-ats-jobs-scraper ### Changelog #### 0.1 Initial HTTP-only version with Arbeitnow and Remotive sources, normalized output, filters, attribution, and deduplication. ### Support If a source changes its API or you need another public job board added, open an issue from the Apify actor page. # Actor input Schema ## `sources` (type: `array`): Public job APIs to include. Remotive listings include source attribution in every result. ## `maxItems` (type: `integer`): Total number of deduplicated job listings to save after filters. ## `query` (type: `string`): Optional keyword such as frontend, data analyst, python, marketing, or recruiter. Leave empty to collect a broader feed. ## `locations` (type: `array`): Optional location words to match, for example Worldwide, Europe, Germany, Berlin, Remote. Leave empty for all locations. ## `remoteOnly` (type: `boolean`): Keep only listings marked as remote. ## `includeDescriptionHtml` (type: `boolean`): Also include the original HTML job description. Disable for smaller datasets. ## Actor input object example ```json { "sources": [ "arbeitnow", "remotive" ], "maxItems": 20, "locations": [], "remoteOnly": true, "includeDescriptionHtml": false } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "sources": [ "arbeitnow", "remotive" ], "maxItems": 20, "locations": [], "remoteOnly": true, "includeDescriptionHtml": false }; // Run the Actor and wait for it to finish const run = await client.actor("automation-lab/omni-remote-jobs-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "sources": [ "arbeitnow", "remotive", ], "maxItems": 20, "locations": [], "remoteOnly": True, "includeDescriptionHtml": False, } # Run the Actor and wait for it to finish run = client.actor("automation-lab/omni-remote-jobs-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "sources": [ "arbeitnow", "remotive" ], "maxItems": 20, "locations": [], "remoteOnly": true, "includeDescriptionHtml": false }' | apify call automation-lab/omni-remote-jobs-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=automation-lab/omni-remote-jobs-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Omni Remote Jobs Scraper", "description": "Scrape normalized remote job listings from public job boards with deduplication, filters, clean fields, and required source attribution.", "version": "0.1", "x-build-id": "M03qUbm8dbnA8yxpc" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/automation-lab~omni-remote-jobs-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-automation-lab-omni-remote-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/automation-lab~omni-remote-jobs-scraper/runs": { "post": { "operationId": "runs-sync-automation-lab-omni-remote-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/automation-lab~omni-remote-jobs-scraper/run-sync": { "post": { "operationId": "run-sync-automation-lab-omni-remote-jobs-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "sources": { "title": "Sources", "type": "array", "description": "Public job APIs to include. Remotive listings include source attribution in every result.", "items": { "type": "string", "enum": [ "arbeitnow", "remotive" ], "enumTitles": [ "Arbeitnow", "Remotive" ] }, "default": [ "arbeitnow", "remotive" ] }, "maxItems": { "title": "Maximum jobs", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Total number of deduplicated job listings to save after filters.", "default": 20 }, "query": { "title": "Keyword filter", "type": "string", "description": "Optional keyword such as frontend, data analyst, python, marketing, or recruiter. Leave empty to collect a broader feed." }, "locations": { "title": "Location keywords", "type": "array", "description": "Optional location words to match, for example Worldwide, Europe, Germany, Berlin, Remote. Leave empty for all locations.", "items": { "type": "string" }, "default": [] }, "remoteOnly": { "title": "Remote jobs only", "type": "boolean", "description": "Keep only listings marked as remote.", "default": true }, "includeDescriptionHtml": { "title": "Include description HTML", "type": "boolean", "description": "Also include the original HTML job description. Disable for smaller datasets.", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```