Web Developer Jobs Scraper — LinkedIn, HN, RemoteOK + 7 More avatar

Web Developer Jobs Scraper — LinkedIn, HN, RemoteOK + 7 More

Pricing

from $3.00 / 1,000 job results

Go to Apify Store
Web Developer Jobs Scraper — LinkedIn, HN, RemoteOK + 7 More

Web Developer Jobs Scraper — LinkedIn, HN, RemoteOK + 7 More

Scrape developer jobs from 10 boards in one ~90s run: LinkedIn, RemoteOK, Remotive, WeWorkRemotely, Built In, JustJoin.it, NoFluffJobs, Hacker News, Y Combinator, WTTJ, InfoJobs, Tecnoempleo. URL-deduped, with structured salary, remote, seniority and skills. One bill, no child-actor fees.

Pricing

from $3.00 / 1,000 job results

Rating

0.0

(0)

Developer

Nomad.Dev

Nomad.Dev

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

1

Monthly active users

14 hours ago

Last modified

Share

Web Developer Jobs Scraper — 10 Boards in One

One call, ten boards, one bill. Scrapes LinkedIn, RemoteOK/Remotive/WeWorkRemotely, Built In, JustJoin.it, NoFluffJobs, Hacker News "Who Is Hiring", Y Combinator, Welcome to the Jungle, InfoJobs and Tecnoempleo concurrently, merges them, removes exact and cross-source duplicate postings, and normalizes every posting onto one flat schema. Multi-keyword, geographic, remote, experience and title-exclusion filters are translated to each board's native inputs. Optional BYOK AI matching ranks the results for a candidate.

No API keys, login, cookies or proxy setup are required for scraping. A provider key is needed only when you opt into candidate matching. Nothing else on the Store aggregates the developer-specific boards this way.

Claude / Codex skill to describe and setup this actor: SKILL.md

What web developer jobs data does this scraper extract?

Each result is one flat JSON record per job posting, with the same structured columns for every board:

FieldTypeMeaning
sourcestringWhich child board the record came from, e.g. "justjoinit"
idstringStable source-side identifier ("" when the source has none)
titlestringJob title as posted
companystringHiring company / organisation
locationstringLocation / duty station (may include remote hints)
urlstringDirect link to the posting (also the dedupe + delta key)
postedAtstringPosting date where the source provides it, else ""
snippetstringShort description excerpt
descriptionstringFull description text where the source exposes one, else ""
salarystringHuman-readable salary text (or composed from the numbers below), else ""
hiringContactNamestring|nullLinkedIn rows: person named as the job poster
hiringContactTitlestring|nullThat person's LinkedIn headline
hiringContactUrlstring|nullTheir LinkedIn profile URL
salaryMinnumber|nullLower bound of the pay range, normalized to a number
salaryMaxnumber|nullUpper bound of the pay range (null for single-figure/no pay)
salaryCurrencystring|nullCurrency code (USD, EUR, GBP, PLN…)
salaryPeriodstring|nullOne of year/month/week/day/hour
isRemoteboolean|nullTrue only for fully-remote; false hybrid/on-site; null if unknown
remoteTypestring|nullremote/hybrid/on-site (keeps the hybrid nuance)
senioritystring|nullExperience level (e.g. "Senior"), where the source states it
employmentTypestring|nullContract/commitment type (e.g. "Full-time", "Contract")
skillsarray|nullDe-duplicated skill / technology tags, where the source has them
companyLogostring|nullCompany logo URL where provided
companyUrlstring|nullCompany website/profile URL where provided
companySizestring|nullCompany size label / employee count where provided
industrystring|nullCompany industry / sector where provided
matchScorenumber|nullAI candidate-fit score from 0–10 when candidateProfile is supplied
matchReasonstring|nullEvidence-based reason for the score
mismatchReasonstring|nullMost important material mismatch, if any
rankingModelstring|nullProvider/model used for matching

Uniform normalization. The bundle derives salaryMin/Max/Currency/Period, isRemote/remoteType, seniority, employmentType and skills the same way for every board — from whichever structured field that child exposes, with a plain-code salary-text parser as a last-resort fallback (ycombinator_was, hackernews). Fields a source doesn't provide come back null (or "" for the text fields); e.g. linkedin, hackernews and tecnoempleo surface no salary text, so their salary is "" while salaryMin/Max may still be parsed where numbers exist.

Delta mode & recency

  • onlyNewSinceLastRun — return only postings the bundle hasn't already delivered on a previous run (remembered by listing URL in a private key-value store on your own account). Already-seen rows are dropped and not charged. Ideal for a scheduled alert bot; the first run returns everything.
  • postedWithinDays — only return postings no older than N days. Forwarded to each child under its own recency parameter (days, or hours for Hacker News — mapped automatically); the two sources without a recency input return their normal window. 0 disables it.

Candidate matching

Set candidateProfile to a resume/profile summary and optionally add preferences plus minimumMatchScore. Supply an Anthropic, Mistral or OpenAI API key. The model evaluates explicit requirements, skills, seniority, geography/work authorization, compensation and exclusions in context; no hardcoded keyword scoring rules are used. Results are returned best-first with matchScore, matchReason, mismatchReason and rankingModel.

The profile and API key are never written to the dataset or RUN-SUMMARY. If the selected provider rejects the key or returns incomplete scoring JSON, the run fails clearly instead of silently returning unranked results.

How the bundle works

This is a bundle Actor: one endpoint that scrapes all 10 boards concurrently, maps every record onto one flat schema and deduplicates exact URLs plus corroborated cross-source copies using normalized title/company/location with matching description or textual URL identity. The richer copy is retained. You can restrict the run to a subset with sources.

One run, one bill. Every board is scraped inside this Actor's own run — there are no child Actor runs, so you are never charged a second time by a downstream Actor. What you see on this page is the whole price. It also means one container instead of ten cold starts: a full 10-board run finishes in about 80 seconds.

Developer-scoped by default. Six boards list only tech roles. The four general-purpose boards are automatically scoped to developer roles in their own language. Use keywords for several searches. Array-capable sources receive the full list; single-query sources fan out with their cap divided fairly. Built In and NoFluffJobs expose categories rather than free-text search, so their RUN-SUMMARY.querySupport says unsupported instead of falsely claiming the query was applied. Their category requests are also divided fairly to prevent the first category from consuming the entire cap.

Observable and honest. Every completed run writes a machine-readable RUN-SUMMARY key-value-store record with per-source request, raw, filtered and delivered counts, query support and errors. One failed source produces a partial run with the others preserved. An all-source outage or bundle/matching failure fails the run; it is never disguised as a successful diagnostic row.

How to scrape web developer jobs with this Actor

  1. Click Try for free / Run — no login to the target site, no cookies, no proxies to configure.
  2. Adjust the input (keyword, filters, maxItems) or keep the defaults.
  3. Run it and export the dataset as JSON, CSV or Excel, or read it over the API.

Run it from your own code:

from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("nomad-agent/web-dev-bundle").call(run_input={"maxItems": 50})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item["title"], "—", item["company"], item["url"])

Or a single HTTP call that runs the Actor and returns items in one response:

curl -X POST \
"https://api.apify.com/v2/acts/nomad-agent~web-dev-bundle/run-sync-get-dataset-items?token=<YOUR_APIFY_TOKEN>" \
-H "Content-Type: application/json" \
-d '{"maxItems": 50}'

Input

FieldTypeDefaultNotes
sourcesarray["linkedin", "remote_boards", "builtin", "justjoinit", "nofluffjobs", "hackernews", "ycombinator_was", "wttj", "infojobs", "tecnoempleo"]Which boards to include. Leave empty to run the full default set. All boards are scraped inside this run and billed only at this Actor's price — no child-Actor fees. Fewer boards = a faster, cheaper run.
keywordstring""Free-text search term forwarded to every board that supports one. Leave empty and the four general-purpose boards fall back to a developer-scoped query in their own language; set it to search for a specific stack or role (react, golang, platform engineer).
keywordsarray[]Preferred multi-query input. Single-query sources fan out fairly; array-aware sources receive all terms together. Overrides keyword when non-empty.
locationstring""LinkedIn location, JustJoin.it city, and InfoJobs/Tecnoempleo province.
countryCodesarray[]ISO two-letter country codes for WTTJ.
remoteOnlybooleanfalseUse native source filters where available, then keep only normalized fully-remote rows.
titleExcludearray[]Title phrases excluded on sources with native support.
experienceLevelsarray[]JustJoin.it levels such as junior, mid, senior.
maxExperienceYearsintegerunsetWTTJ maximum required experience.
includeDetailsbooleantrueFetch full descriptions/details on supported sources, including JustJoin.it and WTTJ.
postedWithinDaysinteger0Only return postings no older than N days (mapped to each child's own recency param). 0 = no filter.
onlyNewSinceLastRunbooleanfalseDelta mode: return (and charge for) only listings not delivered on a prior run. Great for scheduled alert bots.
candidateProfilestring""Optional resume/profile summary that enables AI matching.
preferencesstring""Optional prose or JSON with role, geography, salary and exclusion preferences.
minimumMatchScoreinteger0Keep scores at or above this 0–10 threshold; 0 keeps all ranked results.
aiProvider / aiModelstringinferred / low-cost defaultCandidate-matching provider and optional model override.
anthropicApiKey / mistralApiKey / openaiApiKeysecret""Supply the key matching the selected provider. Required only for candidate matching.
maxItemsPerSourceinteger36Cap on items fetched from EACH child board before merge.
maxItemsinteger360Hard cap on the merged, deduped output. Default is sources × maxItemsPerSource (the zero-config ceiling). Set 0 for no cap.
cacheTtlSecondsinteger1800How long to reuse results already fetched from a source instead of re-fetching. 0 = always fetch fresh.
concurrencyinteger10How many boards to fetch at the same time. The default fetches them all at once, so a run takes as long as the slowest board rather than the sum. (Advanced)
runTimeoutSecsinteger300How long to wait for each source before giving up on it. Sources run in parallel, so this is a per-source ceiling, not a budget shared across them. (Advanced)
apifyTokenstring (secret)""Leave empty — injected automatically on the Apify platform. Only set for local runs outside the platform. (Advanced)

Output example

{
"source": "justjoinit",
"id": "upvanta-senior-full-stack",
"title": "Senior Full Stack Developer",
"company": "Upvanta",
"location": "Poznań (Remote)",
"url": "https://justjoin.it/job-offer/upvanta-senior-full-stack",
"postedAt": "2026-06-26",
"snippet": "We're looking for a senior full-stack engineer...",
"description": "We're looking for a senior full-stack engineer to...",
"salary": "B2B 22 000–28 000 PLN",
"salaryMin": 22000,
"salaryMax": 28000,
"salaryCurrency": "PLN",
"salaryPeriod": "month",
"isRemote": true,
"remoteType": "remote",
"seniority": "Senior",
"employmentType": null,
"skills": ["React", "Node.js", "TypeScript"],
"companyLogo": "https://justjoin.it/logos/upvanta.png",
"companyUrl": null,
"companySize": "50+",
"industry": null,
"matchScore": 9,
"matchReason": "Strong React, TypeScript and senior full-stack fit; fully remote.",
"mismatchReason": null,
"rankingModel": "anthropic:claude-haiku-4-5-20251001"
}

Every board returns the same shape; fields a source doesn't provide come back null (or "" for text fields). A record from linkedin, hackernews or tecnoempleo has "salary": "", with salaryMin/Max still populated where the source exposes numbers.

Pricing

Pay per event: $0.01 per Actor start and $0.003 per job returned ($3 per 1,000 jobs). That is the entire cost — all 10 boards are scraped inside this run, so no child Actor ever bills you on top.

Zero-config run (defaults, all 10 boards): up to 360 merged, deduped jobs for at most $1.09 ($0.01 start + 360 × $0.003). You only ever pay for unique jobs — a role cross-posted to three boards is charged once, and in onlyNewSinceLastRun mode a listing you already received is not returned or charged again. Cap the spend of any run with maxItems, or with Apify's per-run "Maximum cost" limit.

Use cases

  • Developer job boards that want breadth without 10 integrations
  • Job-alert bots for frontend/backend/full-stack roles
  • Hiring-market dashboards
  • AI matching agents needing wide supply

FAQ

Is it legal to scrape web developer jobs? This Actor reads only publicly available job postings — data any visitor can see without logging in. No personal data behind authentication is touched. Review the target site's terms and your local regulations for your specific use case.

Do I need an account on the target site? No. Postings are fetched from public pages/APIs — no login, cookies or session tokens.

How fresh is the data? Every run fetches live listings. Results are cached for cacheTtlSeconds (default 30 min, set 0 to always hit the source live).

How many jobs can I get? maxItems caps the run (set 0 for no cap). Most sources paginate from newest to oldest.

Something broken or missing? Open an issue on the Actor's Issues tab — it is monitored and reliability fixes ship fast.

Found it useful? Leaving a review on the Actor page genuinely helps other developers find it — and tells me which boards to add next.

Integrations

Export the dataset as JSON, CSV or Excel, or read it straight from the Apify API. Works out of the box with Make, Zapier and n8n via their Apify integrations, can be called synchronously with run-sync-get-dataset-items from any backend, and is usable by AI agents through the Apify MCP server.


From the maker of Oink — an open-source, AI-powered job-search bot for Telegram that runs on these Actors. Try the free bot, get a managed instance at oinkjobsearch.com, or browse the full catalog of 50+ Actors.