# GitHub User Scraper — Profiles, Repos & Orgs (`devilscrapes/github-user-scraper`) Actor Fetch GitHub user or organisation metadata via the GitHub API — name, bio, company, location, blog, public repo count, follower count, and optionally the user's pinned/public repositories — export to JSON or CSV. Free REST API, optional token for higher limits. - **URL**: https://apify.com/devilscrapes/github-user-scraper.md - **Developed by:** [DevilScrapes](https://apify.com/devilscrapes) (community) - **Categories:** Lead generation, Developer tools - **Stats:** 2 total users, 0 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per event This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README
Devil Scrapes mark ## GitHub User Scraper — Profiles, Repos & Org Data **$3.00 / 1 000 results**  ·  pay only for results  ·  no credit card to try _We do the dirty work so your dataset stays clean._ 😈 Bulk-extract GitHub user and organisation profiles — name, bio, company, location, blog, follower count, public repo count, hireable flag, and an optional list of public repos. Feed it a list of usernames and get back clean, typed JSON. Optional GitHub token for higher rate limits.
--- ### 🎯 What this scrapes Every GitHub user and organisation has a public profile page — and a matching REST API endpoint. This Actor ingests a list of usernames or org slugs, fans them out in parallel, and returns one structured row per profile: display name, bio, company, location, blog URL, public repo count, follower and following counts, hireable flag, account-creation timestamp, and an optional public-repos sub-array. Organisations and personal accounts share the same output shape; the `type` field tells them apart. ### 🔥 Features - 🛡️ **Browser fingerprint rotation** — `curl-cffi` replays real Chrome / Firefox / Safari TLS handshakes so requests look like a browser, not a Python script. - 🌐 **Proxy rotation via Apify Proxy** — fresh session and exit IP on every block; residential pool available on paid plans. - 🔁 **Retries with exponential backoff** — up to 5 attempts per request on `408 / 429 / 5xx`, `Retry-After` honoured. - 🧱 **Rate-limit-aware pacing** — when the target pushes back, we slow down and surface a clear status message; you never get a silent empty dataset. - 🧊 **Clean, typed rows** — Pydantic-validated output, ISO-8601 timestamps, stable `login` IDs, direct JSON / CSV / Excel export from Apify Console. - 💰 **Pay-Per-Event pricing** — you pay only for rows that reach your dataset. No data, no charge (minus the small `actor-start` warm-up fee). ### 💡 Use cases - **Technical recruiting** — find developers whose bio mentions a framework and whose `hireable` flag is `true`; enrich a sourcer's shortlist at scale. - **B2B lead gen** — pull GitHub orgs in a target geography, filter by `public_repos > N`, then enrich with the org's website or LinkedIn. - **ATS enrichment** — pipe candidate GitHub profile URLs through this Actor to append repo count, follower count, and company to your applicant-tracker rows. - **Developer-OSINT** — map a pseudonymous developer's public identity: linked Twitter handle, declared company, registered location, and account-creation date. - **DevRel contributor intelligence** — rank contributors to a project by follower count and organisation, then prioritise outreach. ### ⚙️ How to use it 1. Click **Try for free** at the top of the Actor page. 2. Paste GitHub usernames (or profile URLs) into the **Usernames or org slugs** field — one per line. 3. Optionally add a **GitHub personal access token** to raise the rate limit from 60 to 5 000 requests per hour. 4. Toggle **Include public repos list** if you need the repos sub-array. 5. Click **Start**. Results stream into the run's dataset in real time. 6. Export from **Storage → Dataset** as JSON, CSV, or Excel — or pull via the Apify API. ### 📥 Input | Field | Type | Required | Default | Notes | |---|---|:--:|---|---| | `usernames` | `array` | **yes** | `["torvalds", "apify"]` | GitHub usernames or org slugs, one per line. Full profile URLs accepted — the host is stripped automatically. | | `githubToken` | `string` | no | — | Personal access token. Unauthenticated: 60 req/hr. With token: 5 000 req/hr. | | `includeRepos` | `boolean` | no | `false` | Appends a `repos` array (up to `maxReposPerUser` most-recently-updated public repos). One extra API call per user. | | `maxReposPerUser` | `integer` | no | `30` | Cap on repos returned per user when `includeRepos` is `true`. Hard ceiling: 100. | | `concurrency` | `integer` | no | `6` | Parallel API requests in flight at once. | | `proxyConfiguration` | `object` | no | `{"useApifyProxy": false}` | Apify Proxy config. Enable residential proxies for large-volume runs. | #### Example input ```json { "usernames": ["apify", "torvalds"], "includeRepos": true, "maxReposPerUser": 10, "concurrency": 4, "proxyConfiguration": { "useApifyProxy": false } } ```` ### 📤 Output One dataset item per GitHub profile. | Field | Type | Notes | |---|---|---| | `login` | `string` | GitHub username or org slug. | | `type` | `string` | `User` or `Organization`. | | `name` | `string \| null` | Display name. | | `company` | `string \| null` | Self-declared company. | | `blog` | `string \| null` | Profile blog or homepage URL. | | `location` | `string \| null` | Self-declared location. | | `email` | `string \| null` | Public email — `null` when the user keeps it private. | | `bio` | `string \| null` | Profile bio. | | `twitter_username` | `string \| null` | Linked X (Twitter) handle. | | `public_repos` | `integer` | Public repository count. | | `public_gists` | `integer` | Public gist count. | | `followers` | `integer` | Follower count. | | `following` | `integer` | Following count. | | `html_url` | `string` | Profile URL. | | `avatar_url` | `string` | Avatar image URL. | | `hireable` | `boolean \| null` | Self-declared hireable flag. | | `created_at` | `string` | Account creation timestamp (ISO-8601). | | `updated_at` | `string` | Last profile-update timestamp (ISO-8601). | | `repos` | `array \| null` | Public repos summary when `includeRepos` is `true`. | | `scraped_at` | `string` | When this row was written (ISO-8601). | #### Example output ```json { "login": "apify", "type": "Organization", "name": "Apify", "company": null, "blog": "https://apify.com", "location": "Prague, Czechia", "email": null, "bio": "The full-stack web scraping and browser automation platform.", "public_repos": 412, "followers": 856, "hireable": null, "html_url": "https://github.com/apify", "created_at": "2012-09-21T08:07:25Z", "scraped_at": "2025-11-01T10:30:00Z" } ``` ### 💰 Pricing Pay-Per-Event — you pay only when these events fire: | Event | USD | What it covers | |---|---:|---| | `actor-start` | $0.005 | One-off warm-up charge per run | | `result` | $0.003 | Per dataset item written | 1 000 profiles at the rates above ≈ **$3.00**. No subscription, no minimum commitment, no card required to start — every new Apify account gets $5 of free credit. ### 🚧 Limitations - Only the `/users/{login}` REST endpoint is called. Contribution graphs, sponsor tiers, starred repos, and commit activity are not included in this Actor. - Private-org membership and private repos require OAuth scopes that are outside what a read-only personal token provides — those fields are out of scope. - GitHub's unauthenticated rate limit is 60 requests per hour per IP. For bulk runs of 500+ users, supply a GitHub token or enable Apify Proxy to spread requests across IPs. - Data freshness reflects whatever GitHub returns at run time. Cached or recently-deleted accounts may return stale or empty rows. ### ❓ FAQ **Is this a github profile scraper as well as a user scraper?** Yes — the same Actor handles both personal user accounts and organisation profiles. The `type` field in each row tells you which you got (`User` vs `Organization`). If you search for "github profile scraper" this is the tool. **What about the github contributor api — can I get contribution data?** GitHub's public REST API does not expose a user's contribution graph or commit-activity heatmap. This Actor returns what the `/users/{login}` endpoint publishes: bio, follower count, repo count, hireable flag, and (optionally) the public-repos list. For commit-level data you need the repository contributors endpoint, which is a separate scrape. **Why is `email` null for most profiles?** GitHub hides email addresses by default. We surface exactly what the public API returns; we do not probe commit metadata or decode `noreply` addresses. **Are GitHub organisations supported?** Yes — org slugs and personal usernames use the same endpoint and produce the same row shape. The `type` field distinguishes them. **Does this respect GitHub's ToS and GDPR?** We request only publicly published profile fields via the official REST API — no login walls, no scraping of private content. Whether your downstream use of the data complies with GDPR or GitHub's Acceptable Use Policy is your legal call; we surface the data, you own the compliance obligation. **Can I run this at scale for recruiting?** With a GitHub token you get 5 000 API requests per hour, enough for a few thousand profiles per run. We handle rate-limit responses and back off automatically; you set the concurrency and we do the rest. ### 💬 Your feedback Spotted a bug, hit a weird edge case, or need an extra field? Open an issue on the Actor's **Issues** tab in Apify Console — we ship fixes weekly and read every report. ***
Built by **[Devil Scrapes](https://apify.com/DevilScrapes)** 😈 — a small fleet of opinionated public-data Actors. Honest pricing, real engineering, zero fine print.
# Actor input Schema ## `usernames` (type: `array`): GitHub usernames or organisation slugs, one per line. Profile URLs are also accepted — we strip the host. ## `githubToken` (type: `string`): Personal access token. Without one you get 60 requests/hour; with one, 5 000/hour. ## `includeRepos` (type: `boolean`): Adds a `repos` array (up to 100 most-recently-updated public repos with name + stars). One extra API call per user. ## `maxReposPerUser` (type: `integer`): Cap on repos returned per user when includeRepos=true. Hard ceiling 100. ## `concurrency` (type: `integer`): Parallel API requests. ## `proxyConfiguration` (type: `object`): Apify Proxy optional — GitHub's REST API does not IP-block at reasonable volumes. ## Actor input object example ```json { "usernames": [ "torvalds", "apify" ], "includeRepos": false, "maxReposPerUser": 30, "concurrency": 6, "proxyConfiguration": { "useApifyProxy": false } } ``` # Actor output Schema ## `datasetItems` (type: `string`): All dataset items as JSON. ## `datasetItemsCsv` (type: `string`): Same data exported to CSV. ## `datasetView` (type: `string`): Open the run dataset in the Console. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "usernames": [ "torvalds", "apify" ], "proxyConfiguration": { "useApifyProxy": false } }; // Run the Actor and wait for it to finish const run = await client.actor("devilscrapes/github-user-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "usernames": [ "torvalds", "apify", ], "proxyConfiguration": { "useApifyProxy": False }, } # Run the Actor and wait for it to finish run = client.actor("devilscrapes/github-user-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "usernames": [ "torvalds", "apify" ], "proxyConfiguration": { "useApifyProxy": false } }' | apify call devilscrapes/github-user-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=devilscrapes/github-user-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "GitHub User Scraper — Profiles, Repos & Orgs", "description": "Fetch GitHub user or organisation metadata via the GitHub API — name, bio, company, location, blog, public repo count, follower count, and optionally the user's pinned/public repositories — export to JSON or CSV. Free REST API, optional token for higher limits.", "version": "0.4", "x-build-id": "P9FOA2oOimtoPU0Ai" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/devilscrapes~github-user-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-devilscrapes-github-user-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/devilscrapes~github-user-scraper/runs": { "post": { "operationId": "runs-sync-devilscrapes-github-user-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/devilscrapes~github-user-scraper/run-sync": { "post": { "operationId": "run-sync-devilscrapes-github-user-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "usernames" ], "properties": { "usernames": { "title": "Usernames or org slugs", "type": "array", "description": "GitHub usernames or organisation slugs, one per line. Profile URLs are also accepted — we strip the host.", "items": { "type": "string" } }, "githubToken": { "title": "GitHub token (optional)", "type": "string", "description": "Personal access token. Without one you get 60 requests/hour; with one, 5 000/hour." }, "includeRepos": { "title": "Include public repos list", "type": "boolean", "description": "Adds a `repos` array (up to 100 most-recently-updated public repos with name + stars). One extra API call per user.", "default": false }, "maxReposPerUser": { "title": "Max repos per user", "minimum": 1, "maximum": 100, "type": "integer", "description": "Cap on repos returned per user when includeRepos=true. Hard ceiling 100.", "default": 30 }, "concurrency": { "title": "Concurrent fetches", "minimum": 1, "maximum": 32, "type": "integer", "description": "Parallel API requests.", "default": 6 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Apify Proxy optional — GitHub's REST API does not IP-block at reasonable volumes.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```