# SimilarWeb Scraper (`ecomdate/similarweb-scraper`) Actor Scrape SimilarWeb website analytics in bulk, including traffic, rankings, categories, top countries, screenshots, tags, and similar sites. Ideal for SEO research, competitor analysis, and lead scoring. Supports pay-per-event pricing and large domain lists. - **URL**: https://apify.com/ecomdate/similarweb-scraper.md - **Developed by:** [Ecomdate Tech](https://apify.com/ecomdate) (community) - **Categories:** SEO tools, Lead generation, Automation - **Stats:** 173 total users, 42 monthly users, 100.0% runs succeeded, 9 bookmarks - **User rating**: 3.27 out of 5 stars ## Pricing from $4.00 / 1,000 performance overview scrapeds This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## SimilarWeb Bulk Analytics & Similar Sites Scraper Apify Actor for scraping **Similarweb website analytics and similar sites in bulk**. Paste a list of domains, choose whether to include similar sites, and get **clean, structured data** ready for enrichment, lead scoring, and market research. No Similarweb API key required - the actor works on publicly available data and handles concurrency, retries. ------------------------------------------------------------------------ ### What this Actor does For each domain, the Actor can: - πŸ” **Scrape website overview** - title, description, category, traffic & ranks - 🌎 **Capture traffic & geography** - total visits, global rank, category rank, top country & rank - πŸ–Ό **Grab visual assets** - favicon + mobile & desktop screenshots - 🧭 **(Optional) Discover similar sites** - related domains with the same rich analytics - 🧩 **(Optional) Tag each site** - topic/brand tags extracted from Similarweb You can run it on **a few domains** for quick checks or **thousands of domains** for bulk analytics pipelines. ------------------------------------------------------------------------ ### Who is it for? - **Growth & SEO teams** - competitor analysis, content & keyword research - **Sales & RevOps** - lead scoring, ICP matching, prioritizing high-traffic domains - **Investors & analysts** - traffic and category signals for portfolio or prospect research - **Data platforms & SaaS** - enrichment of existing domain lists with traffic & ranking metrics ------------------------------------------------------------------------ ### Pricing (Pay-Per-Event) This Actor uses **Apify Pay-Per-Event (PPE)** pricing: - **Overview Scraped** - **$4 per 1,000 events** - 1 event per successfully scraped domain overview - Always charged when a domain is successfully processed - **Similar Sites Scraped** - **$4 per 1,000 events** - 1 event per domain where similar sites data is successfully scraped - Charged **only if** `scrapeSimilarSites: true` and similar sites are fetched successfully #### Quick cost examples | Use case | Example size | Approx. PPE cost* | |----------|--------------|-------------------| | Only overviews | 1,000 domains | $4 | | Overview + similar sites | 1,000 domains | $8 | *Compute costs not included. Actual costs may vary based on success rates. ### Features - πŸš€ **Async bulk processing** - domains processed concurrently for fast runs - πŸ”„ **Automatic retry handling** - simple transient errors are retried for you - 🌐 **Optional similar sites lookup** - enable only when you need it - πŸ“Š **Rich analytics** - visits, ranking, categories, geography, tags - πŸ’Ύ **Clean dataset output** - one record per domain, optionally with an array of similar sites ------------------------------------------------------------------------ ### Input Parameters #### Actor input | Field | Type | Required | Default | Description | |-------|------|----------|---------|-------------| | `domains` | Array | Yes | - | List of domains to scrape. | | `scrapeSimilarSites` | Boolean | No | `false` | If true, also scrape similar sites. | #### Example input ``` json { "domains": [ "stripe.com", "apple.com" ], "scrapeSimilarSites": true } ```` *** ### Output data The Actor outputs structured data stored in the default Apify dataset. *** #### Example output ```json { "domain": "stripe.com", "inputDomain": "stripe.com", "title": "Stripe Privacy Center", "description": "Stripe's suite of modular UI building blocks make it easy to design a secure on-brand checkout and payments experience for your customers.", "snapshotDate": "2025-10-01T00:00:00+00:00", "category": "Finance", "globalRank": 458, "topCountry": "US", "topCountryRank": 325, "categoryRank": 26, "totalVisits": 94590134, "bounceRate": 0.5424, "pagesPerVisit": 3.3, "timeOnSite": 175.23, "estimatedMonthlyVisits": { "2025-08-01": 91752638, "2025-09-01": 88593774, "2025-10-01": 94590134 }, "topCountryShares": { "US": 0.3064, "GB": 0.0907, "FR": 0.0521, "IN": 0.0443, "CA": 0.0342 }, "trafficSources": { "Direct": 0.5769, "Referrals": 0.2912, "Search": 0.12, "Social": 0.0065, "Paid Referrals": 0.0045, "Mail": 0.0009 }, "topKeywords": [ { "name": "stripe", "volume": 2765510, "cpc": 2.74, "estimatedMonthlyValue": 2430000 }, { "name": "stripe login", "volume": 199710, "cpc": 3.49, "estimatedMonthlyValue": 199340 } ], "favicon": "https://site-images.similarcdn.com/image?url=stripe.com&t=2&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=stripe.com&t=4&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=stripe.com&t=1&s=1&h=d68993ccefeee1fe61031cd46586b3158ad13585abae80195cc41b500863c253", "tags": [], "similarSites": [], "isSmallSite": false, "isDataFromGoogleAnalytics": false, "scrapedAt": "2025-12-03T10:30:45.123Z" } ``` *** #### Additional fields When `scrapeSimilarSites` is set to `true`, the output items will include the following additional fields: ```json { "similarSites": [ { "domain": "americanexpress.com", "title": "American Express Credit Cards, Rewards & Banking", "description": "American Express offers world-class Charge and Credit Cards, Gift Cards, Rewards, Travel, Personal Savings, Business Services, Insurance and more.", "totalVisits": 101459089, "globalRank": 313, "categoryRank": 6, "topCountry": "US", "topCountryRank": 98, "favicon": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=2&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=4&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=americanexpress.com&t=1&h=50a8ba5a26c8aecf1fb7963e38401c74f27f0f2abf54799cf579a17af6dbffb3" }, { "domain": "cigna.com", "title": "Cigna Healthcare | Health Insurance, Dental Plans & Medicare", "description": "Cigna Healthcare offers health insurance plans such as medical and dental to individuals and employers, international health insurance, and Medicare coverage.", "totalVisits": 11020147, "globalRank": 3749, "categoryRank": 16, "topCountry": "US", "topCountryRank": 767, "favicon": "https://site-images.similarcdn.com/image?url=cigna.com&t=2&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9", "mobileScreenshot": "https://site-images.similarcdn.com/image?url=cigna.com&t=4&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9", "desktopScreenshot": "https://site-images.similarcdn.com/image?url=cigna.com&t=1&h=25143aae11a29782bdf0527072c691744a847f3fefdaa0405627be4de9485ef9" } ], "tags": [ "stripe", "online payments", "payments" ] } ``` *** #### Main item fields | Field | Type | Description | |-------|------|-------------| | `domain` | String | Normalized domain name | | `inputDomain` | String | Original input URL/domain | | `title` | String | Website title | | `description` | String | Website description | | `snapshotDate` | String (ISO date) | Data snapshot date | | `category` | String | Website category path | | `globalRank` | Integer | Global traffic rank | | `categoryRank` | Integer | Category rank | | `topCountry` | String | Top traffic country code | | `topCountryRank` | Integer | Rank in that top country | | `totalVisits` | Integer | Total visits | | `bounceRate` | Number | Bounce rate (0-1) | | `pagesPerVisit` | Number | Average pages per visit | | `timeOnSite` | Number | Average time on site (seconds) | | `estimatedMonthlyVisits` | Object | Monthly visits history (date β†’ visits) | | `topCountryShares` | Object | Top country traffic shares (countryCode β†’ share) | | `trafficSources` | Object | Traffic source breakdown (source β†’ share) | | `topKeywords` | Array | Top organic keywords with volume, CPC, value | | `favicon` | String (URL) | Favicon URL | | `mobileScreenshot` | String (URL) | Mobile screenshot image URL | | `desktopScreenshot` | String (URL) | Desktop screenshot image URL | | `tags` | Array | Extracted descriptive tags | | `similarSites` | Array | Similar sites (optional) | | `isSmallSite` | Boolean | Whether site has low traffic | | `isDataFromGoogleAnalytics` | Boolean | Whether data is from Google Analytics | | `scrapedAt` | String (ISO date) | Timestamp of when the data was scraped | #### Similar sites object | Field | Type | Description | |-------|------|-------------| | `domain` | String | Similar site domain | | `title` | String | Title of the similar site | | `description` | String | Description | | `totalVisits` | Integer | Total visits | | `globalRank` | Integer | Global rank | | `categoryRank` | Integer | Category rank | | `topCountry` | String | Top traffic country | | `topCountryRank` | Integer | Rank in that country | | `favicon` | String (URL) | Favicon | | `mobileScreenshot` | String (URL) | Mobile screenshot | | `desktopScreenshot` | String (URL) | Desktop screenshot | *** ### How to use 1. Click **"Try for free"** 2. Paste your domains into the `domains` input 3. Set `scrapeSimilarSites` if needed 4. Run the Actor 5. Export results from the Dataset as JSON/CSV/Excel/API *** ### FAQs **Do I need a Similarweb API key?** No. This Actor works on publicly available data. **Will every domain have full data?** No.Β Low-traffic domains may have partial or no data. **Is this an official Similarweb tool?** No.Β This Actor is independent and simply automates scraping of publicly available pages. *** ### Support πŸ“ž If you need help, want to request a feature, or found a bug: - Open an issue directly on the Actor page - Or contact us via [Ecomdate Tech](https://apify.com/ecomdate) *** ### Disclaimer βš–οΈ This actor is **not affiliated with SimilarWeb**. It retrieves publicly available data from SimilarWeb pages. Users are responsible for compliance with SimilarWeb’s Terms of Service, GDPR, CCPA, and other applicable laws. # Actor input Schema ## `domains` (type: `array`): List of domains to scrape data from SimilarWeb API ## `scrapeSimilarSites` (type: `boolean`): Whether to also scrape similar sites for each domain ## Actor input object example ```json { "domains": [ "stripe.com" ], "scrapeSimilarSites": false } ``` # Actor output Schema ## `results` (type: `string`): No description ## `technologies` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "domains": [ "stripe.com" ] }; // Run the Actor and wait for it to finish const run = await client.actor("ecomdate/similarweb-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "domains": ["stripe.com"] } # Run the Actor and wait for it to finish run = client.actor("ecomdate/similarweb-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("πŸ’Ύ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # πŸ“š Want to learn more πŸ“–? Go to β†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "domains": [ "stripe.com" ] }' | apify call ecomdate/similarweb-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=ecomdate/similarweb-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "SimilarWeb Scraper", "description": "Scrape SimilarWeb website analytics in bulk, including traffic, rankings, categories, top countries, screenshots, tags, and similar sites. Ideal for SEO research, competitor analysis, and lead scoring. Supports pay-per-event pricing and large domain lists.", "version": "0.0", "x-build-id": "cu1ejefhUKlrXy7r4" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/ecomdate~similarweb-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-ecomdate-similarweb-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/ecomdate~similarweb-scraper/runs": { "post": { "operationId": "runs-sync-ecomdate-similarweb-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/ecomdate~similarweb-scraper/run-sync": { "post": { "operationId": "run-sync-ecomdate-similarweb-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "domains" ], "properties": { "domains": { "title": "Domains", "type": "array", "description": "List of domains to scrape data from SimilarWeb API", "default": [ "stripe.com" ], "items": { "type": "string" } }, "scrapeSimilarSites": { "title": "Scrape Similar Sites", "type": "boolean", "description": "Whether to also scrape similar sites for each domain", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```