Semrush Website Overview Scraper
Pricing
from $10.00 / 1,000 results
Semrush Website Overview Scraper
Extract public traffic analytics from Semrush /website/{domain}/overview/ — visits, authority score, backlinks, top keywords, competitors, country/device breakdowns. One record per domain. No auth, no proxy required.
Pricing
from $10.00 / 1,000 results
Rating
0.0
(0)
Developer
Farhan Febrian Nauval
Maintained by CommunityActor stats
0
Bookmarked
1
Total users
0
Monthly active users
4 days ago
Last modified
Categories
Share
Semrush Website Overview Actor
Pull public traffic analytics from Semrush for any list of domains — visits, authority score, backlinks, top keywords, top competitors, country split, and device split. One record per domain, no account required.
Why use this actor
- No account or API key needed — all data comes from Semrush's publicly accessible overview pages.
- Traffic estimates at a glance — monthly visit counts plus month-over-month change for every domain you submit.
- Authority score and backlinks — Semrush's 0–100 authority rating and total inbound link count in every record.
- Top keywords and competitors — see which search terms drive the most organic traffic and which sites compete for the same audience.
- Country and device breakdown — understand where visitors come from and whether they use desktop or mobile.
- Stable JSON output — every run produces the same field names and types, ready to load into a database, spreadsheet, or downstream pipeline.
How it works
- You provide a list of domains (e.g.
apple.com,github.com). - The actor fetches the public overview page for each domain and extracts all available metrics.
- Each domain produces exactly one output record — whether the lookup succeeds or the domain is not found.
- Results appear in your dataset as structured JSON, ready to download as JSON, CSV, or Excel.
You do not need to manage browsers, proxies, or rate limiting — the actor handles all of that automatically.
Input
{"domains": ["apple.com", "github.com"],"maxConcurrency": 3,"requestDelayMs": 500,"proxyConfiguration": { "useApifyProxy": false }}
| Field | Type | Default | Description |
|---|---|---|---|
domains | array | required | Root domains to look up (e.g. apple.com). Full URLs are accepted and stripped to the root domain. Each domain produces one output record. |
maxConcurrency | integer | 3 | How many domains to process simultaneously. Keep at 3 or below for large batches. |
requestDelayMs | integer | 500 | Milliseconds to wait between requests (a small random variation is added). Increase to 1000–2000 for batches of 1 000+ domains. |
proxyConfiguration | object | no proxy | Optional proxy settings. Leave at the default for most runs. |
Output
One record per domain. Example for apple.com and github.com (arrays truncated):
[{"_input": "apple.com","_source": "S1-website-rsc","_scrapedAt": "2026-06-10T12:15:19Z","recordType": "DOMAIN_OVERVIEW","domain": "apple.com","brandName": "Apple","displayDate": "2026-04-01","visits": 635764958,"visitsDiffPct": -0.2518,"pagesPerVisit": 3.2304,"timeOnSiteSeconds": 469,"bounceRate": 0.5892,"authorityScore": 100,"backlinks": 6452600472,"referringDomains": 5792563,"googlePenaltyRisk": "Low","topKeywords": [{ "keyword": "apple", "position": 1, "searchVolume": 4090000, "cpc": 0.36, "trafficPct": 0.0179 },{ "keyword": "facebook", "position": 3, "searchVolume": 101000000, "cpc": 9.17, "trafficPct": 0.0099 },"... 2 more"],"competitors": [{ "name": "google.com", "relevance": 0.31, "visits": 93834069957 },{ "name": "imdb.com", "relevance": 0.18, "visits": 703158376 },{ "name": "spotify.com", "relevance": 0.18, "visits": 831606418 }],"trafficByCountry": [{ "country": "US", "countryName": "United States", "traffic": 209474156, "trafficShare": 0.3295 },{ "country": "GB", "countryName": "United Kingdom", "traffic": 44046719, "trafficShare": 0.0693 },"... more"],"trafficByDevice": [{ "displayDate": "2026-04-01", "visits": 635764958, "desktopVisits": 285026150, "mobileVisits": 350738808 },"... 1 more"],"visitsHistory": [{ "displayDate": "2026-04-01", "visits": 635764958 },{ "displayDate": "2026-03-01", "visits": 849715801 },{ "displayDate": "2026-02-01", "visits": 624525130 }],"backlinksHistory": [{ "displayDate": "2026-04-01", "backlinks": 6452600472 },"... 2 more"],"organicSearchVisits": 941734597,"paidSearchVisits": 6347539,"searchTrafficHistory": [{ "displayDate": "2026-04-15", "organic": 941734597, "paid": 6347539, "total": 948082136 },"... 1 more"]},{"_input": "github.com","_source": "S1-website-rsc","_scrapedAt": "2026-06-10T12:15:20Z","recordType": "DOMAIN_OVERVIEW","domain": "github.com","brandName": "GitHub","displayDate": "2026-04-01","visits": 934714141,"visitsDiffPct": -0.1259,"authorityScore": 100,"backlinks": 9151702027,"referringDomains": 3787533,"googlePenaltyRisk": "Low","topKeywords": [{ "keyword": "github", "position": 1, "searchVolume": 1000000, "cpc": 2.47, "trafficPct": 0.0474 },"... 4 more"],"competitors": [{ "name": "stackoverflow.com", "relevance": 0.27, "visits": 41797828 },"... 2 more"]}]
Output field reference
| Field | Type | Description |
|---|---|---|
_input | string | The domain as you entered it. |
_source | string | Internal data-source tag (S1-website-rsc). |
_scrapedAt | string | UTC timestamp of when the record was collected. |
_error | string | Present only on failure. Values: not_found, no_data, network_error, http_N. |
recordType | string | Always DOMAIN_OVERVIEW. |
domain | string | Canonical domain as recognised by Semrush. |
brandName | string | Brand name (e.g. Apple). |
displayDate | string | Month the traffic data covers (YYYY-MM-DD). |
visits | integer | Total visits for the month. |
visitsDiffPct | float | Month-over-month change as a fraction (e.g. -0.25 = −25 %). |
pagesPerVisit | float | Average pages viewed per session. |
timeOnSiteSeconds | integer | Average session duration in seconds. |
bounceRate | float | Share of single-page visits (0–1). |
visitsHistory | array | Up to 3 months of visit counts. |
authorityScore | integer | Semrush authority score (0–100). |
backlinks | integer | Total inbound links. |
backlinksDiffPct | float | Month-over-month change in backlinks. |
referringDomains | integer | Number of unique domains linking to this site. |
googlePenaltyRisk | string | Low, High, or null. |
backlinksHistory | array | Up to 6 months of backlink counts. |
competitors | array | Up to 3 competing domains with relevance score and visit count. |
topKeywords | array | Up to 5 top organic keywords with position, search volume, CPC, and traffic share (US data). |
organicSearchVisits | integer | Estimated visits from organic search. |
paidSearchVisits | integer | Estimated visits from paid search. |
searchTrafficHistory | array | Up to 6 months of organic + paid + total search traffic. |
trafficByCountry | array | Top countries with visit count and traffic share. |
trafficByDevice | array | Up to 6 months of desktop vs mobile visit breakdown. |
Error records
If a domain cannot be found or a transient error occurs, the actor still emits one record for that domain — it will have an _error field instead of metrics. This makes failures visible in your dataset rather than silently missing rows.
_error value | Meaning |
|---|---|
not_found | Domain has no Semrush overview page (HTTP 404). |
no_data | Page loaded but contained no data. |
network_error | All retries failed (transient network issue). |
http_N | Unexpected HTTP status code N. |
Limitations
Semrush's public overview page only includes a preview of the full data available to paid Semrush subscribers:
| Metric | This actor (public data) | Semrush paid plans |
|---|---|---|
| Keywords per domain | Top 5, US market only | Thousands, all countries |
| Competitors | Top 3 | Full list |
| History window | 3–6 months | Multi-year |
| Data freshness | Monthly snapshots | Daily updates |
For deeper analysis, see the official Semrush API (paid subscription required).
Other actors in this collection
| Actor | What it extracts |
|---|---|
| mobile.de Listings | Used-car listings from Germany's largest auto marketplace |
| Immobiliare Listings | Property listings from Italy's top real-estate portal |
| Idealista Listings | Property listings from Spain and Portugal |
| Leboncoin Listings | Classifieds from France's largest marketplace |
| Avito Listings | Classifieds from Russia's largest marketplace |
| MercadoLibre Listings | Listings from Latin America's leading marketplace |
| Eventbrite Events | Public events and ticket details from Eventbrite |
| Kickstarter Projects | Crowdfunding projects from Kickstarter |