Semrush Website Overview Scraper avatar

Semrush Website Overview Scraper

Pricing

from $10.00 / 1,000 results

Go to Apify Store
Semrush Website Overview Scraper

Semrush Website Overview Scraper

Extract public traffic analytics from Semrush /website/{domain}/overview/ — visits, authority score, backlinks, top keywords, competitors, country/device breakdowns. One record per domain. No auth, no proxy required.

Pricing

from $10.00 / 1,000 results

Rating

0.0

(0)

Developer

Farhan Febrian Nauval

Farhan Febrian Nauval

Maintained by Community

Actor stats

0

Bookmarked

1

Total users

0

Monthly active users

4 days ago

Last modified

Share

Semrush Website Overview Actor

Pull public traffic analytics from Semrush for any list of domains — visits, authority score, backlinks, top keywords, top competitors, country split, and device split. One record per domain, no account required.


Why use this actor

  • No account or API key needed — all data comes from Semrush's publicly accessible overview pages.
  • Traffic estimates at a glance — monthly visit counts plus month-over-month change for every domain you submit.
  • Authority score and backlinks — Semrush's 0–100 authority rating and total inbound link count in every record.
  • Top keywords and competitors — see which search terms drive the most organic traffic and which sites compete for the same audience.
  • Country and device breakdown — understand where visitors come from and whether they use desktop or mobile.
  • Stable JSON output — every run produces the same field names and types, ready to load into a database, spreadsheet, or downstream pipeline.

How it works

  1. You provide a list of domains (e.g. apple.com, github.com).
  2. The actor fetches the public overview page for each domain and extracts all available metrics.
  3. Each domain produces exactly one output record — whether the lookup succeeds or the domain is not found.
  4. Results appear in your dataset as structured JSON, ready to download as JSON, CSV, or Excel.

You do not need to manage browsers, proxies, or rate limiting — the actor handles all of that automatically.


Input

{
"domains": ["apple.com", "github.com"],
"maxConcurrency": 3,
"requestDelayMs": 500,
"proxyConfiguration": { "useApifyProxy": false }
}
FieldTypeDefaultDescription
domainsarrayrequiredRoot domains to look up (e.g. apple.com). Full URLs are accepted and stripped to the root domain. Each domain produces one output record.
maxConcurrencyinteger3How many domains to process simultaneously. Keep at 3 or below for large batches.
requestDelayMsinteger500Milliseconds to wait between requests (a small random variation is added). Increase to 1000–2000 for batches of 1 000+ domains.
proxyConfigurationobjectno proxyOptional proxy settings. Leave at the default for most runs.

Output

One record per domain. Example for apple.com and github.com (arrays truncated):

[
{
"_input": "apple.com",
"_source": "S1-website-rsc",
"_scrapedAt": "2026-06-10T12:15:19Z",
"recordType": "DOMAIN_OVERVIEW",
"domain": "apple.com",
"brandName": "Apple",
"displayDate": "2026-04-01",
"visits": 635764958,
"visitsDiffPct": -0.2518,
"pagesPerVisit": 3.2304,
"timeOnSiteSeconds": 469,
"bounceRate": 0.5892,
"authorityScore": 100,
"backlinks": 6452600472,
"referringDomains": 5792563,
"googlePenaltyRisk": "Low",
"topKeywords": [
{ "keyword": "apple", "position": 1, "searchVolume": 4090000, "cpc": 0.36, "trafficPct": 0.0179 },
{ "keyword": "facebook", "position": 3, "searchVolume": 101000000, "cpc": 9.17, "trafficPct": 0.0099 },
"... 2 more"
],
"competitors": [
{ "name": "google.com", "relevance": 0.31, "visits": 93834069957 },
{ "name": "imdb.com", "relevance": 0.18, "visits": 703158376 },
{ "name": "spotify.com", "relevance": 0.18, "visits": 831606418 }
],
"trafficByCountry": [
{ "country": "US", "countryName": "United States", "traffic": 209474156, "trafficShare": 0.3295 },
{ "country": "GB", "countryName": "United Kingdom", "traffic": 44046719, "trafficShare": 0.0693 },
"... more"
],
"trafficByDevice": [
{ "displayDate": "2026-04-01", "visits": 635764958, "desktopVisits": 285026150, "mobileVisits": 350738808 },
"... 1 more"
],
"visitsHistory": [
{ "displayDate": "2026-04-01", "visits": 635764958 },
{ "displayDate": "2026-03-01", "visits": 849715801 },
{ "displayDate": "2026-02-01", "visits": 624525130 }
],
"backlinksHistory": [
{ "displayDate": "2026-04-01", "backlinks": 6452600472 },
"... 2 more"
],
"organicSearchVisits": 941734597,
"paidSearchVisits": 6347539,
"searchTrafficHistory": [
{ "displayDate": "2026-04-15", "organic": 941734597, "paid": 6347539, "total": 948082136 },
"... 1 more"
]
},
{
"_input": "github.com",
"_source": "S1-website-rsc",
"_scrapedAt": "2026-06-10T12:15:20Z",
"recordType": "DOMAIN_OVERVIEW",
"domain": "github.com",
"brandName": "GitHub",
"displayDate": "2026-04-01",
"visits": 934714141,
"visitsDiffPct": -0.1259,
"authorityScore": 100,
"backlinks": 9151702027,
"referringDomains": 3787533,
"googlePenaltyRisk": "Low",
"topKeywords": [
{ "keyword": "github", "position": 1, "searchVolume": 1000000, "cpc": 2.47, "trafficPct": 0.0474 },
"... 4 more"
],
"competitors": [
{ "name": "stackoverflow.com", "relevance": 0.27, "visits": 41797828 },
"... 2 more"
]
}
]

Output field reference

FieldTypeDescription
_inputstringThe domain as you entered it.
_sourcestringInternal data-source tag (S1-website-rsc).
_scrapedAtstringUTC timestamp of when the record was collected.
_errorstringPresent only on failure. Values: not_found, no_data, network_error, http_N.
recordTypestringAlways DOMAIN_OVERVIEW.
domainstringCanonical domain as recognised by Semrush.
brandNamestringBrand name (e.g. Apple).
displayDatestringMonth the traffic data covers (YYYY-MM-DD).
visitsintegerTotal visits for the month.
visitsDiffPctfloatMonth-over-month change as a fraction (e.g. -0.25 = −25 %).
pagesPerVisitfloatAverage pages viewed per session.
timeOnSiteSecondsintegerAverage session duration in seconds.
bounceRatefloatShare of single-page visits (0–1).
visitsHistoryarrayUp to 3 months of visit counts.
authorityScoreintegerSemrush authority score (0–100).
backlinksintegerTotal inbound links.
backlinksDiffPctfloatMonth-over-month change in backlinks.
referringDomainsintegerNumber of unique domains linking to this site.
googlePenaltyRiskstringLow, High, or null.
backlinksHistoryarrayUp to 6 months of backlink counts.
competitorsarrayUp to 3 competing domains with relevance score and visit count.
topKeywordsarrayUp to 5 top organic keywords with position, search volume, CPC, and traffic share (US data).
organicSearchVisitsintegerEstimated visits from organic search.
paidSearchVisitsintegerEstimated visits from paid search.
searchTrafficHistoryarrayUp to 6 months of organic + paid + total search traffic.
trafficByCountryarrayTop countries with visit count and traffic share.
trafficByDevicearrayUp to 6 months of desktop vs mobile visit breakdown.

Error records

If a domain cannot be found or a transient error occurs, the actor still emits one record for that domain — it will have an _error field instead of metrics. This makes failures visible in your dataset rather than silently missing rows.

_error valueMeaning
not_foundDomain has no Semrush overview page (HTTP 404).
no_dataPage loaded but contained no data.
network_errorAll retries failed (transient network issue).
http_NUnexpected HTTP status code N.

Limitations

Semrush's public overview page only includes a preview of the full data available to paid Semrush subscribers:

MetricThis actor (public data)Semrush paid plans
Keywords per domainTop 5, US market onlyThousands, all countries
CompetitorsTop 3Full list
History window3–6 monthsMulti-year
Data freshnessMonthly snapshotsDaily updates

For deeper analysis, see the official Semrush API (paid subscription required).


Other actors in this collection

ActorWhat it extracts
mobile.de ListingsUsed-car listings from Germany's largest auto marketplace
Immobiliare ListingsProperty listings from Italy's top real-estate portal
Idealista ListingsProperty listings from Spain and Portugal
Leboncoin ListingsClassifieds from France's largest marketplace
Avito ListingsClassifieds from Russia's largest marketplace
MercadoLibre ListingsListings from Latin America's leading marketplace
Eventbrite EventsPublic events and ticket details from Eventbrite
Kickstarter ProjectsCrowdfunding projects from Kickstarter