# Semrush Scraper (`radeance/semrush-scraper`) Actor
Extract enterprise-level SEO data from Semrush including domain authority, traffic analytics, keyword rankings, backlink profiles, trending sites & competitor insights. Supports bulk analysis with historical trends. Download as CSV, JSON, Excel, XML & more.
- **URL**: https://apify.com/radeance/semrush-scraper.md
- **Developed by:** [Radeance](https://apify.com/radeance) (community)
- **Categories:** SEO tools, Automation, Developer tools
- **Stats:** 1,292 total users, 141 monthly users, 100.0% runs succeeded, 69 bookmarks
- **User rating**: 4.91 out of 5 stars
## Pricing
Pay per event
This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.
Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event
## What's an Apify Actor?
Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".
## How to integrate an Actor?
If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.
In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md):
```bash
npm install apify-client
```
In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md):
```bash
pip install apify-client
```
In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md):
````bash
# MacOS / Linux
curl -fsSL https://apify.com/install-cli.sh | bash
# Windows
irm https://apify.com/install-cli.ps1 | iex
```bash
In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md).
If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md).
For usage examples, see the [API](#api) section below.
For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).
# README
## π Semrush SEO Scraper
The **Semrush Scraper** on Apify gives you complete, **structured SEO insights from Semrush** β including authority metrics, organic and paid traffic, keyword rankings, backlink profiles, and SERP data. It supports multiple search modes, letting you extract **domain overviews**, **traffic sources**, **keyword volumes**, **keyword rankings**, **historical performance data** and **SEO Audits** across global markets.
Whether youβre analyzing competitors, tracking visibility trends, or building SEO dashboards, this Actor provides rich, export-ready data such as **authority scores**, **search traffic** breakdowns, **keyword difficulty**, **backlinks**, and top-ranking URLs. Designed for SEO experts, marketers, and analysts, it delivers enterprise-level insights at scale with clean JSON, CSV, or XLSX outputs.
### βΆ Key Features
- **π Comprehensive SEO Data Extraction:**
- β
Scrape complete SEO intelligence from Semrush with support for multiple search types
- β
Extract **domain authority scores**, **traffic analytics**, **keyword performance**, and **backlink profiles** automatically
- β
Access detailed metrics such as authority score, organic traffic, bounce rate, pages per visit, keyword positions, and more
- **π Advanced Traffic Analytics:**
- β
Capture precise **website traffic data**, including visits, engagement, and time on site
- β
View **traffic distribution by device** (desktop vs mobile) and **geographical share** across top countries
- β
Analyze **traffic channels** including direct, organic, paid, social, and referral sources
- **ποΈ Backlink & Authority Intelligence:**
- β
Scrape complete backlink profiles with **historical data trends** and quality indicators
- β
Retrieve **referring domain counts**, **authority scoring**, and **link power metrics**
- β
Identify **top-performing pages** by backlink volume and distribution
- **π Keyword & SERP Insights:**
- β
Capture **organic keyword rankings**, **search volumes**, **keyword difficulty**, and **CPC data**
- β
Analyze **search trends**, **SERP results**, and **top-ranking URLs** for any keyword or country
- β
Discover **competitive keyword overlaps** and traffic opportunities
- **π SEO Audit:**
- β
Perform in-depth **SEO audits** of any domain or URL
- β
Extract **on-page SEO elements** including titles, meta descriptions, headings, text content, images, and internal & external links
- β
Analyze **technical SEO factors** like robots.txt, sitemaps, and language
- **π Trending Website Data:**
- β
Track **top-performing websites globally** by traffic, rank, and engagement
- β
Measure **month-over-month** and **year-over-year** growth for any industry
- β
Uncover **category-based rankings** and emerging market leaders
- **π Flexible Data Output:**
- β
Export SEO data seamlessly in multiple formats: CSV, XLSX, JSON, JSONL, XML, and RSS
### β· Output
#### Domain Authority Overview
###### Requires: `Domain or URL`
###### Fields: `authority_score` `moz_domain_authority`, `moz_spam_score`
```json
{
"data_captured_at": "2026-06-14T22:22:07.885680",
"type": "domain_authority",
"last_updated": "2026-06-01T00:00:00",
"domain": "google.com",
"authority_score": 100,
"moz_domain_authority": 94,
"moz_spam_score": "1.0%"
}
````
#### Domain Overview
###### Requires: `Domain or URL`
###### Fields: `categories`, `visits`, `visits_history`, `bounce_rate`, `pages_per_visit`, `time_on_site`, `global_rank`, `category_rank`, `country_rank`, `authority_score`, `backlinks_google_penalty_risk`, `traffic_organic`, `traffic_paid`, `traffic_history`, `traffic_by_country_history`, `traffic_by_device_history`, `inbound_traffic_sources`, `outbound_traffic_sources`, `total_backlinks`, `total_backlinks_last_month`, `total_backlinks_change`, `backlinks_history`, `backlinks_last_updated`, `referral_domains`, `referral_domains_last_month`, `referral_domains_change`, `referral_domains_history`, `top_organic_keywords`, `top_organic_keywords_last_updated`, `competitors`
```json
{
"data_captured_at": "2026-06-14T22:22:01.780939",
"last_updated": "2026-06-12T00:00:00",
"domain": "google.com",
"country": "us",
"categories": [
{
"category": "Online Services"
}
],
"visits": 101172727926,
"visits_history": [
{
"date": "2026-05-01T00:00:00",
"value": 101172727926
},
{
"date": "2026-04-01T00:00:00",
"value": 93834069957
},
{
"date": "2026-03-01T00:00:00",
"value": 111753386145
}
],
"bounce_rate": 0.3669,
"pages_per_visit": 5.6419,
"time_on_site": 799.0,
"global_rank": {
"category": "Global",
"rank": 1,
"change": 0,
"rank_last_month": 1
},
"category_rank": {
"category": "Online Services",
"rank": 1,
"change": 0,
"rank_last_month": 1
},
"country_rank": {
"country": "US",
"rank": 1,
"change": 0,
"rank_last_month": 1
},
"authority_score": 100,
"backlinks_google_penalty_risk": "Low",
"traffic_organic": 5235637014,
"traffic_paid": 21228492,
"traffic_history": [
{
"date": "2026-05-15T00:00:00",
"organic_traffic": 5235637014,
"paid_traffic": 21228492,
"search_traffic": 5256865506
},
{
"date": "2026-04-15T00:00:00",
"organic_traffic": 4628706977,
"paid_traffic": 23417013,
"search_traffic": 4652123990
},
{
"date": "2026-03-15T00:00:00",
"organic_traffic": 4638180545,
"paid_traffic": 21650526,
"search_traffic": 4659831071
},
{
"date": "2026-02-15T00:00:00",
"organic_traffic": 4793343366,
"paid_traffic": 21571469,
"search_traffic": 4814914835
},
{
"date": "2026-01-15T00:00:00",
"organic_traffic": 4790672330,
"paid_traffic": 18204040,
"search_traffic": 4808876370
},
{
"date": "2025-12-15T00:00:00",
"organic_traffic": 4917115520,
"paid_traffic": 23052763,
"search_traffic": 4940168283
}
],
"traffic_by_country_history": [
{
"country": "US",
"traffic_share": 0.2405,
"traffic": 24331115522,
"desktop_share": 0.2794,
"mobile_share": 0.7206
},
{
"country": "JP",
"traffic_share": 0.0632,
"traffic": 6389773210,
"desktop_share": 0.1857,
"mobile_share": 0.8143
},
{
"country": "IN",
"traffic_share": 0.0542,
"traffic": 5487266135,
"desktop_share": 0.2773,
"mobile_share": 0.7227
},
{
"country": "BR",
"traffic_share": 0.0501,
"traffic": 5067029603,
"desktop_share": 0.2751,
"mobile_share": 0.7249
},
{
"country": "DE",
"traffic_share": 0.0343,
"traffic": 3471013237,
"desktop_share": 0.3288,
"mobile_share": 0.6712
}
],
"traffic_by_device_history": [
{
"date": "2026-05-01T00:00:00",
"value": 101172727926,
"desktop_visits": 29349576296,
"mobile_visits": 71823151630,
"desktop_share": 0.2900937525127022,
"mobile_share": 0.7099062474872978
},
{
"date": "2026-04-01T00:00:00",
"value": 93834069957,
"desktop_visits": 27351478846,
"mobile_visits": 66482591111,
"desktop_share": 0.2914877171856019,
"mobile_share": 0.7085122828143982
},
{
"date": "2026-03-01T00:00:00",
"value": 111753386145,
"desktop_visits": 32321386007,
"mobile_visits": 79432000138,
"desktop_share": 0.2892206412883365,
"mobile_share": 0.7107793587116635
},
{
"date": "2026-02-01T00:00:00",
"value": 88460065425,
"desktop_visits": 25528803784,
"mobile_visits": 62931261641,
"desktop_share": 0.2885912830987486,
"mobile_share": 0.7114087169012514
},
{
"date": "2026-01-01T00:00:00",
"value": 94757767992,
"desktop_visits": 27958159934,
"mobile_visits": 66799608058,
"desktop_share": 0.29504873876261406,
"mobile_share": 0.7049512612373859
},
{
"date": "2025-12-01T00:00:00",
"value": 95362815483,
"desktop_visits": 26615919234,
"mobile_visits": 68746896249,
"desktop_share": 0.2791016508813619,
"mobile_share": 0.720898349118638
}
],
"inbound_traffic_sources": [
{
"source": "Direct",
"visits": 27186577924,
"visits_last_month": 25344605557,
"share": 0.92630223
},
{
"source": "youtube.com",
"visits": 243299470,
"visits_last_month": 219053012,
"share": 0.00828971
},
{
"source": "bing.com",
"visits": 50097916,
"visits_last_month": 46479615,
"share": 0.00170694
},
{
"source": "chatgpt.com",
"visits": 46273515,
"visits_last_month": 40206382,
"share": 0.00157664
},
{
"source": "web.whatsapp.com",
"visits": 43977047,
"visits_last_month": 41992850,
"share": 0.00149839
}
],
"outbound_traffic_sources": [
{
"source": "youtube.com",
"visits": 1574608577,
"visits_last_month": 1449034666,
"share": 0.0383161
},
{
"source": "reddit.com",
"visits": 1268530601,
"visits_last_month": 1179403913,
"share": 0.03086808
},
{
"source": "wikipedia.org",
"visits": 790621068,
"visits_last_month": 753363172,
"share": 0.01923876
},
{
"source": "facebook.com",
"visits": 634252563,
"visits_last_month": 593022231,
"share": 0.01543373
},
{
"source": "instagram.com",
"visits": 556469880,
"visits_last_month": 500397434,
"share": 0.01354099
}
],
"total_backlinks": 50277073038,
"total_backlinks_last_month": 50401117901,
"total_backlinks_change": -0.25,
"backlinks_history": [
{
"date": "2026-05-01T00:00:00",
"backlinks": 50277073038
},
{
"date": "2026-04-01T00:00:00",
"backlinks": 50401117901
},
{
"date": "2026-03-01T00:00:00",
"backlinks": 51513015121
},
{
"date": "2026-02-01T00:00:00",
"backlinks": 51146670544
},
{
"date": "2026-01-01T00:00:00",
"backlinks": 51675883893
},
{
"date": "2025-12-01T00:00:00",
"backlinks": 51930531506
}
],
"backlinks_last_updated": "2026-05-01T00:00:00",
"referral_domains": 51300049,
"referral_domains_last_month": 51986210,
"referral_domains_change": -1.32,
"referral_domains_history": [
{
"date": "2026-05-01T00:00:00",
"referringDomains": 51300049
},
{
"date": "2026-04-01T00:00:00",
"referringDomains": 51986210
},
{
"date": "2026-03-01T00:00:00",
"referringDomains": 52629411
},
{
"date": "2026-02-01T00:00:00",
"referringDomains": 52374318
},
{
"date": "2026-01-01T00:00:00",
"referringDomains": 51920588
},
{
"date": "2025-12-01T00:00:00",
"referringDomains": 51836255
}
],
"top_organic_keywords": [
{
"keyword": "google",
"traffic_share": 0.0004,
"search_volume": 83100000,
"cpc": 20.72
},
{
"keyword": "google flights",
"traffic_share": 0.0003,
"search_volume": 20400000,
"cpc": 0.75
},
{
"keyword": "gmail",
"traffic_share": 0.0003,
"search_volume": 55600000,
"cpc": 1.64
},
{
"keyword": "facebook",
"traffic_share": 0.0003,
"search_volume": 101000000,
"cpc": 7.17
},
{
"keyword": "google maps",
"traffic_share": 0.0003,
"search_volume": 16600000,
"cpc": 0.42
}
],
"top_organic_keywords_last_updated": "2026-05-15T00:00:00",
"competitors": [
{
"domain": "apple.com",
"relevance": 0.28,
"visits": 704638097,
"favicon": null
},
{
"domain": "microsoft.com",
"relevance": 0.13,
"visits": 1222875095,
"favicon": "https://static.semrush.com/power-pages/media/favicons/microsoft-com-favicon-12e3dac8.ico"
},
{
"domain": "wikipedia.org",
"relevance": 0.09,
"visits": 4182321063,
"favicon": "https://static.semrush.com/power-pages/media/favicons/wikipedia-org-favicon-904ce6bd.ico"
}
]
}
```
#### Top Websites Ranking Search
###### Requires: `Top Website Industry` `Top Website Country`
###### Fields: `total_traffic` `total_traffic_history` `ranks` (up to 100 results)
```json
{
"data_captured_at": "2025-10-09T20:03:08.157973",
"type": "top_trending_websites",
"last_updated": "2025-08-01T00:00:00",
"country": "global",
"industry": "all",
"total_traffic": 253261802635,
"total_traffic_history": [
{
"date": "2024-09-01T00:00:00",
"value": 255234250991
},
{
"date": "2024-10-01T00:00:00",
"value": 268751094934
},
{
"date": "2024-11-01T00:00:00",
"value": 247929534176
},
...
{
"date": "2025-06-01T00:00:00",
"value": 240830956236
},
{
"date": "2025-07-01T00:00:00",
"value": 257868271205
},
{
"date": "2025-08-01T00:00:00",
"value": 254846321495
}
],
"ranks": [
{
"domain": "google.com",
"rank": 1,
"traffic": 98223803338,
"traffic_month_over_month_change_percentage": -3.082808,
"traffic_year_over_year_change_percentage": 0.02475095,
"desktop_traffic": 26987570738,
"mobile_traffic": 71236232600,
"desktop_share": 0.274755912730568,
"mobile_share": 0.7252440872694321,
"top_source": "direct",
"traffic_month_over_month_change": -3028051267,
"traffic_year_over_year_change": 24311324
},
{
"domain": "youtube.com",
"rank": 2,
"traffic": 48112196329,
"traffic_month_over_month_change_percentage": 0.02100302,
"traffic_year_over_year_change_percentage": -4.286362,
"desktop_traffic": 14752923970,
"mobile_traffic": 33359272359,
"desktop_share": 0.30663584487219847,
"mobile_share": 0.6933641551278015,
"top_source": "direct",
"traffic_month_over_month_change": 10105014,
"traffic_year_over_year_change": -2062262900
},
{
"domain": "facebook.com",
"rank": 3,
"traffic": 9676753447,
"traffic_month_over_month_change_percentage": -2.6834202,
"traffic_year_over_year_change_percentage": -11.636927,
"desktop_traffic": 4746416117,
"mobile_traffic": 4930337330,
"desktop_share": 0.49049675007184257,
"mobile_share": 0.5095032499281574,
"top_source": "direct",
"traffic_month_over_month_change": -259667956,
"traffic_year_over_year_change": -1126076734
},
...
{
"domain": "mercadolivre.com.br",
"rank": 98,
"traffic": 216763258,
"traffic_month_over_month_change_percentage": 0.416558,
"traffic_year_over_year_change_percentage": 0.11037884999999999,
"desktop_traffic": 126577134,
"mobile_traffic": 90186124,
"desktop_share": 0.583941832060856,
"mobile_share": 0.416058167939144,
"top_source": "direct",
"traffic_month_over_month_change": 902944,
"traffic_year_over_year_change": 239260
},
{
"domain": "dailymail.co.uk",
"rank": 99,
"traffic": 213389734,
"traffic_month_over_month_change_percentage": -10.592063,
"traffic_year_over_year_change_percentage": -25.038593,
"desktop_traffic": 76267580,
"mobile_traffic": 137122154,
"desktop_share": 0.35740978991988437,
"mobile_share": 0.6425902100801157,
"top_source": "direct",
"traffic_month_over_month_change": -22602375,
"traffic_year_over_year_change": -53429787
},
{
"domain": "scribd.com",
"rank": 100,
"traffic": 213064083,
"traffic_month_over_month_change_percentage": 0.022294247,
"traffic_year_over_year_change_percentage": 0.19249655000000002,
"desktop_traffic": 79302603,
"mobile_traffic": 133761480,
"desktop_share": 0.3722007101497253,
"mobile_share": 0.6277992898502748,
"top_source": "search",
"traffic_month_over_month_change": 47501,
"traffic_year_over_year_change": 410141
}
]
}
```
### βΈ Input
#### Semrush Search Parameters
| Parameter | Type | Default | Description |
| ----------------------- | -------------- | --------------------------- | ------------------------------------------------------------------------------------------------------------------------------------- |
| `urls` | array (string) | `["make.com","zapier.com"]` | List of domains or full URLs to analyze on Semrush. Supports bulk analysis (e.g. `["make.com","example.com"]`). |
| `include_overview` | boolean | `false` | Includes basic domain overview metrics such as authority score, backlinks, organic traffic, and general stats. |
| `include_authority` | boolean | `true` | Includes domain authority metrics such as domain rating, referral domains, backlink health and authority indicators. |
| `include_top_websites` | boolean | `false` | Includes top trending websites by industry and country with global ranking insights. |
| `industry_top_websites` | string | `all` | Industry filter for top websites search (e.g. `all`, `accounting-and-auditing`, `advertising-and-marketing`, `banking`, `education`). |
| `country_top_websites` | string | `global` | Country filter for top websites search (e.g. `global`, `us`, `uk`, `de`, `fr`, `jp`, `br`, `ru`). |
#### Supported URL Formats
| Link | Supported |
| -------------------------------------------------- | --------- |
| | β
|
| [https://www.n8n.io](https://www.make.com) | β
|
| | β
|
| [pipedream.com](pipedream.com) | β
|
#### JSON Input
Sample JSON input if you use the apify api via CURL, Python, JS etc.
```json
{
"urls": ["https://www.make.com/"],
"keyword": "ai automation",
"country": "us",
"include_overview": true,
"include_authority": true,
"include_top_websites": true,
"industry_top_websites": "all",
"country_top_websites": "global"
}
```
### Available Search Types
Each run can include up to 10 different search types:
- `overview` - Basic Domain metrics and stats
- `authority` - Domain authority metrics
- `top_websites` - Top 100 trending websites worldwide or in a specific industry and country
### βΉ Use Cases
- **SEO Specialists & Digital Marketers**: Gather detailed authority metrics, keyword data, traffic analytics, and backlink insights to refine SEO strategies and outperform competitors.
- **Business Intelligence Teams**: Analyze **website performance trends**, **market positioning**, and **competitive landscapes** for data-driven decision-making.
- **Enterprise SEO Teams**: Monitor **domain health**, **backlink evolution**, **traffic changes**, and **keyword visibility** across multiple websites and markets.
- **Competitive Analysts**: Track **trending domains**, **industry benchmarks**, and **global traffic movements** to understand digital share of voice.
- **Agencies & Consultants**: Provide clients with comprehensive **SEO audits**, **authority tracking**, and **market opportunity assessments**.
- **Data Scientists & Researchers**: Collect large-scale SEO datasets for **trend forecasting**, **correlation analysis**, and **competitive intelligence modeling**.
The **Semrush Data Scraper** streamlines the collection and analysis of in-depth SEO metrics, delivering enterprise-grade insights for professionals who need **complete competitive visibility** and **data-rich performance tracking**.
### βΊ Usage Limits
This service has different usage limits depending on your subscription status:
| User Type | Monthly Runs | # Bulk URLs Supported | Reset Period |
| --------- | ------------ | --------------------- | ------------ |
| **Free** | 3 runs | 1 per run | 30 days |
| **Paid** | Unlimited | Unlimited | N/A |
#### How Limits Work
- **Free users**: Limited to 3 runs per 30-day period from your first usage
- **Paid users**: No limits on the number of runs
- **All users**: Can select any combination of the available search types to them in a single run
- Usage resets automatically 30 days after your first run (for free users)
### β» FAQ
#### How do i get started?
Getting started is easy! Just click on the "Try for free" button at the top of the page, sign up for an Apify account if you don't have one, and you'll be taken to the Apify Console where you can run the Semrush Scraper Actor. You can input the parameters for your search, select the search types you want to include, and then start the run. Once the run is complete, you can view and download your results directly from the Apify Console.
#### How long does a run take?
The runtime depends on the number of search types you select and the number of URLs you include in your input. A single search type for a single URL typically takes around 15-30 seconds. If you select multiple search types or include multiple URLs, the runtime will increase accordingly.
#### What format are the results in?
The results are provided in JSON format, which is easy to read and can be easily integrated into your data analysis workflows. You can also view the output as a csv table. Each search type will have its own section in the output view, containing the relevant metrics and data for that search.
### βΌ While the scraper is running
During the run, the actor will output log messages letting you know what is going on at any point. Each message always contains specific information about the process including which url / page the actor is working on.
If you provide invalid inputs to the actor, it will immediately stop with a failure state and output log messages explaining what is wrong. If you are unsure what went wrong feel free to open up an issue in the issue tab.
### β½ Legality of web scraping
The **Semrush Scraper** is designed to ethically extract **only publicly available job data and company information**, and it **does not** scrape private user data such as personal email addresses or personal identifiers.
Our services are ethical and **do not extract any private user data**. They only extract **what individuals or companies chose to share publicly**. We therefore believe that our services, when used for ethical purposes by our users, are safe to use. However, you should be aware that your results could contain personal data. Personal data is protected by the **GDPR** in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. For more information you can read this [blog post](https://blog.apify.com/is-web-scraping-legal/) on the legality of web scraping from Apify.
### βΎ Feedback and Support
**Your satisfaction** is **important** to us! Therefore we are constantly striving to enhance the performance of our services.
If you have any technical feedback or encounter any bugs within the **Semrush Scraper**, please create an issue in the Actorβs Issues tab on the Apify Console to let us know about it. We will look into it as soon as possible.
You can also contact us directly for **general help** on **issues** or **integrations** at suppport@radeance.com.
For **custom projects**, **general suggestions** or **new use cases** feel free to reach out to us at business@radeance.com
# Actor input Schema
## `urls` (type: `array`):
A list of URLs or Domains to search for on Semrush. You can specify multiple URLs by clicking on the Add button or in bulk by clicking on the Bulk edit button. Maximum Allowed URLs is 5 for free users and unlimited for paying users, others will be disregarded.
## `keyword` (type: `string`):
The keyword to search for on Semrush. Required for SERP Search and Keyword Volume / CPC Search.
## `country` (type: `string`):
Select the country for the search on Semrush. Required for SERP Search and Keyword Volume / CPC Search.
## `include_overview` (type: `boolean`):
Needs Domain / Website. If checked, the search will include website stats overview data like rank, category, visits, bounce rate, traffic from Semrush. β οΈ This search will only return results on websites with high traffic.
## `include_authority` (type: `boolean`):
Needs Domain / Website. If checked, the search will include domain overview / web authority data like authority score and health stats from Semrush.
## `include_traffic` (type: `boolean`):
Needs Domain / Website. If checked, the search will include web-traffic data from Semrush.
## `include_backlinks` (type: `boolean`):
Needs Domain / Website. If checked, the search will include backlinks data from Semrush.
## `include_ai_visibility` (type: `boolean`):
Needs Domain / Website. If checked, the search will include AI Visibility data from Semrush including citation, mentions, audience and search volume count.
## `include_competitors` (type: `boolean`):
Needs Domain / Website. If checked, the search will include competitors data from Semrush.
## `include_keyword_volume` (type: `boolean`):
Needs Keyword and Country. If checked, the search will include keywords data from Semrush.
## `include_keywords_ranking` (type: `boolean`):
Needs Domain / Website. If checked, the search will include keywords ranking data from Semrush.
## `include_seo` (type: `boolean`):
Needs Domain / Website. If checked, the search will include SEO Audit data from Semrush.
## `include_serp` (type: `boolean`):
Needs Keyword and Country. If checked, the search will include SERP data from Semrush.
## `include_top_websites` (type: `boolean`):
If checked, the search will include top websites data from Semrush from the Top websites ranking.
## `industry_top_websites` (type: `string`):
Select the category for the search on Semrush Top Websites Ranking.
## `country_top_websites` (type: `string`):
Select the country for the search on Semrush Top Websites Ranking.
## Actor input object example
```json
{
"urls": [
"zapier.com"
],
"keyword": "agentic ai",
"country": "us",
"include_overview": true,
"include_authority": true,
"include_traffic": false,
"include_backlinks": false,
"include_ai_visibility": false,
"include_competitors": false,
"include_keyword_volume": false,
"include_keywords_ranking": false,
"include_seo": false,
"include_serp": false,
"include_top_websites": false,
"industry_top_websites": "all",
"country_top_websites": "global"
}
```
# Actor output Schema
## `results` (type: `string`):
No description
# API
You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.
## JavaScript example
```javascript
import { ApifyClient } from 'apify-client';
// Initialize the ApifyClient with your Apify API token
// Replace the '' with your token
const client = new ApifyClient({
token: '',
});
// Prepare Actor input
const input = {
"urls": [
"zapier.com"
],
"keyword": "agentic ai"
};
// Run the Actor and wait for it to finish
const run = await client.actor("radeance/semrush-scraper").call(input);
// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`πΎ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
console.dir(item);
});
// π Want to learn more π? Go to β https://docs.apify.com/api/client/js/docs
```
## Python example
```python
from apify_client import ApifyClient
# Initialize the ApifyClient with your Apify API token
# Replace '' with your token.
client = ApifyClient("")
# Prepare the Actor input
run_input = {
"urls": ["zapier.com"],
"keyword": "agentic ai",
}
# Run the Actor and wait for it to finish
run = client.actor("radeance/semrush-scraper").call(run_input=run_input)
# Fetch and print Actor results from the run's dataset (if there are any)
print("πΎ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)
# π Want to learn more π? Go to β https://docs.apify.com/api/client/python/docs/quick-start
```
## CLI example
```bash
echo '{
"urls": [
"zapier.com"
],
"keyword": "agentic ai"
}' |
apify call radeance/semrush-scraper --silent --output-dataset
```
## MCP server setup
```json
{
"mcpServers": {
"apify": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com/?tools=radeance/semrush-scraper",
"--header",
"Authorization: Bearer "
]
}
}
}
```
## OpenAPI specification
```json
{
"openapi": "3.0.1",
"info": {
"title": "Semrush Scraper",
"description": "Extract enterprise-level SEO data from Semrush including domain authority, traffic analytics, keyword rankings, backlink profiles, trending sites & competitor insights. Supports bulk analysis with historical trends. Download as CSV, JSON, Excel, XML & more.",
"version": "0.0",
"x-build-id": "XQ9yCrBHqfcuz3fIq"
},
"servers": [
{
"url": "https://api.apify.com/v2"
}
],
"paths": {
"/acts/radeance~semrush-scraper/run-sync-get-dataset-items": {
"post": {
"operationId": "run-sync-get-dataset-items-radeance-semrush-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
},
"/acts/radeance~semrush-scraper/runs": {
"post": {
"operationId": "runs-sync-radeance-semrush-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor and returns information about the initiated run in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK",
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/runsResponseSchema"
}
}
}
}
}
}
},
"/acts/radeance~semrush-scraper/run-sync": {
"post": {
"operationId": "run-sync-radeance-semrush-scraper",
"x-openai-isConsequential": false,
"summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
"tags": [
"Run Actor"
],
"requestBody": {
"required": true,
"content": {
"application/json": {
"schema": {
"$ref": "#/components/schemas/inputSchema"
}
}
}
},
"parameters": [
{
"name": "token",
"in": "query",
"required": true,
"schema": {
"type": "string"
},
"description": "Enter your Apify token here"
}
],
"responses": {
"200": {
"description": "OK"
}
}
}
}
},
"components": {
"schemas": {
"inputSchema": {
"type": "object",
"properties": {
"urls": {
"title": "URL(s) or Domain(s)",
"type": "array",
"description": "A list of URLs or Domains to search for on Semrush. You can specify multiple URLs by clicking on the Add button or in bulk by clicking on the Bulk edit button. Maximum Allowed URLs is 5 for free users and unlimited for paying users, others will be disregarded.",
"items": {
"type": "string"
}
},
"keyword": {
"title": "Keyword",
"type": "string",
"description": "The keyword to search for on Semrush. Required for SERP Search and Keyword Volume / CPC Search."
},
"country": {
"title": "Country",
"enum": [
"af",
"al",
"dz",
"as",
"ad",
"ao",
"ai",
"ag",
"ar",
"am",
"au",
"at",
"az",
"bs",
"bh",
"bd",
"by",
"be",
"bz",
"bj",
"bt",
"bo",
"ba",
"bw",
"br",
"bn",
"bg",
"bf",
"bi",
"kh",
"cm",
"ca",
"cv",
"cf",
"td",
"cl",
"co",
"cg",
"cd",
"ck",
"cr",
"ci",
"hr",
"cy",
"cz",
"dk",
"dj",
"dm",
"do",
"ec",
"eg",
"sv",
"ee",
"et",
"fj",
"fi",
"fr",
"ga",
"gm",
"ge",
"de",
"gh",
"gi",
"gr",
"gl",
"gp",
"gt",
"gg",
"gy",
"ht",
"hn",
"hk",
"hu",
"is",
"in",
"id",
"iq",
"ie",
"il",
"it",
"jm",
"jp",
"je",
"jo",
"kz",
"ke",
"ki",
"kr",
"kw",
"kg",
"la",
"lv",
"lb",
"ls",
"ly",
"li",
"lt",
"lu",
"mk",
"mg",
"mw",
"my",
"mv",
"ml",
"mt",
"mu",
"mx",
"fm",
"md",
"mn",
"me",
"ms",
"ma",
"mz",
"mm",
"na",
"nr",
"np",
"nl",
"nz",
"ni",
"ne",
"ng",
"nu",
"no",
"om",
"pk",
"ps",
"pa",
"pg",
"py",
"pe",
"ph",
"pn",
"pl",
"pt",
"pr",
"qa",
"ro",
"ru",
"rw",
"sh",
"vc",
"ws",
"sm",
"st",
"sa",
"sn",
"rs",
"sc",
"sl",
"sg",
"sk",
"si",
"sb",
"so",
"za",
"es",
"lk",
"sr",
"se",
"ch",
"tw",
"tj",
"tz",
"th",
"tl",
"tg",
"tk",
"to",
"tt",
"tn",
"tr",
"tm",
"ug",
"ua",
"ae",
"gb",
"us",
"uy",
"uz",
"vu",
"ve",
"vn",
"vg",
"vi",
"zm",
"zw"
],
"type": "string",
"description": "Select the country for the search on Semrush. Required for SERP Search and Keyword Volume / CPC Search.",
"default": "us"
},
"include_overview": {
"title": "Include Domain Overview (former Website Stats)",
"type": "boolean",
"description": "Needs Domain / Website. If checked, the search will include website stats overview data like rank, category, visits, bounce rate, traffic from Semrush. β οΈ This search will only return results on websites with high traffic.",
"default": true
},
"include_authority": {
"title": "Include Domain Authority",
"type": "boolean",
"description": "Needs Domain / Website. If checked, the search will include domain overview / web authority data like authority score and health stats from Semrush.",
"default": true
},
"include_traffic": {
"title": "Include Web-Traffic (Deprecated)",
"type": "boolean",
"description": "Needs Domain / Website. If checked, the search will include web-traffic data from Semrush.",
"default": false
},
"include_backlinks": {
"title": "Include Backlinks (Deprecated)",
"type": "boolean",
"description": "Needs Domain / Website. If checked, the search will include backlinks data from Semrush.",
"default": false
},
"include_ai_visibility": {
"title": "Include AI Visibility (Deprecated)",
"type": "boolean",
"description": "Needs Domain / Website. If checked, the search will include AI Visibility data from Semrush including citation, mentions, audience and search volume count.",
"default": false
},
"include_competitors": {
"title": "Include Competitors (Deprecated)",
"type": "boolean",
"description": "Needs Domain / Website. If checked, the search will include competitors data from Semrush.",
"default": false
},
"include_keyword_volume": {
"title": "Include Keyword Volume / CPC (Deprecated)",
"type": "boolean",
"description": "Needs Keyword and Country. If checked, the search will include keywords data from Semrush.",
"default": false
},
"include_keywords_ranking": {
"title": "Include Keywords Ranking (Deprecated)",
"type": "boolean",
"description": "Needs Domain / Website. If checked, the search will include keywords ranking data from Semrush.",
"default": false
},
"include_seo": {
"title": "Include SEO Audit (Sitemaps, Robots.txt, Internal / External Links) (Deprecated)",
"type": "boolean",
"description": "Needs Domain / Website. If checked, the search will include SEO Audit data from Semrush.",
"default": false
},
"include_serp": {
"title": "Include SERP (Deprecated)",
"type": "boolean",
"description": "Needs Keyword and Country. If checked, the search will include SERP data from Semrush.",
"default": false
},
"include_top_websites": {
"title": "Include Top Websites Search",
"type": "boolean",
"description": "If checked, the search will include top websites data from Semrush from the Top websites ranking.",
"default": false
},
"industry_top_websites": {
"title": "Industry (Top Websites Search Only)",
"enum": [
"all",
"accounting-and-auditing",
"adult",
"advertising-and-marketing",
"aerospace-and-defense",
"agriculture",
"airlines",
"apparel-and-fashion",
"architecture",
"automotive",
"banking",
"beauty-and-cosmetics",
"biotech",
"ceramics-and-pottery",
"chemicals",
"civil-engineering",
"comics-and-animation",
"computer-and-video-games",
"computer-hardware",
"computer-software-and-development",
"computers-and-electronics",
"construction-and-maintenance",
"consulting",
"consumer-electronics",
"crafts",
"customer-services",
"design",
"distance-learning",
"ecology-and-environment",
"education",
"entertainment",
"equipment-and-supplies",
"events-services",
"facilities-services",
"farms-and-ranches",
"finance",
"fishery",
"food-and-beverages",
"foreign-language",
"furniture",
"gambling",
"government",
"graphic-design",
"healthcare",
"hospitality",
"human-resources",
"import-and-export",
"information-technology",
"insurance",
"investment",
"jewelry-and-luxury-products",
"legal",
"libraries",
"machinery",
"mail-and-package-delivery",
"manufacturing",
"maritime",
"market-research",
"mass-media",
"medical-devices-and-equipment",
"mental-health",
"metals-and-mining",
"military",
"museums",
"music",
"nanotechnology",
"newspapers",
"nonprofit-organizations",
"oil-and-gas",
"online-services",
"outsourcing",
"packaging-and-containers",
"performing-arts",
"pharmaceuticals",
"photography",
"plastics-and-polymers",
"political-organizations",
"printing",
"public-policy",
"public-relations",
"public-safety",
"public-utility",
"publishing",
"real-estate",
"recreational-facilities",
"recruitment-and-staffing",
"reference",
"religion-and-belief",
"renewable-energy",
"restaurants",
"retail",
"science",
"security-products-and-services",
"social-and-charitable-organizations",
"sporting-goods",
"sports",
"telecom",
"textiles-and-nonwovens",
"tobacco",
"training-and-certification",
"transportation-and-logistics",
"travel-and-tourism",
"tv-and-movies",
"venture-capital",
"veterinary",
"visual-art",
"warehousing",
"wellness",
"wholesalers-and-liquidators",
"wine-and-spirits",
"writing-and-editing-services"
],
"type": "string",
"description": "Select the category for the search on Semrush Top Websites Ranking.",
"default": "all"
},
"country_top_websites": {
"title": "Country (Top Websites Search Only)",
"enum": [
"global",
"af",
"al",
"dz",
"as",
"ad",
"ao",
"ai",
"ag",
"ar",
"am",
"au",
"at",
"az",
"bs",
"bh",
"bd",
"by",
"be",
"bz",
"bj",
"bt",
"bo",
"ba",
"bw",
"br",
"bn",
"bg",
"bf",
"bi",
"kh",
"cm",
"ca",
"cv",
"cf",
"td",
"cl",
"co",
"cg",
"cd",
"ck",
"cr",
"ci",
"hr",
"cy",
"cz",
"dk",
"dj",
"dm",
"do",
"ec",
"eg",
"sv",
"ee",
"et",
"fj",
"fi",
"fr",
"ga",
"gm",
"ge",
"de",
"gh",
"gi",
"gr",
"gl",
"gp",
"gt",
"gg",
"gy",
"ht",
"hn",
"hk",
"hu",
"is",
"in",
"id",
"iq",
"ie",
"il",
"it",
"jm",
"jp",
"je",
"jo",
"kz",
"ke",
"ki",
"kr",
"kw",
"kg",
"la",
"lv",
"lb",
"ls",
"ly",
"li",
"lt",
"lu",
"mk",
"mg",
"mw",
"my",
"mv",
"ml",
"mt",
"mu",
"mx",
"fm",
"md",
"mn",
"me",
"ms",
"ma",
"mz",
"mm",
"na",
"nr",
"np",
"nl",
"nz",
"ni",
"ne",
"ng",
"nu",
"no",
"om",
"pk",
"ps",
"pa",
"pg",
"py",
"pe",
"ph",
"pn",
"pl",
"pt",
"pr",
"qa",
"ro",
"ru",
"rw",
"sh",
"vc",
"ws",
"sm",
"st",
"sa",
"sn",
"rs",
"sc",
"sl",
"sg",
"sk",
"si",
"sb",
"so",
"za",
"es",
"lk",
"sr",
"se",
"ch",
"tw",
"tj",
"tz",
"th",
"tl",
"tg",
"tk",
"to",
"tt",
"tn",
"tr",
"tm",
"ug",
"ua",
"ae",
"gb",
"us",
"uy",
"uz",
"vu",
"ve",
"vn",
"vg",
"vi",
"zm",
"zw"
],
"type": "string",
"description": "Select the country for the search on Semrush Top Websites Ranking.",
"default": "global"
}
}
},
"runsResponseSchema": {
"type": "object",
"properties": {
"data": {
"type": "object",
"properties": {
"id": {
"type": "string"
},
"actId": {
"type": "string"
},
"userId": {
"type": "string"
},
"startedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"finishedAt": {
"type": "string",
"format": "date-time",
"example": "2025-01-08T00:00:00.000Z"
},
"status": {
"type": "string",
"example": "READY"
},
"meta": {
"type": "object",
"properties": {
"origin": {
"type": "string",
"example": "API"
},
"userAgent": {
"type": "string"
}
}
},
"stats": {
"type": "object",
"properties": {
"inputBodyLen": {
"type": "integer",
"example": 2000
},
"rebootCount": {
"type": "integer",
"example": 0
},
"restartCount": {
"type": "integer",
"example": 0
},
"resurrectCount": {
"type": "integer",
"example": 0
},
"computeUnits": {
"type": "integer",
"example": 0
}
}
},
"options": {
"type": "object",
"properties": {
"build": {
"type": "string",
"example": "latest"
},
"timeoutSecs": {
"type": "integer",
"example": 300
},
"memoryMbytes": {
"type": "integer",
"example": 1024
},
"diskMbytes": {
"type": "integer",
"example": 2048
}
}
},
"buildId": {
"type": "string"
},
"defaultKeyValueStoreId": {
"type": "string"
},
"defaultDatasetId": {
"type": "string"
},
"defaultRequestQueueId": {
"type": "string"
},
"buildNumber": {
"type": "string",
"example": "1.0.0"
},
"containerUrl": {
"type": "string"
},
"usage": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "integer",
"example": 1
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
},
"usageTotalUsd": {
"type": "number",
"example": 0.00005
},
"usageUsd": {
"type": "object",
"properties": {
"ACTOR_COMPUTE_UNITS": {
"type": "integer",
"example": 0
},
"DATASET_READS": {
"type": "integer",
"example": 0
},
"DATASET_WRITES": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_READS": {
"type": "integer",
"example": 0
},
"KEY_VALUE_STORE_WRITES": {
"type": "number",
"example": 0.00005
},
"KEY_VALUE_STORE_LISTS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_READS": {
"type": "integer",
"example": 0
},
"REQUEST_QUEUE_WRITES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_INTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"DATA_TRANSFER_EXTERNAL_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
"type": "integer",
"example": 0
},
"PROXY_SERPS": {
"type": "integer",
"example": 0
}
}
}
}
}
}
}
}
}
}
```