💎 Semrush SEO Scraper

Discover more ➤	Similarweb Scraper	Ahrefs Scraper	MOZ Scraper	Ubersuggest Scraper

The Semrush Scraper on Apify gives you complete, structured SEO insights from Semrush — including authority metrics, organic and paid traffic, keyword rankings, backlink profiles, and SERP data. It supports multiple search modes, letting you extract domain overviews, traffic sources, keyword volumes, keyword rankings, historical performance data and SEO Audits across global markets.

Whether you’re analyzing competitors, tracking visibility trends, or building SEO dashboards, this Actor provides rich, export-ready data such as authority scores, search traffic breakdowns, keyword difficulty, backlinks, and top-ranking URLs. Designed for SEO experts, marketers, and analysts, it delivers enterprise-level insights at scale with clean JSON, CSV, or XLSX outputs.

❶ Key Features

• 🔍 Comprehensive SEO Data Extraction:
  

  • ✅ Scrape complete SEO intelligence from Semrush with support for multiple search types
  • ✅ Extract domain authority scores, traffic analytics, keyword performance, and backlink profiles automatically
  • ✅ Access detailed metrics such as authority score, organic traffic, bounce rate, pages per visit, keyword positions, and more

• 📈 Advanced Traffic Analytics:
  

  • ✅ Capture precise website traffic data, including visits, engagement, and time on site
  • ✅ View traffic distribution by device (desktop vs mobile) and geographical share across top countries
  • ✅ Analyze traffic channels including direct, organic, paid, social, and referral sources

• 🖇️ Backlink & Authority Intelligence:
  

  • ✅ Scrape complete backlink profiles with historical data trends and quality indicators
  • ✅ Retrieve referring domain counts, authority scoring, and link power metrics
  • ✅ Identify top-performing pages by backlink volume and distribution

• 📍 Keyword & SERP Insights:
  

  • ✅ Capture organic keyword rankings, search volumes, keyword difficulty, and CPC data
  • ✅ Analyze search trends, SERP results, and top-ranking URLs for any keyword or country
  • ✅ Discover competitive keyword overlaps and traffic opportunities

• 🔖 SEO Audit:
  

  • ✅ Perform in-depth SEO audits of any domain or URL
  • ✅ Extract on-page SEO elements including titles, meta descriptions, headings, text content, images, and internal & external links
  • ✅ Analyze technical SEO factors like robots.txt, sitemaps, and language

• 🏆 Trending Website Data:
  

  • ✅ Track top-performing websites globally by traffic, rank, and engagement
  • ✅ Measure month-over-month and year-over-year growth for any industry
  • ✅ Uncover category-based rankings and emerging market leaders

• 📊 Flexible Data Output:
  

  • ✅ Export SEO data seamlessly in multiple formats: CSV, XLSX, JSON, JSONL, XML, and RSS

❷ Output

Domain Authority Overview

Requires: Domain or URL

Fields: authority_score moz_domain_authority, moz_spam_score

{
    "data_captured_at": "2026-06-14T22:22:07.885680",
    "type": "domain_authority",
    "last_updated": "2026-06-01T00:00:00",
    "domain": "google.com",
    "authority_score": 100,
    "moz_domain_authority": 94,
    "moz_spam_score": "1.0%"
}

Domain Overview

Requires: Domain or URL

Fields: categories, visits, visits_history, bounce_rate, pages_per_visit, time_on_site, global_rank, category_rank, country_rank, authority_score, backlinks_google_penalty_risk, traffic_organic, traffic_paid, traffic_history, traffic_by_country_history, traffic_by_device_history, inbound_traffic_sources, outbound_traffic_sources, total_backlinks, total_backlinks_last_month, total_backlinks_change, backlinks_history, backlinks_last_updated, referral_domains, referral_domains_last_month, referral_domains_change, referral_domains_history, top_organic_keywords, top_organic_keywords_last_updated, competitors

{
    "data_captured_at": "2026-06-14T22:22:01.780939",
    "last_updated": "2026-06-12T00:00:00",
    "domain": "google.com",
    "country": "us",
    "categories": [
        {
            "category": "Online Services"
        }
    ],
    "visits": 101172727926,
    "visits_history": [
        {
            "date": "2026-05-01T00:00:00",
            "value": 101172727926
        },
        {
            "date": "2026-04-01T00:00:00",
            "value": 93834069957
        },
        {
            "date": "2026-03-01T00:00:00",
            "value": 111753386145
        }
    ],
    "bounce_rate": 0.3669,
    "pages_per_visit": 5.6419,
    "time_on_site": 799.0,
    "global_rank": {
        "category": "Global",
        "rank": 1,
        "change": 0,
        "rank_last_month": 1
    },
    "category_rank": {
        "category": "Online Services",
        "rank": 1,
        "change": 0,
        "rank_last_month": 1
    },
    "country_rank": {
        "country": "US",
        "rank": 1,
        "change": 0,
        "rank_last_month": 1
    },
    "authority_score": 100,
    "backlinks_google_penalty_risk": "Low",
    "traffic_organic": 5235637014,
    "traffic_paid": 21228492,
    "traffic_history": [
        {
            "date": "2026-05-15T00:00:00",
            "organic_traffic": 5235637014,
            "paid_traffic": 21228492,
            "search_traffic": 5256865506
        },
        {
            "date": "2026-04-15T00:00:00",
            "organic_traffic": 4628706977,
            "paid_traffic": 23417013,
            "search_traffic": 4652123990
        },
        {
            "date": "2026-03-15T00:00:00",
            "organic_traffic": 4638180545,
            "paid_traffic": 21650526,
            "search_traffic": 4659831071
        },
        {
            "date": "2026-02-15T00:00:00",
            "organic_traffic": 4793343366,
            "paid_traffic": 21571469,
            "search_traffic": 4814914835
        },
        {
            "date": "2026-01-15T00:00:00",
            "organic_traffic": 4790672330,
            "paid_traffic": 18204040,
            "search_traffic": 4808876370
        },
        {
            "date": "2025-12-15T00:00:00",
            "organic_traffic": 4917115520,
            "paid_traffic": 23052763,
            "search_traffic": 4940168283
        }
    ],
    "traffic_by_country_history": [
        {
            "country": "US",
            "traffic_share": 0.2405,
            "traffic": 24331115522,
            "desktop_share": 0.2794,
            "mobile_share": 0.7206
        },
        {
            "country": "JP",
            "traffic_share": 0.0632,
            "traffic": 6389773210,
            "desktop_share": 0.1857,
            "mobile_share": 0.8143
        },
        {
            "country": "IN",
            "traffic_share": 0.0542,
            "traffic": 5487266135,
            "desktop_share": 0.2773,
            "mobile_share": 0.7227
        },
        {
            "country": "BR",
            "traffic_share": 0.0501,
            "traffic": 5067029603,
            "desktop_share": 0.2751,
            "mobile_share": 0.7249
        },
        {
            "country": "DE",
            "traffic_share": 0.0343,
            "traffic": 3471013237,
            "desktop_share": 0.3288,
            "mobile_share": 0.6712
        }
    ],
    "traffic_by_device_history": [
        {
            "date": "2026-05-01T00:00:00",
            "value": 101172727926,
            "desktop_visits": 29349576296,
            "mobile_visits": 71823151630,
            "desktop_share": 0.2900937525127022,
            "mobile_share": 0.7099062474872978
        },
        {
            "date": "2026-04-01T00:00:00",
            "value": 93834069957,
            "desktop_visits": 27351478846,
            "mobile_visits": 66482591111,
            "desktop_share": 0.2914877171856019,
            "mobile_share": 0.7085122828143982
        },
        {
            "date": "2026-03-01T00:00:00",
            "value": 111753386145,
            "desktop_visits": 32321386007,
            "mobile_visits": 79432000138,
            "desktop_share": 0.2892206412883365,
            "mobile_share": 0.7107793587116635
        },
        {
            "date": "2026-02-01T00:00:00",
            "value": 88460065425,
            "desktop_visits": 25528803784,
            "mobile_visits": 62931261641,
            "desktop_share": 0.2885912830987486,
            "mobile_share": 0.7114087169012514
        },
        {
            "date": "2026-01-01T00:00:00",
            "value": 94757767992,
            "desktop_visits": 27958159934,
            "mobile_visits": 66799608058,
            "desktop_share": 0.29504873876261406,
            "mobile_share": 0.7049512612373859
        },
        {
            "date": "2025-12-01T00:00:00",
            "value": 95362815483,
            "desktop_visits": 26615919234,
            "mobile_visits": 68746896249,
            "desktop_share": 0.2791016508813619,
            "mobile_share": 0.720898349118638
        }
    ],
    "inbound_traffic_sources": [
        {
            "source": "Direct",
            "visits": 27186577924,
            "visits_last_month": 25344605557,
            "share": 0.92630223
        },
        {
            "source": "youtube.com",
            "visits": 243299470,
            "visits_last_month": 219053012,
            "share": 0.00828971
        },
        {
            "source": "bing.com",
            "visits": 50097916,
            "visits_last_month": 46479615,
            "share": 0.00170694
        },
        {
            "source": "chatgpt.com",
            "visits": 46273515,
            "visits_last_month": 40206382,
            "share": 0.00157664
        },
        {
            "source": "web.whatsapp.com",
            "visits": 43977047,
            "visits_last_month": 41992850,
            "share": 0.00149839
        }
    ],
    "outbound_traffic_sources": [
        {
            "source": "youtube.com",
            "visits": 1574608577,
            "visits_last_month": 1449034666,
            "share": 0.0383161
        },
        {
            "source": "reddit.com",
            "visits": 1268530601,
            "visits_last_month": 1179403913,
            "share": 0.03086808
        },
        {
            "source": "wikipedia.org",
            "visits": 790621068,
            "visits_last_month": 753363172,
            "share": 0.01923876
        },
        {
            "source": "facebook.com",
            "visits": 634252563,
            "visits_last_month": 593022231,
            "share": 0.01543373
        },
        {
            "source": "instagram.com",
            "visits": 556469880,
            "visits_last_month": 500397434,
            "share": 0.01354099
        }
    ],
    "total_backlinks": 50277073038,
    "total_backlinks_last_month": 50401117901,
    "total_backlinks_change": -0.25,
    "backlinks_history": [
        {
            "date": "2026-05-01T00:00:00",
            "backlinks": 50277073038
        },
        {
            "date": "2026-04-01T00:00:00",
            "backlinks": 50401117901
        },
        {
            "date": "2026-03-01T00:00:00",
            "backlinks": 51513015121
        },
        {
            "date": "2026-02-01T00:00:00",
            "backlinks": 51146670544
        },
        {
            "date": "2026-01-01T00:00:00",
            "backlinks": 51675883893
        },
        {
            "date": "2025-12-01T00:00:00",
            "backlinks": 51930531506
        }
    ],
    "backlinks_last_updated": "2026-05-01T00:00:00",
    "referral_domains": 51300049,
    "referral_domains_last_month": 51986210,
    "referral_domains_change": -1.32,
    "referral_domains_history": [
        {
            "date": "2026-05-01T00:00:00",
            "referringDomains": 51300049
        },
        {
            "date": "2026-04-01T00:00:00",
            "referringDomains": 51986210
        },
        {
            "date": "2026-03-01T00:00:00",
            "referringDomains": 52629411
        },
        {
            "date": "2026-02-01T00:00:00",
            "referringDomains": 52374318
        },
        {
            "date": "2026-01-01T00:00:00",
            "referringDomains": 51920588
        },
        {
            "date": "2025-12-01T00:00:00",
            "referringDomains": 51836255
        }
    ],
    "top_organic_keywords": [
        {
            "keyword": "google",
            "traffic_share": 0.0004,
            "search_volume": 83100000,
            "cpc": 20.72
        },
        {
            "keyword": "google flights",
            "traffic_share": 0.0003,
            "search_volume": 20400000,
            "cpc": 0.75
        },
        {
            "keyword": "gmail",
            "traffic_share": 0.0003,
            "search_volume": 55600000,
            "cpc": 1.64
        },
        {
            "keyword": "facebook",
            "traffic_share": 0.0003,
            "search_volume": 101000000,
            "cpc": 7.17
        },
        {
            "keyword": "google maps",
            "traffic_share": 0.0003,
            "search_volume": 16600000,
            "cpc": 0.42
        }
    ],
    "top_organic_keywords_last_updated": "2026-05-15T00:00:00",
    "competitors": [
        {
            "domain": "apple.com",
            "relevance": 0.28,
            "visits": 704638097,
            "favicon": null
        },
        {
            "domain": "microsoft.com",
            "relevance": 0.13,
            "visits": 1222875095,
            "favicon": "https://static.semrush.com/power-pages/media/favicons/microsoft-com-favicon-12e3dac8.ico"
        },
        {
            "domain": "wikipedia.org",
            "relevance": 0.09,
            "visits": 4182321063,
            "favicon": "https://static.semrush.com/power-pages/media/favicons/wikipedia-org-favicon-904ce6bd.ico"
        }
    ]
}

Top Websites Ranking Search

Requires: Top Website Industry Top Website Country

Fields: total_traffic total_traffic_history ranks (up to 100 results)

{
  "data_captured_at": "2025-10-09T20:03:08.157973",
  "type": "top_trending_websites",
  "last_updated": "2025-08-01T00:00:00",
  "country": "global",
  "industry": "all",
  "total_traffic": 253261802635,
  "total_traffic_history": [
    {
      "date": "2024-09-01T00:00:00",
      "value": 255234250991
    },
    {
      "date": "2024-10-01T00:00:00",
      "value": 268751094934
    },
    {
      "date": "2024-11-01T00:00:00",
      "value": 247929534176
    },
    ...
    {
      "date": "2025-06-01T00:00:00",
      "value": 240830956236
    },
    {
      "date": "2025-07-01T00:00:00",
      "value": 257868271205
    },
    {
      "date": "2025-08-01T00:00:00",
      "value": 254846321495
    }
  ],
  "ranks": [
    {
      "domain": "google.com",
      "rank": 1,
      "traffic": 98223803338,
      "traffic_month_over_month_change_percentage": -3.082808,
      "traffic_year_over_year_change_percentage": 0.02475095,
      "desktop_traffic": 26987570738,
      "mobile_traffic": 71236232600,
      "desktop_share": 0.274755912730568,
      "mobile_share": 0.7252440872694321,
      "top_source": "direct",
      "traffic_month_over_month_change": -3028051267,
      "traffic_year_over_year_change": 24311324
    },
    {
      "domain": "youtube.com",
      "rank": 2,
      "traffic": 48112196329,
      "traffic_month_over_month_change_percentage": 0.02100302,
      "traffic_year_over_year_change_percentage": -4.286362,
      "desktop_traffic": 14752923970,
      "mobile_traffic": 33359272359,
      "desktop_share": 0.30663584487219847,
      "mobile_share": 0.6933641551278015,
      "top_source": "direct",
      "traffic_month_over_month_change": 10105014,
      "traffic_year_over_year_change": -2062262900
    },
    {
      "domain": "facebook.com",
      "rank": 3,
      "traffic": 9676753447,
      "traffic_month_over_month_change_percentage": -2.6834202,
      "traffic_year_over_year_change_percentage": -11.636927,
      "desktop_traffic": 4746416117,
      "mobile_traffic": 4930337330,
      "desktop_share": 0.49049675007184257,
      "mobile_share": 0.5095032499281574,
      "top_source": "direct",
      "traffic_month_over_month_change": -259667956,
      "traffic_year_over_year_change": -1126076734
    },
    ...
    {
      "domain": "mercadolivre.com.br",
      "rank": 98,
      "traffic": 216763258,
      "traffic_month_over_month_change_percentage": 0.416558,
      "traffic_year_over_year_change_percentage": 0.11037884999999999,
      "desktop_traffic": 126577134,
      "mobile_traffic": 90186124,
      "desktop_share": 0.583941832060856,
      "mobile_share": 0.416058167939144,
      "top_source": "direct",
      "traffic_month_over_month_change": 902944,
      "traffic_year_over_year_change": 239260
    },
    {
      "domain": "dailymail.co.uk",
      "rank": 99,
      "traffic": 213389734,
      "traffic_month_over_month_change_percentage": -10.592063,
      "traffic_year_over_year_change_percentage": -25.038593,
      "desktop_traffic": 76267580,
      "mobile_traffic": 137122154,
      "desktop_share": 0.35740978991988437,
      "mobile_share": 0.6425902100801157,
      "top_source": "direct",
      "traffic_month_over_month_change": -22602375,
      "traffic_year_over_year_change": -53429787
    },
    {
      "domain": "scribd.com",
      "rank": 100,
      "traffic": 213064083,
      "traffic_month_over_month_change_percentage": 0.022294247,
      "traffic_year_over_year_change_percentage": 0.19249655000000002,
      "desktop_traffic": 79302603,
      "mobile_traffic": 133761480,
      "desktop_share": 0.3722007101497253,
      "mobile_share": 0.6277992898502748,
      "top_source": "search",
      "traffic_month_over_month_change": 47501,
      "traffic_year_over_year_change": 410141
    }
  ]
}

❸ Input

Semrush Search Parameters

Parameter	Type	Default	Description
urls	array (string)	["make.com","zapier.com"]	List of domains or full URLs to analyze on Semrush. Supports bulk analysis (e.g. ["make.com","example.com"]).
include_overview	boolean	false	Includes basic domain overview metrics such as authority score, backlinks, organic traffic, and general stats.
include_authority	boolean	true	Includes domain authority metrics such as domain rating, referral domains, backlink health and authority indicators.
include_top_websites	boolean	false	Includes top trending websites by industry and country with global ranking insights.
industry_top_websites	string	all	Industry filter for top websites search (e.g. all, accounting-and-auditing, advertising-and-marketing, banking, education).
country_top_websites	string	global	Country filter for top websites search (e.g. global, us, uk, de, fr, jp, br, ru).

Supported URL Formats

Link	Supported
https://blog.apify.com/	✅
https://www.n8n.io	✅
https://make.com	✅
pipedream.com	✅

JSON Input

Sample JSON input if you use the apify api via CURL, Python, JS etc.

{
    "urls": ["https://www.make.com/"],
    "keyword": "ai automation",
    "country": "us",
    "include_overview": true,
    "include_authority": true,
    "include_top_websites": true,
    "industry_top_websites": "all",
    "country_top_websites": "global"
}

Available Search Types

Each run can include up to 10 different search types:

• overview - Basic Domain metrics and stats
• authority - Domain authority metrics
• top_websites - Top 100 trending websites worldwide or in a specific industry and country

❹ Use Cases

• SEO Specialists & Digital Marketers: Gather detailed authority metrics, keyword data, traffic analytics, and backlink insights to refine SEO strategies and outperform competitors.

• Business Intelligence Teams: Analyze website performance trends, market positioning, and competitive landscapes for data-driven decision-making.

• Enterprise SEO Teams: Monitor domain health, backlink evolution, traffic changes, and keyword visibility across multiple websites and markets.

• Competitive Analysts: Track trending domains, industry benchmarks, and global traffic movements to understand digital share of voice.

• Agencies & Consultants: Provide clients with comprehensive SEO audits, authority tracking, and market opportunity assessments.

• Data Scientists & Researchers: Collect large-scale SEO datasets for trend forecasting, correlation analysis, and competitive intelligence modeling.

The Semrush Data Scraper streamlines the collection and analysis of in-depth SEO metrics, delivering enterprise-grade insights for professionals who need complete competitive visibility and data-rich performance tracking.

❺ Usage Limits

This service has different usage limits depending on your subscription status:

User Type	Monthly Runs	# Bulk URLs Supported	Reset Period
Free	3 runs	1 per run	30 days
Paid	Unlimited	Unlimited	N/A

How Limits Work

• Free users: Limited to 3 runs per 30-day period from your first usage
• Paid users: No limits on the number of runs
• All users: Can select any combination of the available search types to them in a single run
• Usage resets automatically 30 days after your first run (for free users)

❻ FAQ

How do i get started?

Getting started is easy! Just click on the "Try for free" button at the top of the page, sign up for an Apify account if you don't have one, and you'll be taken to the Apify Console where you can run the Semrush Scraper Actor. You can input the parameters for your search, select the search types you want to include, and then start the run. Once the run is complete, you can view and download your results directly from the Apify Console.

How long does a run take?

The runtime depends on the number of search types you select and the number of URLs you include in your input. A single search type for a single URL typically takes around 15-30 seconds. If you select multiple search types or include multiple URLs, the runtime will increase accordingly.

What format are the results in?

The results are provided in JSON format, which is easy to read and can be easily integrated into your data analysis workflows. You can also view the output as a csv table. Each search type will have its own section in the output view, containing the relevant metrics and data for that search.

❼ While the scraper is running

During the run, the actor will output log messages letting you know what is going on at any point. Each message always contains specific information about the process including which url / page the actor is working on.

If you provide invalid inputs to the actor, it will immediately stop with a failure state and output log messages explaining what is wrong. If you are unsure what went wrong feel free to open up an issue in the issue tab.

❽ Legality of web scraping

The Semrush Scraper is designed to ethically extract only publicly available job data and company information, and it does not scrape private user data such as personal email addresses or personal identifiers.

Our services are ethical and do not extract any private user data. They only extract what individuals or companies chose to share publicly. We therefore believe that our services, when used for ethical purposes by our users, are safe to use. However, you should be aware that your results could contain personal data. Personal data is protected by the GDPR in the European Union and by other regulations around the world. You should not scrape personal data unless you have a legitimate reason to do so. If you're unsure whether your reason is legitimate, consult your lawyers. For more information you can read this blog post on the legality of web scraping from Apify.

❾ Feedback and Support

Your satisfaction is important to us! Therefore we are constantly striving to enhance the performance of our services.

If you have any technical feedback or encounter any bugs within the Semrush Scraper, please create an issue in the Actor’s Issues tab on the Apify Console to let us know about it. We will look into it as soon as possible.

You can also contact us directly for general help on issues or integrations at suppport@radeance.com.
For custom projects, general suggestions or new use cases feel free to reach out to us at business@radeance.com