Search Intelligence & AI Visibility Scraper

The Search Intelligence & AI Visibility Scraper is a premium, all-in-one data collection tool that gathers search results, paid ads, shopping products, and AI answers from Google and leading AI search engines.

With this scraper, you can keep track of how your brand ranks in organic search, monitor competitor ads, see how AI assistants describe your business, and instantly find contact details for potential B2B leads.

---

What can you do with this Scraper?

• 🌱 Track Search Performance: Collect organic search rankings, titles, description text, and suggested sitelinks.
• 🛍 Monitor Ads & Products: Capture paid text ads and shopping carousel products (including prices, merchant names, and ratings).
• 🙋‍♀️ Extract Questions & Recommendations: Save People Also Ask (PAA) accordion questions and Google's related search suggestions.
• 🤖 Audit AI Search Engines (AEO/GEO): Retrieve and compare AI-generated answers side-by-side across Google AI Mode, ChatGPT Search, Gemini, Copilot, and Perplexity.
• 🎯 Generate Contact Leads: Discover business domains, automatically filter out directories, and extract professional contacts (full name, job title, email, phone, and LinkedIn).
• ✅ Verify Emails: Check if discovered emails are valid and deliverable, preventing bounces.
• 📊 Multi-Format Export: Download your data as JSON, CSV, Excel, or HTML for easy integration into spreadsheets, CRM platforms, or automation tools like Make/Zapier.

---

What data can you extract?

🌱 Organic Search Listings	🛍 Paid Text Ads
🤖 Google AI Overviews & AI Mode	📢 Shopping Product Ads
❓ Related Search Queries	🙋‍♀️ People Also Ask Accordions
🎯 Business Contact Leads	⭐️ Review Ratings & Price Snippets
🔍 Custom Page Attributes	✅ Email Deliverability Verification

---

Deep Dive: AI & Lead Generation Add-Ons

🤖 Google AI Overviews & AI Mode

Extracts Google's native generative response panels and source citations. Track how your brand appears when users switch to Google's AI-assisted search experience.

💬 ChatGPT Search

Fetches answers using OpenAI's search engine. Allows you to check how ChatGPT answers user queries about your industry, complete with the list of websites it cited.

⏩ Gemini & Copilot Search

Retrieves answers from Google Gemini and Microsoft Copilot. Compare how different AI platforms summarize your products or services, and see which reference links they display.

🧠 Perplexity AI Search

Queries the Perplexity engine to see how it answers search questions, making it easy to identify visibility gaps across multiple AI search assistants.

👥 Business Lead Enrichment & Email Check

This feature looks up business contact information for the domains found in search results. When enabled, it appends:

• Full Name & Job Title
• Work Email Address & Phone Number
• LinkedIn Profile URL

If Email Verification is active, the scraper validates email deliverability, marking them clearly so you don't waste time on dead leads:

• ok – Valid, deliverable email address.
• invalid – Non-existent email mailbox.
• disposable – Temporary or fake email address.

---

How to use the Scraper

You don't need any coding experience to use this scraper. Just follow these simple steps:

1. Create a free account on Apify.
2. Open the Search Intelligence & AI Visibility Scraper page.
3. Configure your search: Type in your keywords (one per line) or paste raw Google Search URLs.
4. Choose your target: Select a country, language, device (desktop or mobile), or a specific city location.
5. Select features: Toggle paid ads, AI comparisons, or lead enrichment as needed.
6. Click the Start button. Once completed, download your data in Excel, CSV, or JSON format.

---

Pricing Model (Pay Per Event)

This scraper uses a simple Pay-Per-Event (PPE) pricing model. Instead of paying for computer running time, you only pay for the exact data milestones you successfully retrieve:

Event	Description
serp-page	Per successfully crawled and parsed Google Search results page.
ai-answer	Per AI search answer collected from a provider (ChatGPT, Gemini, etc.).
lead-enrichment	Per enriched business domain contact listing.
email-verification	Per verified email address deliverability check outcome.

---

Input Example

Here is an example input configuration in JSON format:

{
  "queries": "best crm software\ncrm for small business",
  "countryCode": "us",
  "languageCode": "en",
  "device": "desktop",
  "maxPagesPerQuery": 1,
  "includeOrganicResults": true,
  "includePaidResults": true,
  "includeAiOverview": true,
  "aiProviders": ["chatgpt", "perplexity", "gemini"],
  "trackedEntities": ["HubSpot", "Salesforce", "Pipedrive"],
  "leadEnrichment": {
    "enabled": true,
    "maxLeadsPerDomain": 3,
    "verifyEmails": true
  }
}

---

Output Views

Your data is stored in a clean dataset. The Apify Console will organize the output into five convenient tabular tabs:

1. Organic & Paid Rows (serp_result): A simple, unified list of standard search and ad rankings.
2. Page Snapshots (serp_page): High-level page metadata and complete page layout blocks.
3. AI Answers (ai_answer / ai_comparison): Brand mentions, sentiment analysis, and cited source URLs.
4. Business Leads (lead): Verified professional contacts and company info.
5. Errors (error): Debugging logs if a request got blocked or failed.