# Make Template Analyzer (`scraper_guru/make-template-analyzer`) Actor The first Actor to scrape Make.com's 8,000+ automation templates. Extracts title, description, apps used, and URL from every template. Uses PlaywrightCrawler to bypass Cloudflare and JS rendering. Perfect for market research, competitive analysis, and ML training data. - **URL**: https://apify.com/scraper\_guru/make-template-analyzer.md - **Developed by:** [LIAICHI MUSTAPHA](https://apify.com/scraper_guru) (community) - **Categories:** AI, Developer tools, Agents - **Stats:** 4 total users, 0 monthly users, 100.0% runs succeeded, 1 bookmarks - **User rating**: No ratings yet ## Pricing from $1.50 / 1,000 results This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## 🧩 Make.com Template Analyzer **The first Apify Actor to scrape and analyze Make.com's 8,000+ automation templates** — Unlock the hidden intelligence behind the world's second-largest automation marketplace. [![Apify Actor](https://img.shields.io/badge/Apify-Actor-blue)](https://apify.com) [![Make.com](https://img.shields.io/badge/Make.com-Templates-6D00CC)](https://www.make.com/en/templates) [![PlaywrightCrawler](https://img.shields.io/badge/Engine-PlaywrightCrawler-2EAD33)](https://crawlee.dev) --- ### 🎯 Why This Actor Exists Make.com has **8,000+ automation templates** — a goldmine of market intelligence that nobody is extracting. Until now, this data was locked behind a JavaScript-rendered SPA with Cloudflare protection, making it impossible for simple HTTP scrapers. **This Actor breaks through those barriers** using a real Chromium browser via PlaywrightCrawler to collect every template with its full metadata. #### The Automation War Is Real | Platform | Templates | Public API? | Existing Scrapers? | |----------|-----------|-------------|---------------------| | **n8n** | ~6,000 | ✅ Yes | Many | | **Zapier** | ~7,000 | Partial | Some | | **Make.com** | **8,000+** | ❌ No | **None — until now** | **Make.com is the blind spot.** Competitors analyze n8n and Zapier daily, but Make.com's template library — arguably the richest — has been untouched. --- ### ⚡ What It Does This Actor navigates to Make.com's template library, handles JavaScript rendering and anti-bot measures, paginates through the entire catalog via "Load More" clicks, and extracts structured data from every single template card. #### Data Fields Extracted | Field | Type | Description | |-------|------|-------------| | `title` | String | Template name (e.g., _"Generate ChatGPT Completions from Google Sheets Rows"_) | | `url` | String | Direct link to the template page | | `description` | String | Full description with feature details and use cases | | `apps` | Array | List of apps/services used (e.g., `["Google Sheets", "OpenAI (ChatGPT, Whisper, DALL-E)"]`) | --- ### 💡 Who Is This For? #### 🏢 Automation Consultants & Agencies > _"What are the most popular automation patterns on Make.com?"_ Analyze 8,000+ templates to discover which app combinations clients actually want. Stop guessing — build what the market demands. #### 📊 Market Researchers & Competitive Analysts > _"How does Make.com's template ecosystem compare to n8n and Zapier?"_ Cross-reference with n8n marketplace data (available via our [n8n Marketplace Analyzer](https://console.apify.com/actors/scraper_guru/n8n-marketplace-analyzer)) to spot trends, gaps, and opportunities across the entire automation industry. #### 🤖 AI/ML Engineers > _"I need a training dataset of real-world automation workflows."_ Use 8,000+ structured template records to: - Fine-tune LLMs that recommend automations - Build classification models for app categories - Train NLP models on automation descriptions #### 🚀 SaaS Founders & Product Teams > _"Which integrations should we build next?"_ Discover which apps and combinations appear most frequently in Make.com's templates to prioritize your integration roadmap with real demand data. #### 📝 Content Creators & Educators > _"What Make.com tutorials will get the most views?"_ Find the most popular templates → Create tutorials around proven demand → Grow your audience. --- ### 📂 Output Data #### Sample Output Record ```json { "title": "Generate ChatGPT Completions from Google Sheets Rows", "url": "https://www.make.com/en/templates/10570-create-new-completions-with-openai-chatgpt-from-new-rows-in-google-sheets", "description": "Effortlessly enhance your content creation process by integrating ChatGPT with Google Sheets. This powerful template allows you to automatically generate relevant completions, ranging from SEO keywords to custom responses, boosting productivity and content quality with ease.", "apps": [ "Google Sheets", "OpenAI (ChatGPT, Whisper, DALL-E)" ] } ```` #### What You Can Do With This Data | Use Case | How | |----------|-----| | **App popularity ranking** | Count app appearances across all templates → Top 50 most integrated apps | | **Combination analysis** | Find which app pairs appear together most → "Google Sheets + Slack" = 500 templates | | **Category trends** | Group by description keywords → AI templates grew 300% in 2024 | | **Competitor benchmarking** | Compare against n8n/Zapier data → Make.com leads in CRM integrations | | **Content gap analysis** | Find popular apps with few templates → Opportunity for tutorial content | | **ML training dataset** | 8,000+ labeled automation descriptions → Fine-tune workflow recommendation models | **Download as:** JSON, CSV, or Excel from the Apify Dataset tab. *** ### ⚙️ Input Configuration #### Parameters | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `startUrls` | Array | `["https://www.make.com/en/templates"]` | URLs to start scraping from | | `maxRequestsPerCrawl` | Integer | `100` | Max browser requests (controls pagination depth) | #### Example Inputs ##### Quick Test (first page of templates) ```json { "startUrls": [{ "url": "https://www.make.com/en/templates" }], "maxRequestsPerCrawl": 10 } ``` ##### Category-Specific Scrape (AI templates only) ```json { "startUrls": [{ "url": "https://www.make.com/en/templates?category=ai" }], "maxRequestsPerCrawl": 100 } ``` ##### Deep Scrape (all available templates) ```json { "startUrls": [{ "url": "https://www.make.com/en/templates" }], "maxRequestsPerCrawl": 1000 } ``` #### Available Category Filters You can filter by category using the URL query parameter `?category=`: | Category | URL | |----------|-----| | AI | `https://www.make.com/en/templates?category=ai` | | Marketing | `https://www.make.com/en/templates?category=marketing` | | Sales | `https://www.make.com/en/templates?category=sales` | | CRM | `https://www.make.com/en/templates?category=crm` | | Productivity | `https://www.make.com/en/templates?category=productivity` | | IT & Development | `https://www.make.com/en/templates?category=it-development` | *** ### 🛠️ Technical Details #### Why PlaywrightCrawler? Make.com is **not scrapable** with traditional HTTP request libraries or CheerioCrawler: | Challenge | Status | |-----------|--------| | HTTP fetch → **403 Forbidden** (Cloudflare) | ✅ Solved with real Chromium browser | | Content rendered by JavaScript (SPA) | ✅ Solved with Playwright page evaluation | | "Load More" pagination (no numbered pages) | ✅ Solved with automated button clicks | | Dynamic cookie consent banners | ✅ Auto-dismissed | #### Built With - **Apify SDK** — Actor runtime and dataset management - **Crawlee** — Web scraping framework with built-in retry logic - **PlaywrightCrawler** — Real Chromium browser for JS-heavy sites - **Node.js 22** — Latest LTS runtime #### Enterprise Architecture (V2) Scraping 8,000+ templates from a Single Page Application will normally crash a headless browser due to Out-Of-Memory (OOM) errors. This Actor implements a custom **Batch Extraction & DOM Cleanup** architecture: 1. **Incremental Extraction:** Extracts cards in batches rather than waiting for all 8,000 to load. 2. **DOM Memory Cleanup:** Physically deletes processed template cards from the browser DOM (`element.remove()`) to keep memory usage flat. 3. **Data Safety:** Pushes to the Apify Dataset incrementally. If the run is interrupted, you keep all data extracted up to that point. 4. **Bot Mitigation:** Randomized human-like delays between "Load More" clicks to avoid Cloudflare captchas. #### Performance - **Safely scrapes the entire 8,000+ catalog** without memory crashes. - Increase `maxRequestsPerCrawl` to set your desired limit (e.g., 500, 1000, or 10000 for the full set). - Uses Apify proxy rotation and intelligent timeouts to prevent blocking. *** ### 🤖 API & Automation #### Programmatic Access ##### Node.js ```javascript import { ApifyClient } from 'apify-client'; const client = new ApifyClient({ token: 'YOUR_API_TOKEN' }); const run = await client.actor('scraper_guru/make-template-analyzer').call({ startUrls: [{ url: 'https://www.make.com/en/templates' }], maxRequestsPerCrawl: 100, }); const { items } = await client.dataset(run.defaultDatasetId).listItems(); console.log(`Scraped ${items.length} Make.com templates`); ``` ##### Python ```python from apify_client import ApifyClient client = ApifyClient('YOUR_API_TOKEN') run = client.actor('scraper_guru/make-template-analyzer').call( run_input={ 'startUrls': [{'url': 'https://www.make.com/en/templates'}], 'maxRequestsPerCrawl': 100, } ) dataset = client.dataset(run['defaultDatasetId']).list_items() print(f"Scraped {len(dataset.items)} Make.com templates") ``` ##### cURL ```bash curl -X POST https://api.apify.com/v2/acts/scraper_guru~make-template-analyzer/runs \ -H "Authorization: Bearer YOUR_API_TOKEN" \ -H "Content-Type: application/json" \ -d '{ "startUrls": [{"url": "https://www.make.com/en/templates"}], "maxRequestsPerCrawl": 100 }' ``` #### Integrate With | Platform | Flow | |----------|------| | **n8n** | Schedule → Run Actor → Get Dataset → Analyze in Google Sheets | | **Make.com** | Schedule → Apify Module → Parse JSON → Store in Airtable | | **Zapier** | Schedule → Webhooks → Apify API → Google Sheets | | **Custom** | Cron job → Apify API → PostgreSQL → Dashboard | *** ### 🔮 Roadmap This is **V1 — the scraper foundation**. Upcoming versions will add: - \[ ] **Analytics Engine** — Top apps, category distribution, trend analysis (like the n8n Actor) - \[ ] **Template Detail Scraping** — Navigate into each template for full module count, step details, triggers - \[ ] **ML Training Data Generator** — Alpaca & OpenAI fine-tuning formats - \[ ] **Cross-Platform Intelligence** — Compare Make.com vs n8n vs Zapier ecosystems side-by-side - \[ ] **Scheduled Monitoring** — Track template growth over time *** ### 🤝 Part of the Automation Intelligence Suite This Actor is part of a larger project to map and analyze the entire automation ecosystem: | Actor | Platform | Status | |-------|----------|--------| | [n8n Marketplace Analyzer](https://console.apify.com/actors/scraper_guru/n8n-marketplace-analyzer) | n8n | ✅ Live | | **Make.com Template Analyzer** | Make.com | ✅ **This Actor** | | [Apify Store Analyzer](https://console.apify.com/actors/scraper_guru/apify-store-analyzer) | Apify | ✅ Live | | Zapier Template Analyzer | Zapier | 📋 Planned | **The vision:** A complete, data-driven view of the automation industry — who's building what, where the demand is, and what's trending. *** ### 💬 Support & Contact - 📧 Email: mustaphaliaichi@gmail.com - 💬 GitHub: [github.com/MuLIAICHI](https://github.com/MuLIAICHI) #### Custom Services - 🎨 Custom analysis reports for your niche - 🤖 Fine-tuned AI models for automation recommendation - 🔧 Bespoke scrapers for any platform - 📊 Data visualization and dashboards *** ### 🎓 About the Creator Built by **MuLIAICHI**, an AI Engineer mapping the automation industry: - 🔬 Creator of the [n8n Marketplace Intelligence project](https://console.apify.com/actors/scraper_guru/n8n-marketplace-analyzer) - 🤖 Expertise in web scraping, LLM fine-tuning, and automation analytics - 📚 Active contributor to the n8n and Make.com communities *** ### 📜 License & Terms - **License:** ISC - **Terms:** Follow Apify Terms of Service - **Data:** Public Make.com template data only - **Ethics:** Respects rate limits, uses proxies responsibly *** ### 🚀 Get Started Now 1. **Click "Try for Free"** above 2. **Run with default settings** — takes ~2 minutes 3. **Download your dataset** — JSON, CSV, or Excel 4. **Analyze the data** — Discover what 8,000+ automation builders are creating ```json { "startUrls": [{ "url": "https://www.make.com/en/templates" }], "maxRequestsPerCrawl": 100 } ``` **Nobody else has this data. Now you do.** 🎉 *** **⭐ Star this Actor if you find it useful!** **💬 Questions? Ideas? Reach out anytime!** *** *Last updated: February 2026* *Version: 0.0* *Maintained by: MuLIAICHI (mustaphaliaichi@gmail.com)* # Actor input Schema ## `startUrls` (type: `array`): URLs to start with. ## `maxRequestsPerCrawl` (type: `integer`): Maximum number of requests that can be made by this crawler. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.make.com/en/templates" } ], "maxRequestsPerCrawl": 100 } ``` # Actor output Schema ## `overview` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.make.com/en/templates" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("scraper_guru/make-template-analyzer").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.make.com/en/templates" }] } # Run the Actor and wait for it to finish run = client.actor("scraper_guru/make-template-analyzer").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.make.com/en/templates" } ] }' | apify call scraper_guru/make-template-analyzer --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=scraper_guru/make-template-analyzer", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Make Template Analyzer", "description": "The first Actor to scrape Make.com's 8,000+ automation templates. Extracts title, description, apps used, and URL from every template. Uses PlaywrightCrawler to bypass Cloudflare and JS rendering. Perfect for market research, competitive analysis, and ML training data.", "version": "0.0", "x-build-id": "TcIbzHcTxsg1UwTKB" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/scraper_guru~make-template-analyzer/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-scraper_guru-make-template-analyzer", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/scraper_guru~make-template-analyzer/runs": { "post": { "operationId": "runs-sync-scraper_guru-make-template-analyzer", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/scraper_guru~make-template-analyzer/run-sync": { "post": { "operationId": "run-sync-scraper_guru-make-template-analyzer", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "startUrls": { "title": "Start URLs", "type": "array", "description": "URLs to start with.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "maxRequestsPerCrawl": { "title": "Max Requests per Crawl", "type": "integer", "description": "Maximum number of requests that can be made by this crawler.", "default": 100 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```