Databricks MCP Server

A Model Context Protocol (MCP) server that connects to Databricks API, allowing LLMs to run SQL queries, list jobs, and get job status.

Features

• Run SQL queries on Databricks SQL warehouses

• List all Databricks jobs

• Get status of specific Databricks jobs

• Get detailed information about Databricks jobs

Related MCP server: Alibaba Cloud DMS MCP Server

Prerequisites

• Python 3.7+

• Databricks workspace with:

  • Personal access token

  • SQL warehouse endpoint

  • Permissions to run queries and access jobs

Setup

1. Clone this repository

2. Create and activate a virtual environment (recommended):

   python -m venv .venv
   source .venv/bin/activate  # On Windows: .venv\Scripts\activate

3. Install dependencies:

   pip install -r requirements.txt

4. Create a .env file in the root directory with the following variables:

   DATABRICKS_HOST=your-databricks-instance.cloud.databricks.com
   DATABRICKS_TOKEN=your-personal-access-token
   DATABRICKS_HTTP_PATH=/sql/1.0/warehouses/your-warehouse-id

5. Test your connection (optional but recommended):

   python test_connection.py

Obtaining Databricks Credentials

1. Host: Your Databricks instance URL (e.g., your-instance.cloud.databricks.com)

2. Token: Create a personal access token in Databricks:

   • Go to User Settings (click your username in the top right)

   • Select "Developer" tab

   • Click "Manage" under "Access tokens"

   • Generate a new token, and save it immediately

3. HTTP Path: For your SQL warehouse:

   • Go to SQL Warehouses in Databricks

   • Select your warehouse

   • Find the connection details and copy the HTTP Path

Running the Server

Start the MCP server:

python main.py

You can test the MCP server using the inspector by running

npx @modelcontextprotocol/inspector python3 main.py

Available MCP Tools

The following MCP tools are available:

1. run_sql_query(sql: str) - Execute SQL queries on your Databricks SQL warehouse

2. list_jobs() - List all Databricks jobs in your workspace

3. get_job_status(job_id: int) - Get the status of a specific Databricks job by ID

4. get_job_details(job_id: int) - Get detailed information about a specific Databricks job

Example Usage with LLMs

When used with LLMs that support the MCP protocol, this server enables natural language interaction with your Databricks environment:

• "Show me all tables in the database"

• "Run a query to count records in the customer table"

• "List all my Databricks jobs"

• "Check the status of job #123"

• "Show me details about job #456"

Troubleshooting

Connection Issues

• Ensure your Databricks host is correct and doesn't include https:// prefix

• Check that your SQL warehouse is running and accessible

• Verify your personal access token has the necessary permissions

• Run the included test script: python test_connection.py

Security Considerations

• Your Databricks personal access token provides direct access to your workspace

• Secure your .env file and never commit it to version control

• Consider using Databricks token with appropriate permission scopes only

• Run this server in a secure environment