Skip to main content
Glama
JMRussas

Ollama MCP Server

by JMRussas
OverviewSchemaRelated ServersScoreDiscussions
Python
Local

ollama-mcp

An MCP (Model Context Protocol) server that exposes local Ollama instances as tools for Claude Code.

Lets Claude offload code generation, drafts, embeddings, and quick questions to your local GPUs.

Setup

  1. Run the setup script:

    bash setup.sh

    This creates a venv, installs dependencies, generates a machine-specific config.json, and registers the MCP server with Claude Code.

    Note: setup.sh uses cygpath and targets Windows (Git Bash / MSYS2). On Linux/macOS, replace the cygpath -w calls with the paths directly, or register manually:

    claude mcp add ollama -s user -- /path/to/.venv/bin/python /path/to/src/ollama_mcp/server.py

  2. Restart Claude Code.

Related MCP server: Ollama MCP Server

Tools

Tool

Description

ollama_generate

Single-turn prompt → response

ollama_chat

Multi-turn conversation

ollama_embed

Generate embedding vectors

ollama_list_models

List models on your Ollama instances

Configuration

Copy config.example.json to config.json and fill in your machine details, or let setup.sh generate it interactively.

Requirements

  • Python 3.10+

  • Ollama 0.4.0+ running on at least one machine

  • Claude Code with MCP support

Development

pip install -e ".[dev]"
pytest tests/ -v

About

Extracted from a private developer infrastructure repo and published as a standalone tool. This server runs daily as part of a multi-project AI development workflow spanning game engines, RAG pipelines, and task orchestration — see mcp-rag and orchestration-engine for projects that use it.

Troubleshooting

Problem

Cause

Fix

config.json not found

Setup not run

Run bash setup.sh

404 on embed calls

Ollama < 0.4.0

Upgrade Ollama (ollama update)

Cannot connect to...

Ollama not running on target host

Start Ollama: ollama serve or check Docker

Request timed out

Large model / slow hardware

Increase timeout in config.json, or pass timeout parameter

OFFLINE in list_models

Host unreachable

Check network, firewall, Ollama port 11434

cygpath: command not found

Running setup.sh on Linux/macOS

See setup note above

License

MIT

This server cannot be installed

A
license - permissive license
-
quality - not tested
D
maintenance

How are these scores calculated?

Maintenance

–Maintainers
–Response time
–Release cycle
–Releases (12mo)
Commit activity

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Related MCP Servers

  • Llama 4 Maverick MCP Server

    YobieBen
    A
    license
    -
    quality
    D
    maintenance
    Bridges Llama models with Claude Desktop through Ollama, enabling privacy-first local AI operations with 10+ built-in tools for file operations, web search, calculations, and custom model deployment. Features streaming support, hybrid intelligence workflows, and extensive Python ecosystem integration for research, development, and enterprise applications.
    Last updated
    MIT

  • Ollama MCP Server

    etnlbck
    A
    license
    -
    quality
    C
    maintenance
    Enables interaction with locally running Ollama models through chat, generation, and model management operations. Supports listing, downloading, and deleting models while maintaining conversation history for interactive sessions.
    Last updated
    682
    MIT

  • Ollama MCP Server

    Jadael
    A
    license
    -
    quality
    D
    maintenance
    Enables Claude to delegate coding tasks to local Ollama models, reducing API token usage by up to 98.75% while leveraging local compute resources. Supports code generation, review, refactoring, and file analysis with Claude providing oversight and quality assurance.
    Last updated
    682
    19
    AGPL 3.0

  • Ollama MCP Server

    ngc-shj
    A
    license
    -
    quality
    D
    maintenance
    A bridge that enables Claude Code to interact with local Ollama instances for text generation, multi-turn chat, and vision-based analysis. It supports model management tasks such as listing, pulling, and showing details, alongside generating text embeddings.
    Last updated
    682
    MIT

View all related MCP servers

Related MCP Connectors

  • hithereiamaliff-mcp-nextcloud

    A comprehensive Model Context Protocol (MCP) server that enables AI assistants to interact with yo…

  • AgentSEO

    Live SEO workflow tools for Claude Code, Codex, and AI agents.

  • RogerRat

    Real-time chat hub for AI agents — Claude Code, Cursor, Cline, Codex over MCP or REST.

View all MCP Connectors

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/JMRussas/ollama-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server