
Morse
AI Chatbot
Private AI chat with GPT, Claude, Gemini, DeepSeek, and uncensored models, encrypted so even Morse can't read your chats.
AI Developer Tools
Native macOS server for fast local AI model inference

Explore other tools in related categories.

AI Chatbot
Private AI chat with GPT, Claude, Gemini, DeepSeek, and uncensored models, encrypted so even Morse can't read your chats.

AI Developer Tools
Affordable CI runners and persistent cloud computers for AI agents

AI For Finance
Financial data platform with spreadsheets, API, AI connectors, and SQL access
Omlx AI is a native macOS inference server built on MLX, designed to run large language models locally on Apple Silicon. It features paged SSD KV caching, which dramatically reduces time-to-first-token (TTFT) for coding agents, dropping it from 30-90 seconds to under 5 seconds. It provides OpenAI and Anthropic compatible APIs, making it a drop-in backend for tools like Claude Code, OpenClaw, and Cursor.
git clone https://github.com/jundot/omlx && cd omlx && pip install -e ..omlx serve --model-dir ~/models from the terminal.Omlx AI is open source under the Apache 2.0 license, and the DMG is available for free download from GitHub.
How is oMLX different from Ollama or LM Studio?
Ollama and LM Studio cache KV state in memory, which gets invalidated when context shifts, causing recomputation. oMLX persists every KV cache block to SSD, so previously cached portions are always recoverable, reducing TTFT from 30-90 seconds to under 5 seconds.
What hardware do I need?
Apple Silicon (M1 or later) with macOS 15+. 16GB RAM is the minimum, but 64GB+ is recommended for larger models.
Does it work with Claude Code, OpenClaw, and Cursor?
Yes, it provides both OpenAI-compatible and Anthropic-compatible endpoints, and works as a drop-in backend for all three.
Do I need to re-download my models?
No, it reads the standard Hugging Face cache and LM Studio folder, so existing models are recognized without re-download.
What models are supported?
Any MLX-format model from HuggingFace, including Qwen, LLaMA, Mistral, Gemma, DeepSeek, MiniMax, GLM, and more. Vision-Language Models are supported since v0.2.0.