mlx-lm

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.

A native UI for Apple Containers and (o)MLX sandboxes, written in swift as a replacement for docker desktop

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

AI Copilot for Vim/NeoVim

A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

Spark-x2.5 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

Practical guide to running LLMs locally on Apple Silicon, with a focus on architecture, memory scaling, and agent workflows.

macMLX brings local LLM inference to Apple Silicon with a first-class native macOS experience. No cloud, no telemetry, no Electron — just your Mac running models at full speed.

Build an Autonomous Web3 AI Trading Agent (BASE + Uniswap V4 example)

Git-Native Coding Agent for Mac

Experimental: MLX model provider for Strands Agents - Build, train, and deploy AI agents on Apple Silicon.

Run models too big for RAM on Apple Silicon — any Hugging Face model, dense or MoE — by streaming weights from disk

Local inference server for Apple Silicon — hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI API

Mispher turns speech into clean text anywhere on macOS, then goes further - dictation cleanup, rewrite-in-place, translation, and an on-device agent that plans, uses tools, and answers. No cloud, no accounts. Nothing leaves your Mac.

Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

Reinforcement learning for text generation on MLX (Apple Silicon)

Defensive layer for mlx / mlx-lm / mlx-vlm on Apple Silicon. Prevents IOGPUFamily kernel panics, SIGABRT, and Mac reboots from MLX inference. Includes a community-curated registry of known-panic models (KNOWN_PANIC_MODELS) with hardware contexts, root-cause hypotheses, and verified workarounds.

Local AI for Apple Silicon. Chat with open LLMs (Qwen, Gemma, DeepSeek, Mistral, Llama…) fully offline on your Mac via Apple MLX — private by design, zero telemetry.

An all-in-one LLMs chat Web UI based on the MLX framework, designed for Apple Silicon.