MLX LM
Run and fine-tune LLMs locally on Apple Silicon with MLX
MLX LM is a Python package from Apple's MLX project for running and fine-tuning large language models efficiently on Apple Silicon. It provides a command-line interface and HTTP server for local text generation entirely on-device.
Key features
- Native Apple Silicon inference
- LoRA fine-tuning
- OpenAI-compatible server
- Model quantization
Strengths
- Released under the MIT license
- Mature project with 6.5k GitHub stars
- Written in Python
MLX LM replaces
Compare MLX LM
30 head-to-head comparisons.
- MLX LM vs OpenClaw
- MLX LM vs Hermes Agent
- MLX LM vs OpenCode
- MLX LM vs Ollama
- MLX LM vs Hugging Face Transformers
- MLX LM vs Langflow
- MLX LM vs Dify
- MLX LM vs llama.cpp
- MLX LM vs vLLM
- MLX LM vs PaddleOCR
- MLX LM vs RAGFlow
- MLX LM vs OpenHands
- MLX LM vs screenshot-to-code
- MLX LM vs GPT4Free
- MLX LM vs LocalAI
- MLX LM vs exo
- MLX LM vs New API
- MLX LM vs FastChat
- MLX LM vs One API
- MLX LM vs SGLang
- MLX LM vs llamafile
- MLX LM vs MLC LLM
- MLX LM vs Guidance
- MLX LM vs OpenLLM
- MLX LM vs Text Generation Inference
- MLX LM vs Petals
- MLX LM vs Xinference
- MLX LM vs Llama Stack
- MLX LM vs LMDeploy
- MLX LM vs GPUStack
Similar self-hosted ai apps
OpenClaw
Self-Hosted AIThe AI that actually does things
Hermes Agent
Self-Hosted AIThe AI agent that grows with you
OpenCode
Self-Hosted AIThe open source AI coding agent
Hugging Face Transformers
Self-Hosted AIState-of-the-art machine learning model library
Replaces OpenAI API
Langflow
Self-Hosted AIVisual framework for building AI agents and RAG pipelines
Replaces Vertex AI Agent Builder
Dify
Self-Hosted AIOpen-source platform for building production LLM apps
Replaces OpenAI Assistants, Vertex AI Agent Builder