Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
Local LLM Runners
Self-hosted local large-language-model inference engines and serving frameworks.
28 self-hosted apps · 345 comparisons
All local llm runners apps
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API
Jan
Local LLM RunnersOpen-source offline ChatGPT alternative for the desktop
Replaces ChatGPT
FastChat
Local LLM RunnersPlatform for serving and evaluating large language models
Replaces OpenAI API
One API
Local LLM RunnersUnified OpenAI-compatible gateway for many LLM providers
Replaces OpenAI API, OpenRouter
Continue
Local LLM RunnersOpen-source AI code assistant for VS Code and JetBrains
Replaces GitHub Copilot, Cursor
llamafile
Local LLM RunnersDistribute and run LLMs with a single executable file
Replaces OpenAI API, ChatGPT
MLC LLM
Local LLM RunnersUniversal LLM deployment engine for any hardware
Replaces OpenAI API
OpenLLM
Local LLM RunnersRun any open LLM as an OpenAI-compatible API endpoint
Replaces OpenAI API
KoboldCpp
Local LLM RunnersSingle-file local LLM runner for text and storytelling
Replaces ChatGPT
Text Generation Inference
Local LLM RunnersHugging Face toolkit for production LLM serving
Replaces OpenAI API
Petals
Local LLM RunnersRun large language models collaboratively in a swarm
Replaces OpenAI API
Page Assist
Local LLM RunnersBrowser extension to use local AI models on the web
Replaces ChatGPT
LMDeploy
Local LLM RunnersToolkit for compressing and serving large language models
Replaces OpenAI API, Hugging Face Inference Endpoints
Enchanted
Local LLM RunnersNative Ollama client for iOS and macOS
Replaces ChatGPT
Serge
Local LLM RunnersSelf-hosted LLaMA chat UI with no API keys needed
Replaces ChatGPT
LM Studio
Local LLM RunnersDesktop app to discover, download, and run local LLMs
Replaces ChatGPT
Text Embeddings Inference
Local LLM RunnersFast inference server for text embedding models
Replaces OpenAI Embeddings API
Harbor LLM Toolkit
Local LLM RunnersContainerized LLM toolkit to run a local AI stack with one CLI
Replaces OpenAI Platform
ik_llama.cpp
Local LLM RunnersPerformance-focused fork of llama.cpp with new quant types
Replaces OpenAI API
Aphrodite Engine
Local LLM RunnersHigh-throughput inference engine for large language models
Replaces OpenAI API
Wllama
Local LLM RunnersRun LLM inference directly in the browser with WebAssembly
Replaces OpenAI API
LLMKube
Local LLM RunnersKubernetes operator for llama.cpp-native LLM inference with GPU
No apps match these filters.
Curated picks
Easiest Local LLM Runners to self-hostBest API Local LLM RunnersBest Cross-Platform Local LLM RunnersBest Docker Local LLM RunnersBest Free Local LLM RunnersBest Kubernetes Local LLM RunnersBest Lightweight Local LLM RunnersBest Multi-User Local LLM RunnersBest No-Database Local LLM RunnersBest Offline-First Local LLM RunnersBest Single-User Local LLM Runners
Local LLM Runners comparisons
345 head-to-head comparisons in this category.
- Aphrodite Engine vs Continue
- Aphrodite Engine vs Enchanted
- Aphrodite Engine vs exo
- Aphrodite Engine vs FastChat
- Aphrodite Engine vs GPT4All
- Aphrodite Engine vs Harbor LLM Toolkit
- Aphrodite Engine vs ik_llama.cpp
- Aphrodite Engine vs Jan
- Aphrodite Engine vs KoboldCpp
- Aphrodite Engine vs LiteLLM
- Aphrodite Engine vs llama.cpp
- Aphrodite Engine vs llamafile
- Aphrodite Engine vs LM Studio
- Aphrodite Engine vs LMDeploy
- Aphrodite Engine vs MLC LLM
- Aphrodite Engine vs New API
- Aphrodite Engine vs Ollama
- Aphrodite Engine vs One API
- Aphrodite Engine vs OpenLLM
- Aphrodite Engine vs Page Assist
- Aphrodite Engine vs Petals
- Aphrodite Engine vs Serge
- Aphrodite Engine vs Text Embeddings Inference
- Aphrodite Engine vs Text Generation Inference
- Aphrodite Engine vs vLLM
- Continue vs Enchanted
- Continue vs exo
- Continue vs FastChat
- Continue vs GPT4All
- Continue vs Harbor LLM Toolkit
- Continue vs ik_llama.cpp
- Continue vs Jan
- Continue vs KoboldCpp
- Continue vs LiteLLM
- Continue vs llama.cpp
- Continue vs llamafile
- Continue vs LM Studio
- Continue vs LMDeploy
- Continue vs MLC LLM
- Continue vs New API
- Continue vs Ollama
- Continue vs One API
- Continue vs OpenLLM
- Continue vs Page Assist
- Continue vs Petals
- Continue vs Serge
- Continue vs Text Embeddings Inference
- Continue vs Text Generation Inference
- Continue vs vLLM
- Enchanted vs exo
- Enchanted vs FastChat
- Enchanted vs GPT4All
- Enchanted vs Harbor LLM Toolkit
- Enchanted vs ik_llama.cpp
- Enchanted vs Jan
- Enchanted vs KoboldCpp
- Enchanted vs LiteLLM
- Enchanted vs llama.cpp
- Enchanted vs llamafile
- Enchanted vs LM Studio
- Enchanted vs LMDeploy
- Enchanted vs MLC LLM
- Enchanted vs New API
- Enchanted vs Ollama
- Enchanted vs One API
- Enchanted vs OpenLLM
- Enchanted vs Page Assist
- Enchanted vs Petals
- Enchanted vs Serge
- Enchanted vs Text Embeddings Inference
- Enchanted vs Text Generation Inference
- Enchanted vs vLLM
- exo vs FastChat
- exo vs GPT4All
- exo vs Harbor LLM Toolkit
- exo vs ik_llama.cpp
- exo vs Jan
- exo vs KoboldCpp
- exo vs LiteLLM
- exo vs llama.cpp
- exo vs llamafile
- exo vs LLMKube
- exo vs LM Studio
- exo vs LMDeploy
- exo vs MLC LLM
- exo vs New API
- exo vs Ollama
- exo vs One API
- exo vs OpenLLM
- exo vs Page Assist
- exo vs Petals
- exo vs Serge
- exo vs Text Embeddings Inference
- exo vs Text Generation Inference
- exo vs vLLM
- exo vs Wllama
- FastChat vs GPT4All
- FastChat vs Harbor LLM Toolkit
- FastChat vs ik_llama.cpp
- FastChat vs Jan
- FastChat vs KoboldCpp
- FastChat vs LiteLLM
- FastChat vs llama.cpp
- FastChat vs llamafile
- FastChat vs LLMKube
- FastChat vs LM Studio
- FastChat vs LMDeploy
- FastChat vs MLC LLM
- FastChat vs New API
- FastChat vs Ollama
- FastChat vs One API
- FastChat vs OpenLLM
- FastChat vs Page Assist
- FastChat vs Petals
- FastChat vs Serge
- FastChat vs Text Embeddings Inference
- FastChat vs Text Generation Inference
- FastChat vs vLLM
- FastChat vs Wllama
- GPT4All vs Harbor LLM Toolkit