Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
Best Offline-First Local LLM Runners for self-hosting
The 18 best Offline-First local llm runners you can self-host, ranked by community traction.
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API
Jan
Local LLM RunnersOpen-source offline ChatGPT alternative for the desktop
Replaces ChatGPT
Continue
Local LLM RunnersOpen-source AI code assistant for VS Code and JetBrains
Replaces GitHub Copilot, Cursor
llamafile
Local LLM RunnersDistribute and run LLMs with a single executable file
Replaces OpenAI API, ChatGPT
OpenLLM
Local LLM RunnersRun any open LLM as an OpenAI-compatible API endpoint
Replaces OpenAI API
KoboldCpp
Local LLM RunnersSingle-file local LLM runner for text and storytelling
Replaces ChatGPT
Text Generation Inference
Local LLM RunnersHugging Face toolkit for production LLM serving
Replaces OpenAI API
Page Assist
Local LLM RunnersBrowser extension to use local AI models on the web
Replaces ChatGPT
Enchanted
Local LLM RunnersNative Ollama client for iOS and macOS
Replaces ChatGPT
Serge
Local LLM RunnersSelf-hosted LLaMA chat UI with no API keys needed
Replaces ChatGPT
LM Studio
Local LLM RunnersDesktop app to discover, download, and run local LLMs
Replaces ChatGPT
Harbor LLM Toolkit
Local LLM RunnersContainerized LLM toolkit to run a local AI stack with one CLI
Replaces OpenAI Platform
ik_llama.cpp
Local LLM RunnersPerformance-focused fork of llama.cpp with new quant types
Replaces OpenAI API
Wllama
Local LLM RunnersRun LLM inference directly in the browser with WebAssembly
Replaces OpenAI API
No apps match these filters.
Every option here is open-source and self-hostable, tagged Offline-First within the local llm runners category. Compare them on the individual app pages for setup difficulty and resource requirements.