Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
Best Cross-Platform Local LLM Runners for self-hosting
The 13 best Cross-Platform local llm runners you can self-host, ranked by community traction.
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
exo
Local LLM RunnersRun your own AI cluster across everyday devices
Replaces OpenAI API
Jan
Local LLM RunnersOpen-source offline ChatGPT alternative for the desktop
Replaces ChatGPT
Continue
Local LLM RunnersOpen-source AI code assistant for VS Code and JetBrains
Replaces GitHub Copilot, Cursor
llamafile
Local LLM RunnersDistribute and run LLMs with a single executable file
Replaces OpenAI API, ChatGPT
MLC LLM
Local LLM RunnersUniversal LLM deployment engine for any hardware
Replaces OpenAI API
KoboldCpp
Local LLM RunnersSingle-file local LLM runner for text and storytelling
Replaces ChatGPT
Page Assist
Local LLM RunnersBrowser extension to use local AI models on the web
Replaces ChatGPT
LM Studio
Local LLM RunnersDesktop app to discover, download, and run local LLMs
Replaces ChatGPT
Harbor LLM Toolkit
Local LLM RunnersContainerized LLM toolkit to run a local AI stack with one CLI
Replaces OpenAI Platform
No apps match these filters.
Every option here is open-source and self-hostable, tagged Cross-Platform within the local llm runners category. Compare them on the individual app pages for setup difficulty and resource requirements.