SHSelfHostIndex

Best Offline-First Local LLM Runners for self-hosting

The 16 best Offline-First local llm runners you can self-host, ranked by community traction.

At a glance

AppDeploy effortDifficultyMin. RAMLicense★ Stars
Ollama≈5-minute setupEasy8,192 MBMIT183,072
llama.cppUnder-an-hour setupHard8,192 MBMIT131,102
vLLMUnder-an-hour setupHard16,384 MBApache-2.093,739
GPT4AllRead-the-docs projectEasy8,192 MBMIT77,370
exoRead-the-docs projectMedium8,192 MBGPL-3.047,870
JanRead-the-docs projectEasy8,192 MBAGPL-3.044,941
ContinueRead-the-docs projectEasy1,024 MBApache-2.036,219
llamafileRead-the-docs projectEasy8,192 MBApache-2.026,232
OpenLLMUnder-an-hour setupMedium8,192 MBApache-2.012,558
KoboldCppRead-the-docs projectEasy8,192 MBAGPL-3.011,993

Quick picks

Every option here is open-source and self-hostable, tagged Offline-First within the local llm runners category. Deploy effort is graded from published container recipes, not vendor claims — see the methodology.

Keep exploring

All Local LLM RunnersEasiest Local LLM Runners to self-hostHow to choose LLM runner: the Local LLM Runners buyer's guide

Head-to-head: Offline-First local llm runners