SHSelfHostIndex

Best API Local LLM Runners for self-hosting

The 21 best API local llm runners you can self-host, ranked by community traction.

At a glance

AppDeploy effortDifficultyMin. RAMLicense★ Stars
Ollama≈5-minute setupEasy8,192 MBMIT183,072
llama.cppUnder-an-hour setupHard8,192 MBMIT131,102
vLLMUnder-an-hour setupHard16,384 MBApache-2.093,739
LiteLLMUnder-an-hour setupMedium1,024 MBMIT61,190
New APIUnder-an-hour setupMedium512 MBMIT49,901
exoRead-the-docs projectMedium8,192 MBGPL-3.047,870
JanRead-the-docs projectEasy8,192 MBAGPL-3.044,941
FastChatUnder-an-hour setupHard8,192 MBApache-2.039,549
One APIUnder-an-hour setupMedium256 MBMIT37,136
ContinueRead-the-docs projectEasy1,024 MBApache-2.036,219

Quick picks

Every option here is open-source and self-hostable, tagged API within the local llm runners category. Deploy effort is graded from published container recipes, not vendor claims — see the methodology.

Keep exploring

All Local LLM RunnersEasiest Local LLM Runners to self-hostHow to choose LLM runner: the Local LLM Runners buyer's guide

Head-to-head: API local llm runners