LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
Best Multi-User Local LLM Runners for self-hosting
The 5 best Multi-User local llm runners you can self-host, ranked by community traction.
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API
FastChat
Local LLM RunnersPlatform for serving and evaluating large language models
Replaces OpenAI API
One API
Local LLM RunnersUnified OpenAI-compatible gateway for many LLM providers
Replaces OpenAI API, OpenRouter
LLMKube
Local LLM RunnersKubernetes operator for llama.cpp-native LLM inference with GPU
No apps match these filters.
At a glance
| App | Deploy effort | Difficulty | Min. RAM | License | ★ Stars |
|---|---|---|---|---|---|
| LiteLLM | Under-an-hour setup | Medium | 1,024 MB | MIT | 61,190 |
| New API | Under-an-hour setup | Medium | 512 MB | MIT | 49,901 |
| FastChat | Under-an-hour setup | Hard | 8,192 MB | Apache-2.0 | 39,549 |
| One API | Under-an-hour setup | Medium | 256 MB | MIT | 37,136 |
| LLMKube | Under-an-hour setup | Medium | 512 MB | Apache-2.0 | 235 |
Quick picks
- Most adopted: LiteLLM (61,190 GitHub stars).
- Lightest footprint: One API (from 256 MB RAM, against 8,192 MB for the heaviest here).
- Licensing: 3 of 5 use MIT; check the rest individually if you plan to modify and redistribute.
Every option here is open-source and self-hostable, tagged Multi-User within the local llm runners category. Deploy effort is graded from published container recipes, not vendor claims — see the methodology.