Serge
Self-hosted LLaMA chat UI with no API keys needed
This project is archived. Upstream development has stopped, so expect no new features or security fixes. Consider an actively maintained local llm runners alternative.
Serge is a self-hosted chat interface for running LLaMA-family models entirely offline. It bundles llama.cpp with a clean web UI and requires no remote APIs or accounts.
Key features
- No API keys required
- Bundled llama.cpp
- Simple Docker deploy
- Fully offline
Strengths
- Released under the Apache-2.0 license
- Easy to set up — beginner-friendly
- First-class Docker support for quick deployment
- Mature project with 5.7k GitHub stars
Serge replaces
Compare Serge
8 head-to-head comparisons.
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API