Serge
Self-hosted LLaMA chat UI with no API keys needed
This project is archived. Upstream development has stopped, so expect no new features or security fixes. Consider an actively maintained local llm runners alternative.
Serge is a self-hosted chat interface for running LLaMA-family models entirely offline. It bundles llama.cpp with a clean web UI and requires no remote APIs or accounts.
Key features
- No API keys required
- Bundled llama.cpp
- Simple Docker deploy
- Fully offline
Strengths
- Released under the Apache-2.0 license
- Easy to set up — beginner-friendly
- First-class Docker support for quick deployment
- Mature project with 5.7k GitHub stars
Is Serge secure?
OSV.dev has no published security advisories for Serge's repository. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.
Source: OSV.dev, checked 2026-10-14. How this is measured.
Serge replaces
Health badge
Maintain Serge? Add its health score to your README. The badge links back to this page.
Compare Serge
8 head-to-head comparisons.
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API