LL

LlamaGPT

Self-hosted offline ChatGPT-like chatbot powered by Llama

Self-Hosted AI ★ 10.9k stars Easy setup MIT

LlamaGPT is a self-hosted, offline chatbot that runs Llama-family models with a ChatGPT-style interface. It works fully on your own hardware with no data leaving your machine and integrates with home server platforms.

Key features

  • Fully offline operation
  • ChatGPT-style UI
  • Multiple model sizes
  • Umbrel one-click install

Pros & cons

Strengths

  • Complete privacy
  • Simple Docker setup

Trade-offs

  • Needs significant RAM
  • No GPU acceleration on some setups

LlamaGPT replaces

Compare LlamaGPT

31 head-to-head comparisons.

Similar self-hosted ai apps