KoboldCpp
Single-file local LLM runner for text and storytelling
KoboldCpp is an easy-to-use, single-executable tool for running GGUF language models locally. It is popular for AI writing and roleplay, bundling a UI, an API, and image and speech features.
Key features
- Single-file executable
- Bundled UI and API
- Image and TTS support
- Storytelling features
Strengths
- Released under the AGPL-3.0 license
- Easy to set up — beginner-friendly
- Mature project with 12k GitHub stars
- Written in C++
Is KoboldCpp secure?
OSV.dev has no published security advisories for KoboldCpp's repository. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.
Source: OSV.dev, checked 2026-10-14. How this is measured.
KoboldCpp replaces
Health badge
Maintain KoboldCpp? Add its health score to your README. The badge links back to this page.
Compare KoboldCpp
8 head-to-head comparisons.
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API