KoboldCpp
Single-file local LLM runner for text and storytelling
KoboldCpp is an easy-to-use, single-executable tool for running GGUF language models locally. It is popular for AI writing and roleplay, bundling a UI, an API, and image and speech features.
Key features
- Single-file executable
- Bundled UI and API
- Image and TTS support
- Storytelling features
Strengths
- Released under the AGPL-3.0 license
- Easy to set up — beginner-friendly
- Mature project with 11.8k GitHub stars
- Written in C++
KoboldCpp replaces
Compare KoboldCpp
8 head-to-head comparisons.
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API