LLMKube
Kubernetes operator for llama.cpp-native LLM inference with GPU
Kubernetes operator for llama.cpp-native LLM inference with GPU scheduling, Apple Silicon Metal support, and OpenAI-compatible API.
Strengths
- Released under the Apache-2.0 license
- First-class Docker support for quick deployment
- Kubernetes-ready with Helm charts available
- Written in Go
Is LLMKube secure?
OSV.dev has no published security advisories for LLMKube's repository. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.
Source: OSV.dev, checked 2026-10-14. How this is measured.
Health badge
Maintain LLMKube? Add its health score to your README. The badge links back to this page.
The score is recomputed on every nightly rebuild from public repository data — see how it is calculated.
Similar local llm runners apps
Ollama
Local LLM RunnersRun large language models locally with a simple CLI and API
Replaces ChatGPT, OpenAI API
llama.cpp
Local LLM RunnersHigh-performance LLM inference in plain C/C++
Replaces OpenAI API
vLLM
Local LLM RunnersHigh-throughput LLM serving engine with PagedAttention
Replaces OpenAI API
GPT4All
Local LLM RunnersPrivacy-first desktop chat with local language models
Replaces ChatGPT
LiteLLM
Local LLM RunnersUnified proxy and gateway for 100+ LLM APIs
Replaces OpenRouter
New API
Local LLM RunnersNext-gen LLM gateway and AI asset management system
Replaces OpenRouter, OpenAI API