Langfuse
Self-Hosted AIOpen-source observability and analytics for LLM apps
Replaces LangSmith
Best Kubernetes Self-Hosted AI for self-hosting
The 8 best Kubernetes self-hosted ai you can self-host, ranked by community traction.
SGLang
Self-Hosted AIFast serving framework for LLMs and vision-language models
Replaces OpenAI API
Triton Inference Server
Self-Hosted AIHigh-performance inference serving for any model framework
Replaces Amazon SageMaker
Xinference
Self-Hosted AIDistributed inference framework for LLMs and embeddings
Replaces OpenAI API, Hugging Face Inference Endpoints
BentoML
Self-Hosted AIFramework for building and serving AI model APIs
Replaces Amazon SageMaker, Vertex AI
GPUStack
Self-Hosted AIManage GPU clusters for running AI models
Replaces OpenAI API
RamaLama
Self-Hosted AIRun AI models using OCI containers
Replaces Ollama
BionicGPT
Self-Hosted AIOn-premise generative AI platform for teams
Replaces ChatGPT Enterprise
No apps match these filters.
Every option here is open-source and self-hostable, tagged Kubernetes within the self-hosted ai category. Compare them on the individual app pages for setup difficulty and resource requirements.