GPUStack
Manage GPU clusters for running AI models
GPUStack is an open-source platform for running and scaling AI models across heterogeneous GPU clusters. It supports LLMs, embeddings, image, and audio models with an OpenAI-compatible API and a management dashboard.
Key features
- Distributed GPU scheduling
- OpenAI-compatible API
- Many model types
- Cluster dashboard
Strengths
- Released under the Apache-2.0 license
- First-class Docker support for quick deployment
- Kubernetes-ready with Helm charts available
- Mature project with 5.5k GitHub stars
GPUStack replaces
Compare GPUStack
30 head-to-head comparisons.
- GPUStack vs OpenClaw
- GPUStack vs Hermes Agent
- GPUStack vs OpenCode
- GPUStack vs Ollama
- GPUStack vs Hugging Face Transformers
- GPUStack vs Langflow
- GPUStack vs Dify
- GPUStack vs llama.cpp
- GPUStack vs vLLM
- GPUStack vs PaddleOCR
- GPUStack vs RAGFlow
- GPUStack vs OpenHands
- GPUStack vs screenshot-to-code
- GPUStack vs GPT4Free
- GPUStack vs LocalAI
- GPUStack vs exo
- GPUStack vs New API
- GPUStack vs FastChat
- GPUStack vs One API
- GPUStack vs SGLang
- GPUStack vs llamafile
- GPUStack vs MLC LLM
- GPUStack vs Guidance
- GPUStack vs OpenLLM
- GPUStack vs Text Generation Inference
- GPUStack vs Petals
- GPUStack vs Xinference
- GPUStack vs Llama Stack
- GPUStack vs LMDeploy
- GPUStack vs MLX LM
Similar self-hosted ai apps
OpenClaw
Self-Hosted AIThe AI that actually does things
Hermes Agent
Self-Hosted AIThe AI agent that grows with you
OpenCode
Self-Hosted AIThe open source AI coding agent
Hugging Face Transformers
Self-Hosted AIState-of-the-art machine learning model library
Replaces OpenAI API
Langflow
Self-Hosted AIVisual framework for building AI agents and RAG pipelines
Replaces Vertex AI Agent Builder
Dify
Self-Hosted AIOpen-source platform for building production LLM apps
Replaces OpenAI Assistants, Vertex AI Agent Builder