Llama Stack
Composable API server for building generative AI applications
Llama Stack from Meta defines and implements a set of standardized APIs for inference, RAG, agents, safety and evaluation, with multiple provider backends. It can be self-hosted as a unified server for building local generative AI applications.
Key features
- Standardized AI APIs
- Pluggable provider backends
- Agents and RAG support
- Self-hostable server
Strengths
- Released under the MIT license
- First-class Docker support for quick deployment
- Mature project with 8.4k GitHub stars
- Written in Python
Llama Stack replaces
Compare Llama Stack
30 head-to-head comparisons.
- Llama Stack vs OpenClaw
- Llama Stack vs Hermes Agent
- Llama Stack vs OpenCode
- Llama Stack vs Ollama
- Llama Stack vs Hugging Face Transformers
- Llama Stack vs Langflow
- Llama Stack vs Dify
- Llama Stack vs llama.cpp
- Llama Stack vs vLLM
- Llama Stack vs PaddleOCR
- Llama Stack vs RAGFlow
- Llama Stack vs OpenHands
- Llama Stack vs screenshot-to-code
- Llama Stack vs GPT4Free
- Llama Stack vs LocalAI
- Llama Stack vs exo
- Llama Stack vs New API
- Llama Stack vs FastChat
- Llama Stack vs One API
- Llama Stack vs SGLang
- Llama Stack vs llamafile
- Llama Stack vs MLC LLM
- Llama Stack vs Guidance
- Llama Stack vs OpenLLM
- Llama Stack vs Text Generation Inference
- Llama Stack vs Petals
- Llama Stack vs Xinference
- Llama Stack vs LMDeploy
- Llama Stack vs MLX LM
- Llama Stack vs GPUStack
Similar self-hosted ai apps
OpenClaw
Self-Hosted AIThe AI that actually does things
Hermes Agent
Self-Hosted AIThe AI agent that grows with you
OpenCode
Self-Hosted AIThe open source AI coding agent
Hugging Face Transformers
Self-Hosted AIState-of-the-art machine learning model library
Replaces OpenAI API
Langflow
Self-Hosted AIVisual framework for building AI agents and RAG pipelines
Replaces Vertex AI Agent Builder
Dify
Self-Hosted AIOpen-source platform for building production LLM apps
Replaces OpenAI Assistants, Vertex AI Agent Builder