Llama Stack
Composable API server for building generative AI applications
Llama Stack from Meta defines and implements a set of standardized APIs for inference, RAG, agents, safety and evaluation, with multiple provider backends. It can be self-hosted as a unified server for building local generative AI applications.
Key features
- Standardized AI APIs
- Pluggable provider backends
- Agents and RAG support
- Self-hostable server
Strengths
- Released under the MIT license
- First-class Docker support for quick deployment
- Mature project with 8.4k GitHub stars
- Written in Python
Llama Stack replaces
Compare Llama Stack
10 head-to-head comparisons.
Similar self-hosted ai apps
OpenClaw
Self-Hosted AIThe AI that actually does things
Hermes Agent
Self-Hosted AIThe AI agent that grows with you
OpenCode
Self-Hosted AIThe open source AI coding agent
Replaces Claude Code, Cursor
Hugging Face Transformers
Self-Hosted AIState-of-the-art machine learning model library
Replaces OpenAI API
Dify
Self-Hosted AIOpen-source platform for building production LLM apps
Replaces OpenAI Assistants, Vertex AI Agent Builder
Langflow
Self-Hosted AIVisual framework for building AI agents and RAG pipelines
Replaces Vertex AI Agent Builder