Guidance
Constrained generation language for controlling LLMs
Guidance is a programming paradigm from Microsoft for steering language model output with interleaved generation, control flow, and constraints. It can run against locally hosted models to produce reliable structured results.
Key features
- Interleaved generation control
- Token healing
- Regex and grammar constraints
- Works with local models
Strengths
- Released under the MIT license
- Mature project with 21.7k GitHub stars
- Written in Jupyter Notebook
Guidance replaces
Compare Guidance
30 head-to-head comparisons.
- Guidance vs OpenClaw
- Guidance vs Hermes Agent
- Guidance vs OpenCode
- Guidance vs Ollama
- Guidance vs Hugging Face Transformers
- Guidance vs Langflow
- Guidance vs Dify
- Guidance vs llama.cpp
- Guidance vs vLLM
- Guidance vs PaddleOCR
- Guidance vs RAGFlow
- Guidance vs OpenHands
- Guidance vs screenshot-to-code
- Guidance vs GPT4Free
- Guidance vs LocalAI
- Guidance vs exo
- Guidance vs New API
- Guidance vs FastChat
- Guidance vs One API
- Guidance vs SGLang
- Guidance vs llamafile
- Guidance vs MLC LLM
- Guidance vs OpenLLM
- Guidance vs Text Generation Inference
- Guidance vs Petals
- Guidance vs Xinference
- Guidance vs Llama Stack
- Guidance vs LMDeploy
- Guidance vs MLX LM
- Guidance vs GPUStack
Similar self-hosted ai apps
OpenClaw
Self-Hosted AIThe AI that actually does things
Hermes Agent
Self-Hosted AIThe AI agent that grows with you
OpenCode
Self-Hosted AIThe open source AI coding agent
Hugging Face Transformers
Self-Hosted AIState-of-the-art machine learning model library
Replaces OpenAI API
Langflow
Self-Hosted AIVisual framework for building AI agents and RAG pipelines
Replaces Vertex AI Agent Builder
Dify
Self-Hosted AIOpen-source platform for building production LLM apps
Replaces OpenAI Assistants, Vertex AI Agent Builder