OpenLLMetry
Open-source observability for LLM applications
OpenLLMetry is a set of OpenTelemetry extensions from Traceloop that add observability to LLM applications. It instruments calls to model providers and vector databases so traces and metrics can be sent to any self-hosted backend.
Key features
- OpenTelemetry-based tracing
- Instruments popular LLM SDKs
- Vendor-neutral export
- Vector database instrumentation
Strengths
- Released under the Apache-2.0 license
- First-class Docker support for quick deployment
- Mature project with 7.4k GitHub stars
- Written in Python
OpenLLMetry replaces
Compare OpenLLMetry
18 head-to-head comparisons.
- OpenLLMetry vs OpenClaw
- OpenLLMetry vs Hermes Agent
- OpenLLMetry vs OpenCode
- OpenLLMetry vs Hugging Face Transformers
- OpenLLMetry vs Langflow
- OpenLLMetry vs Dify
- OpenLLMetry vs PaddleOCR
- OpenLLMetry vs RAGFlow
- OpenLLMetry vs OpenHands
- OpenLLMetry vs screenshot-to-code
- OpenLLMetry vs Langfuse
- OpenLLMetry vs promptfoo
- OpenLLMetry vs DeepEval
- OpenLLMetry vs Ragas
- OpenLLMetry vs Prompt flow
- OpenLLMetry vs Arize Phoenix
- OpenLLMetry vs Agenta
- OpenLLMetry vs Weave
Similar self-hosted ai apps
OpenClaw
Self-Hosted AIThe AI that actually does things
Hermes Agent
Self-Hosted AIThe AI agent that grows with you
OpenCode
Self-Hosted AIThe open source AI coding agent
Hugging Face Transformers
Self-Hosted AIState-of-the-art machine learning model library
Replaces OpenAI API
Langflow
Self-Hosted AIVisual framework for building AI agents and RAG pipelines
Replaces Vertex AI Agent Builder
Dify
Self-Hosted AIOpen-source platform for building production LLM apps
Replaces OpenAI Assistants, Vertex AI Agent Builder