SHSelfHostIndex
OP

OpenLLMetry

Open-source observability for LLM applications

Self-Hosted AI ★ 7.5k stars Medium setup Apache-2.0

OpenLLMetry is a set of OpenTelemetry extensions from Traceloop that add observability to LLM applications. It instruments calls to model providers and vector databases so traces and metrics can be sent to any self-hosted backend.

Official siteSource code

Key features

  • OpenTelemetry-based tracing
  • Instruments popular LLM SDKs
  • Vendor-neutral export
  • Vector database instrumentation

Strengths

  • Released under the Apache-2.0 license
  • First-class Docker support for quick deployment
  • Mature project with 7.5k GitHub stars
  • Written in Python

Is OpenLLMetry secure?

OSV.dev has no published security advisories for OpenLLMetry's repository. No known vulnerabilities is not proof of security: it means none have been publicly catalogued.

Source: OSV.dev, checked 2026-10-14. How this is measured.

OpenLLMetry replaces

Self-hosted LangSmith alternativesSelf-hosted Datadog LLM Observability alternatives

Health badge

Maintain OpenLLMetry? Add its health score to your README. The badge links back to this page.

SelfHostIndex: 91 · excellent

Markdown
[![SelfHostIndex health score for OpenLLMetry](https://selfhostindex.com/badge/openllmetry.svg)](https://selfhostindex.com/app/openllmetry/)
HTML
<a href="https://selfhostindex.com/app/openllmetry/"><img src="https://selfhostindex.com/badge/openllmetry.svg" alt="SelfHostIndex health score for OpenLLMetry"></a>
reStructuredText
.. image:: https://selfhostindex.com/badge/openllmetry.svg
   :alt: SelfHostIndex health score for OpenLLMetry
   :target: https://selfhostindex.com/app/openllmetry/

The score is recomputed on every nightly rebuild from public repository data — see how it is calculated.

Compare OpenLLMetry

8 head-to-head comparisons.

Similar self-hosted ai apps