OP

OpenLLMetry

Open-source observability for LLM applications

Self-Hosted AI ★ 7.4k stars Medium setup Apache-2.0

OpenLLMetry is a set of OpenTelemetry extensions from Traceloop that add observability to LLM applications. It instruments calls to model providers and vector databases so traces and metrics can be sent to any self-hosted backend.

Key features

  • OpenTelemetry-based tracing
  • Instruments popular LLM SDKs
  • Vendor-neutral export
  • Vector database instrumentation

Strengths

  • Released under the Apache-2.0 license
  • First-class Docker support for quick deployment
  • Mature project with 7.4k GitHub stars
  • Written in Python

OpenLLMetry replaces

Compare OpenLLMetry

18 head-to-head comparisons.

Similar self-hosted ai apps